00000001:02000400:1.0F:1789762630.143367:0:2955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1789762637.455521:0:3154:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1789762638.295154:0:3213:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1583 MB/s 00000001:01000000:3.0:1789762638.545158:0:3213:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1883 MB/s 00000001:01000000:3.0:1789762638.794861:0:3213:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 11483 MB/s 00000020:02000000:2.0F:1789762639.025260:0:3245:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_106_ge548d24 00008000:02000000:2.0:1789762641.405261:0:3413:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000020:01000004:3.0:1789762661.357362:0:5793:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789762661.357366:0:5793:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789762661.357479:0:5793:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c42d22be 00000080:02000400:3.0:1789762661.357488:0:5793:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789762661.359925:0:5793:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789762661.359934:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789762661.359956:0:5793:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000047cdf53a) 00000020:00000080:3.0:1789762661.359970:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789762661.367688:0:5793:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789762661.367959:0:5793:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789762661.378883:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789762661.378924:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789762661.378937:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789762661.378980:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789762661.379009:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789762661.379310:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789762661.379316:0:5793:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789762661.379324:0:5793:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd08452c77c56da4a 00000020:01000004:1.0:1789762661.379330:0:5793:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789762661.379334:0:5793:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789762661.379337:0:5793:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c42d22be from MGS 00000020:01000004:1.0:1789762661.379341:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789762661.379354:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e815be4d) 00000020:00000080:1.0:1789762661.379361:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789762661.379413:0:5793:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c42d22be from MGS, refs=2 00080000:01000000:1.0:1789762661.379417:0:5793:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789762661.379420:0:5793:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd08452c77c56da58 00000100:00100000:1.0:1789762661.379500:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789762661.379602:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789762661.379605:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789762661.379962:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789762661.379971:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789762661.380403:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789762661.380512:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789762661.380516:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789762661.380757:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789762661.380763:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789762661.380955:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789762661.380962:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789762661.381257:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762661.381261:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762661.381263:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762661.381390:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762661.381392:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762661.381394:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762661.381712:0:5793:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789762661.384010:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789762661.630964:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6683 MB/s 00000001:01000000:1.0:1789762661.880933:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7539 MB/s 00000001:01000000:1.0:1789762662.131161:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1379 MB/s 00000001:01000000:1.0:1789762662.380890:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1835 MB/s 00080000:10000000:1.0:1789762662.384545:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1789762662.390556:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789762662.390564:0:5793:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789762662.390567:0:5793:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789762662.391040:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789762662.391077:0:5793:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789762662.391139:0:5793:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789762662.391504:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789762662.391534:0:5793:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789762662.391967:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789762662.392226:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789762662.392240:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789762662.393026:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789762662.393033:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789762662.393463:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789762662.393481:0:5793:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.131@tcp' 00000020:01000004:1.0:1789762662.393483:0:5793:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789762662.393518:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.131@tcp (typ=mgc) 00000020:00000080:1.0:1789762662.393528:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.131@tcp (000000000c701cd1) 00000020:00000080:1.0:1789762662.393540:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789762662.393601:0:5793:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a47175c7@MGC192.168.203.131@tcp: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1789762662.393806:0:5793:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.131@tcp-0 is initialized 00000040:01000000:1.0:1789762662.393813:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 1 is initialized 00000020:00000080:2.0:1789762662.395645:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.131@tcp (uuid 27f3d6dd-3aeb-4425-9393-dc1bb3ae146f) 00000020:00000080:2.0:1789762662.395668:0:5793:0:(genops.c:1385:class_connect()) connect: client 27f3d6dd-3aeb-4425-9393-dc1bb3ae146f, cookie 0xd08452c77c56da66 00000100:00080000:2.0:1789762662.395681:0:5793:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789762662.395685:0:5793:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import 00000000a47175c7 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1789762662.395750:0:5793:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000345d0c95 x1876702148952192/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789762662.395948:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000345d0c95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3275:1876702148952192:0@lo:250: 00000100:00100000:2.0:1789762662.395991:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762662.396030:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148952192 00000100:00100000:1.0:1789762662.396037:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148952192 00000100:00080000:2.0:1789762662.396053:0:5793:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 27f3d6dd-3aeb-4425-9393-dc1bb3ae146f->MGS 00000100:00100000:1.0:1789762662.396071:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000004:2.0:1789762662.396077:0:5793:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:1.0:1789762662.396079:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000614dbf8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3275:x1876702148952192:12345-0@lo:250: 00010000:00080000:1.0:1789762662.396100:0:5805:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 27f3d6dd-3aeb-4425-9393-dc1bb3ae146f@0@lo t0 exp 0000000000000000 cur 66 last 0 00000020:01000004:2.0:1789762662.396109:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789762662.396119:0:5805:0:(genops.c:1385:class_connect()) connect: client 27f3d6dd-3aeb-4425-9393-dc1bb3ae146f, cookie 0xd08452c77c56da6d 00000020:00000080:2.0:1789762662.396131:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000008efe6f4e) 00000020:00000080:2.0:1789762662.396149:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1789762662.396260:0:5805:0:(import.c:65:import_set_state_nolock()) 000000001834dc4b : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789762662.396308:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000614dbf8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:3275:x1876702148952192:12345-0@lo:250: Request processed in 229us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762662.396315:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789762662.401815:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789762662.401996:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789762662.402000:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789762662.402542:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789762662.402547:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789762662.402988:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789762662.402992:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789762662.403679:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789762662.403912:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789762662.403916:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789762662.427958:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789762662.428139:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789762662.428143:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789762662.431943:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789762662.431951:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789762662.432458:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789762662.432578:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789762662.432582:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789762662.432978:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789762662.432982:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789762662.433485:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789762662.433582:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789762662.433585:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789762662.434074:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789762662.434079:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789762662.434538:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789762662.434633:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789762662.434636:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789762662.435050:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789762662.435057:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00010000:00010000:1.0:1789762662.438893:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762662.448098:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789762662.448297:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789762662.448303:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789762662.450088:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789762662.450096:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789762662.453328:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789762662.453337:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789762662.453726:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789762662.453746:0:5793:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789762662.453751:0:5793:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789762662.453880:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789762662.453914:0:5793:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789762662.453918:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789762662.453922:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789762662.453922:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789762662.453923:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789762662.453924:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789762662.453925:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789762662.453926:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789762662.453927:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789762662.453928:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789762662.453929:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789762662.453930:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789762662.453931:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789762662.453932:0:5793:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789762662.453934:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789762662.453935:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789762662.453935:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789762662.453936:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789762662.453937:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789762662.453937:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789762662.453938:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789762662.453939:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789762662.453939:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789762662.453940:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789762662.453940:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789762662.453941:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789762662.453962:0:5793:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789762662.453975:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148952320:0@lo:253: 00000100:00100000:2.0:1789762662.454036:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762662.454073:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148952320 00000100:00100000:2.0:1789762662.454083:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099eb44c4 going to sleep for 11 seconds 00000100:00100000:1.0:1789762662.454087:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148952320 00000100:00100000:1.0:1789762662.454135:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789762662.454144:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c56b0074 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:5793:x1876702148952320:12345-0@lo:253: 20000000:01000000:1.0:1789762662.454193:0:5808:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789762662.454196:0:5808:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789762662.454389:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789762662.454416:0:5808:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789762662.454676:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789762662.455542:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000040:00080000:3.0:1789762662.458062:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789762662.458078:0:5808:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.131@tcp for mdt 20000000:01000000:3.0:1789762662.458080:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:3.0:1789762662.458102:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789762662.458107:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789762662.458124:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789762662.458128:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:3.0:1789762662.458153:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789762662.458160:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789762662.458178:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789762662.458210:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789762662.458250:0:5808:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789762662.458252:0:5808:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789762662.458256:0:5808:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789762662.458260:0:5808:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789762662.458508:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789762662.464281:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789762662.464307:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789762662.464328:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1789762662.464335:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789762662.464336:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789762662.464552:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000100:00100000:3.0:1789762662.561230:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c56b0074 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:5793:x1876702148952320:12345-0@lo:253: Request processed in 107083us (107191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762662.561246:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789762662.561256:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148952320:0@lo:253: 10000000:01000000:2.0:1789762662.561276:0:5793:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789762662.561280:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789762662.561282:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789762662.561283:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789762662.561285:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789762662.561286:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789762662.561286:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789762662.561288:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789762662.561289:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789762662.561295:0:5793:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789762662.561296:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789762662.561297:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789762662.561314:0:5793:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c42d22be from lustre-MDT0000 10000000:01000000:2.0:1789762662.561331:0:5793:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789762662.561333:0:5793:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789762662.561336:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff95d148f33370 10000000:01000000:2.0:1789762662.561339:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789762662.561344:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95d148f33370 from 1 10000000:01000000:2.0:1789762662.561346:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789762662.561373:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000004dfac489/0xd08452c77c56da82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.561381:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000004dfac489/0xd08452c77c56da82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.561387:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000004dfac489/0xd08452c77c56da82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762662.561399:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148952448:0@lo:101: 00000100:00100000:2.0:1789762662.561428:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762662.561484:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000001db68671 going to sleep for 11 seconds 00000100:00100000:1.0:1789762662.561534:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148952448 00000100:00100000:1.0:1789762662.561548:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148952448 00000100:00100000:1.0:1789762662.561596:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789762662.561606:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000324f0277 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:5793:x1876702148952448:12345-0@lo:101: 00010000:00010000:1.0:1789762662.561624:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762662.561641:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c84d6bf/0xd08452c77c56da89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56da82 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.561664:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c84d6bf/0xd08452c77c56da89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56da82 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.561673:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c84d6bf/0xd08452c77c56da89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56da82 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.561681:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c84d6bf, rc 0) 00000100:00100000:1.0:1789762662.561744:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000324f0277 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+6:5793:x1876702148952448:12345-0@lo:101: Request processed in 139us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762662.561749:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789762662.561777:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148952448:0@lo:101: 00010000:00010000:2.0:1789762662.561793:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000004dfac489/0xd08452c77c56da82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56da89 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.561800:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000004dfac489/0xd08452c77c56da82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56da89 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762662.561848:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148952576:0@lo:501: 00000100:00100000:2.0:1789762662.561872:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762662.561900:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000001db68671 going to sleep for 11 seconds 00000100:00100000:3.0:1789762662.561911:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148952576 00000100:00100000:3.0:1789762662.561917:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148952576 00000100:00100000:3.0:1789762662.561949:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789762662.561955:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021f8f634 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+6:5793:x1876702148952576:12345-0@lo:501: 00000100:00100000:3.0:1789762662.562088:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021f8f634 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+6:5793:x1876702148952576:12345-0@lo:501: Request processed in 133us (215us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789762662.562097:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789762662.562126:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148952576:0@lo:501: 10000000:01000000:2.0:1789762662.562152:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789762662.562163:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000004dfac489/0xd08452c77c56da82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56da89 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.562169:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000004dfac489/0xd08452c77c56da82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56da89 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762662.562174:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d1549a0000 10000000:01000000:2.0:1789762662.562177:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789762662.562181:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95d1549a0000 10000000:01000000:2.0:1789762662.562183:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789762662.562184:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95d1549a0000 from 1 10000000:01000000:2.0:1789762662.562186:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789762662.562197:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000cb5bea4d/0xd08452c77c56da90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.562202:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000cb5bea4d/0xd08452c77c56da90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.562207:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000cb5bea4d/0xd08452c77c56da90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762662.562214:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148952704:0@lo:101: 00000100:00100000:2.0:1789762662.562236:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762662.562254:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000001db68671 going to sleep for 11 seconds 00000100:00100000:1.0:1789762662.562318:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148952704 00000100:00100000:1.0:1789762662.562325:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148952704 00000100:00100000:1.0:1789762662.562355:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789762662.562362:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6fd73f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+6:5793:x1876702148952704:12345-0@lo:101: 00010000:00010000:1.0:1789762662.562377:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762662.562386:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000866ae6ab/0xd08452c77c56da97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56da90 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.562399:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000866ae6ab/0xd08452c77c56da97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56da90 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.562405:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000866ae6ab/0xd08452c77c56da97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56da90 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.562410:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000866ae6ab, rc 0) 00000100:00100000:1.0:1789762662.562465:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6fd73f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+7:5793:x1876702148952704:12345-0@lo:101: Request processed in 104us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762662.562475:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789762662.562500:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148952704:0@lo:101: 00010000:00010000:2.0:1789762662.562512:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000cb5bea4d/0xd08452c77c56da90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56da97 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.562523:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000cb5bea4d/0xd08452c77c56da90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56da97 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762662.562531:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789762662.562539:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000cb5bea4d/0xd08452c77c56da90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56da97 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.562544:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000cb5bea4d/0xd08452c77c56da90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56da97 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762662.562549:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789762662.562551:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789762662.562554:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95d1549a0000 10000000:01000000:2.0:1789762662.562556:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789762662.562558:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789762662.562560:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789762662.562571:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000fe769bcf/0xd08452c77c56da9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.562575:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000fe769bcf/0xd08452c77c56da9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.562579:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000fe769bcf/0xd08452c77c56da9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762662.562586:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148952832:0@lo:101: 00000100:00100000:2.0:1789762662.562608:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762662.562621:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000001db68671 going to sleep for 11 seconds 00000100:00100000:3.0:1789762662.562658:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148952832 00000100:00100000:3.0:1789762662.562664:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148952832 00000100:00100000:3.0:1789762662.562692:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789762662.562699:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c7245b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+7:5793:x1876702148952832:12345-0@lo:101: 00010000:00010000:3.0:1789762662.562708:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762662.562717:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000076f928ca/0xd08452c77c56daa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56da9e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762662.562738:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000076f928ca/0xd08452c77c56daa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56da9e expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762662.562745:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000076f928ca/0xd08452c77c56daa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56da9e expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762662.562751:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000076f928ca, rc 0) 00000100:00100000:3.0:1789762662.562781:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c7245b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+8:5793:x1876702148952832:12345-0@lo:101: Request processed in 84us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762662.562787:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789762662.562806:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148952832:0@lo:101: 00010000:00010000:2.0:1789762662.562815:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000fe769bcf/0xd08452c77c56da9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56daa5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.562821:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000fe769bcf/0xd08452c77c56da9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56daa5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762662.562860:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148952960:0@lo:501: 00000100:00100000:2.0:1789762662.562879:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762662.562896:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000001db68671 going to sleep for 11 seconds 00000100:00100000:1.0:1789762662.562953:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148952960 00000100:00100000:1.0:1789762662.562960:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148952960 00000100:00100000:1.0:1789762662.562991:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789762662.562999:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003262ecb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+8:5793:x1876702148952960:12345-0@lo:501: 00000100:00100000:1.0:1789762662.563175:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003262ecb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:5793:x1876702148952960:12345-0@lo:501: Request processed in 177us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762662.563182:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789762662.563219:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148952960:0@lo:501: 00000100:00100000:2.0:1789762662.563248:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148953088:0@lo:503: 00000100:00100000:2.0:1789762662.563290:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762662.563305:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000001db68671 going to sleep for 11 seconds 00000100:00100000:3.0:1789762662.563332:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148953088 00000100:00100000:3.0:1789762662.563337:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148953088 00000100:00100000:3.0:1789762662.563360:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789762662.563364:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f87407e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:5793:x1876702148953088:12345-0@lo:503: 00000100:00100000:3.0:1789762662.563501:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f87407e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:5793:x1876702148953088:12345-0@lo:503: Request processed in 137us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762662.563507:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789762662.563531:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148953088:0@lo:503: 00000100:00100000:2.0:1789762662.563738:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5835:1876702148953216:0@lo:502: 00000100:00100000:2.0:1789762662.563763:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762662.563778:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3724c23 going to sleep for 11 seconds 00000100:00100000:1.0:1789762662.563856:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148953216 00000100:00100000:1.0:1789762662.563863:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148953216 00000100:00100000:1.0:1789762662.563894:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789762662.563900:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a9b16e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:5835:x1876702148953216:12345-0@lo:502: 00000100:00100000:1.0:1789762662.564057:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a9b16e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:5835:x1876702148953216:12345-0@lo:502: Request processed in 158us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762662.564064:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789762662.564100:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5835:1876702148953216:0@lo:502: 00000020:01000000:2.0:1789762662.564130:0:5835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762662.564141:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762662.564143:0:5835:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789762662.564147:0:5835:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789762662.564149:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789762662.564159:0:5835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000002dfcf193) 00000020:00000080:2.0:1789762662.564172:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789762662.564180:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789762662.564229:0:5835:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789762662.564236:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd08452c77c56dab3 00000020:00000080:2.0:1789762662.564400:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789762662.564404:0:5835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762662.564406:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762662.564407:0:5835:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789762662.564409:0:5835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762662.564411:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762662.564412:0:5835:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789762662.564414:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789762662.564419:0:5835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000955234a7) 00000020:00000080:2.0:1789762662.564426:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789762662.564428:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789762662.564429:0:5835:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789762662.564431:0:5835:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789762662.564435:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789762662.564488:0:5835:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c42d22be from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789762662.564498:0:5835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000003bd8002c) 00000020:00000080:2.0:1789762662.564504:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789762662.564540:0:5835:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789762662.564543:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd08452c77c56dac8 00000020:00000080:2.0:1789762662.564611:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789762662.564615:0:5835:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789762662.564618:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd08452c77c56dacf 00080000:01000000:2.0:1789762662.564621:0:5835:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789762662.564623:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd08452c77c56dad6 00080000:10000000:2.0:1789762662.564884:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789762662.565025:0:5835:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789762662.567248:0:5835:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789762662.601948:0:5835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789762662.602192:0:5835:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789762662.603604:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789762662.603725:0:5835:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789762662.613291:0:5835:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fc4b5b19) 00000020:00000080:2.0:1789762662.613306:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789762662.613374:0:5835:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789762662.613379:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd08452c77c56dae4 00000020:00000080:3.0:1789762662.613698:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789762662.615053:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789762662.627580:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789762662.637037:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789762662.647151:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789762662.659478:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789762662.673073:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1789762662.683433:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789762662.683453:0:5835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762662.683458:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762662.683460:0:5835:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789762662.683463:0:5835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762662.683468:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762662.683469:0:5835:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789762662.683472:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789762662.683498:0:5835:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789762662.683508:0:5835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762662.683510:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762662.683510:0:5835:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789762662.683512:0:5835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762662.683514:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762662.683514:0:5835:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789762662.683516:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789762662.683517:0:5835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789762662.683551:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5835:1876702148953344:0@lo:502: 00000100:00100000:2.0:1789762662.683613:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762662.683655:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9da69a9 going to sleep for 11 seconds 00000100:00100000:3.0:1789762662.683655:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148953344 00000100:00100000:3.0:1789762662.683665:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148953344 00000100:00100000:3.0:1789762662.683703:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789762662.683710:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d81ebec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:5835:x1876702148953344:12345-0@lo:502: 00000100:00100000:3.0:1789762662.683985:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d81ebec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:5835:x1876702148953344:12345-0@lo:502: Request processed in 275us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762662.683993:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789762662.684009:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5835:1876702148953344:0@lo:502: 00000020:01000000:2.0:1789762662.684041:0:5835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762662.684045:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762662.684046:0:5835:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789762662.684048:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000100:00100000:1.0:1789762662.684361:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148953472 00000100:00100000:1.0:1789762662.684373:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148953472 00000100:00100000:1.0:1789762662.684414:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789762662.684425:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2cefe40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:5793:x1876702148953472:12345-0@lo:101: 00010000:00010000:1.0:1789762662.684455:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762662.684474:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f51bbf31/0xd08452c77c56daf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56daf2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.684504:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f51bbf31/0xd08452c77c56daf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56daf2 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.684518:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f51bbf31/0xd08452c77c56daf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56daf2 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.684529:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f51bbf31, rc 0) 00000100:00100000:1.0:1789762662.684595:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2cefe40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+10:5793:x1876702148953472:12345-0@lo:101: Request processed in 173us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762662.684602:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789762662.685200:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148953600 00000100:00100000:3.0:1789762662.685206:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148953600 00000100:00100000:3.0:1789762662.685232:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789762662.685238:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f0c9bd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+10:5793:x1876702148953600:12345-0@lo:256: 20000000:01000000:3.0:1789762662.685251:0:5808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789762662.685255:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789762662.685321:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f0c9bd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+10:5793:x1876702148953600:12345-0@lo:256: Request processed in 83us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762662.685327:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789762662.685946:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148953728 00000100:00100000:1.0:1789762662.685953:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148953728 00000100:00100000:1.0:1789762662.685988:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789762662.685997:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4e3a570 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+10:5793:x1876702148953728:12345-0@lo:101: 00010000:00010000:1.0:1789762662.686005:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762662.686013:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000586b96f8/0xd08452c77c56db07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56db00 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.686025:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000586b96f8/0xd08452c77c56db07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56db00 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.686032:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000586b96f8/0xd08452c77c56db07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56db00 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.686044:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000586b96f8, rc 0) 00000100:00100000:1.0:1789762662.686087:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4e3a570 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:5793:x1876702148953728:12345-0@lo:101: Request processed in 92us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762662.686092:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789762662.686210:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148953856 00000100:00100000:3.0:1789762662.686214:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148953856 00000100:00100000:3.0:1789762662.686236:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789762662.686242:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002dff2bec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:5793:x1876702148953856:12345-0@lo:501: 00000100:00100000:3.0:1789762662.686604:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002dff2bec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:5793:x1876702148953856:12345-0@lo:501: Request processed in 363us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762662.686611:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789762662.686737:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148953984 00000100:00100000:1.0:1789762662.686744:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148953984 00000100:00100000:1.0:1789762662.686772:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789762662.686780:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028faecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:5793:x1876702148953984:12345-0@lo:503: 00000040:00080000:1.0:1789762662.686822:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789762662.686894:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028faecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:5793:x1876702148953984:12345-0@lo:503: Request processed in 117us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762662.686901:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000000:2.0:1789762662.687556:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789762662.687570:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789762662.687580:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000008dde2b74/0xd08452c77c56db00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db07 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.687588:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000008dde2b74/0xd08452c77c56db00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db07 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762662.687609:0:5793:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789762662.687611:0:5793:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d1549a0000 10000000:01000000:2.0:1789762662.687614:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d1549a0000 10000000:01000000:2.0:1789762662.687617:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789762662.687620:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d1549a0000 from 1 10000000:01000000:2.0:1789762662.687621:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789762662.687633:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.687638:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.687642:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762662.687650:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148954112:0@lo:101: 00000100:00100000:2.0:1789762662.687676:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762662.687696:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e14092b going to sleep for 11 seconds 00000100:00100000:3.0:1789762662.687707:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148954112 00000100:00100000:3.0:1789762662.687712:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148954112 00000100:00100000:3.0:1789762662.687737:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789762662.687743:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7ad6e76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:5793:x1876702148954112:12345-0@lo:101: 00010000:00010000:3.0:1789762662.687750:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762662.687758:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa3a121b/0xd08452c77c56db15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56db0e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762662.687772:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa3a121b/0xd08452c77c56db15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56db0e expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762662.687778:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa3a121b/0xd08452c77c56db15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56db0e expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762662.687794:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa3a121b, rc 0) 00000100:00100000:3.0:1789762662.687823:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7ad6e76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:5793:x1876702148954112:12345-0@lo:101: Request processed in 81us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762662.687828:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789762662.687875:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148954112:0@lo:101: 00010000:00010000:2.0:1789762662.687884:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db15 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.687889:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56db15 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762662.687914:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148954240:0@lo:501: 00000100:00100000:2.0:1789762662.687933:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762662.687952:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e14092b going to sleep for 11 seconds 00000100:00100000:1.0:1789762662.688007:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148954240 00000100:00100000:1.0:1789762662.688014:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148954240 00000100:00100000:1.0:1789762662.688043:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789762662.688050:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093de71ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:5793:x1876702148954240:12345-0@lo:501: 00000100:00100000:1.0:1789762662.688206:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093de71ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:5793:x1876702148954240:12345-0@lo:501: Request processed in 157us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762662.688212:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789762662.688244:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148954240:0@lo:501: 00000100:00100000:2.0:1789762662.688275:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a9d3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148954368:0@lo:503: 00000100:00100000:2.0:1789762662.688310:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762662.688325:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e14092b going to sleep for 11 seconds 00000100:00100000:3.0:1789762662.688341:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148954368 00000100:00100000:3.0:1789762662.688345:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148954368 00000100:00100000:3.0:1789762662.688369:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789762662.688372:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092bd493b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:5793:x1876702148954368:12345-0@lo:503: 00000100:00100000:3.0:1789762662.688617:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092bd493b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:5793:x1876702148954368:12345-0@lo:503: Request processed in 244us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762662.688623:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789762662.688914:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148954496 00000100:00100000:2.0:1789762662.688921:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148954496 00000100:00100000:2.0:1789762662.688953:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789762662.688959:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2c7dd1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:5840:x1876702148954496:12345-0@lo:502: 00000100:00100000:2.0:1789762662.689116:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2c7dd1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:5840:x1876702148954496:12345-0@lo:502: Request processed in 156us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762662.689125:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789762662.690719:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dd57337 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876702148954624:0@lo:38: 00000100:00100000:2.0:1789762662.690769:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762662.691041:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a63ba73 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5840:1876702148954752:0@lo:502: 00000100:00100000:1.0:1789762662.691094:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762662.691131:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000974001ee going to sleep for 11 seconds 00000100:00100000:1.0:1789762662.691406:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a63ba73 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5840:1876702148954752:0@lo:502: 00000040:00080000:1.0:1789762662.691436:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789762662.691521:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789762662.691541:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789762662.691555:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db15 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.691570:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db15 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789762662.691606:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789762662.691608:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789762662.691609:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789762662.691610:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789762662.691611:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789762662.691612:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789762662.691613:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789762662.691614:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789762662.691615:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789762662.691616:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789762662.691617:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789762662.691618:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789762662.691620:0:5793:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789762662.691622:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789762662.691623:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789762662.691624:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789762662.691625:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789762662.691625:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789762662.691626:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789762662.691627:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789762662.691627:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789762662.691628:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789762662.691629:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789762662.691629:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789762662.691630:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789762662.691646:0:5793:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789762662.691654:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c6a1472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148954880:0@lo:253: 00000100:00100000:2.0:1789762662.691688:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762662.691706:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9da69a9 going to sleep for 11 seconds 00000100:00100000:1.0:1789762662.691727:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148954880 00000100:00100000:1.0:1789762662.691741:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148954880 00000100:00100000:1.0:1789762662.691777:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789762662.691786:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a2dd68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:5793:x1876702148954880:12345-0@lo:253: 20000000:01000000:1.0:1789762662.691806:0:5805:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789762662.691818:0:5805:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789762662.702650:0:5828:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789762662.702658:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789762662.702674:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.702690:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f51bbf31/0xd08452c77c56daf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56daf2 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.702697:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.702725:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f51bbf31/0xd08452c77c56daf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56daf2 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.702741:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f51bbf31/0xd08452c77c56daf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56daf2 expref: 12 pid: 5805 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762662.702755:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a63ba73 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5828:1876702148955008:0@lo:104: 00000100:00100000:1.0:1789762662.702796:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762662.702922:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 00000000118b9ae6 going to sleep for 11 seconds 00000100:00100000:2.0:1789762662.702973:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148955008 00000100:00100000:2.0:1789762662.702980:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148955008 00000100:00100000:2.0:1789762662.703009:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789762662.703024:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079a9569c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:5828:x1876702148955008:12345-0@lo:104: 00010000:00010000:2.0:1789762662.703036:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 00000000113466cf/0xd08452c77c56daf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56daf9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762662.703038:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789762662.703048:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1789762662.703126:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789762662.703135:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a63ba73 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5828:1876702148955008:0@lo:104: 00000100:00100000:2.0:1789762662.703140:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079a9569c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:5828:x1876702148955008:12345-0@lo:104: Request processed in 114us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762662.703152:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789762662.703160:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.703245:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762662.703253:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000113466cf/0xd08452c77c56daf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56daf9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.703263:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000113466cf already unused, calling callback (000000003c7fefd3) 10000000:00010000:2.0:1789762662.703268:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000113466cf/0xd08452c77c56daf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56daf9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.703278:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000113466cf/0xd08452c77c56daf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56daf9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762662.703283:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000113466cf/0xd08452c77c56daf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56daf9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762662.703287:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789762662.703315:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000113466cf/0xd08452c77c56daf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56daf9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.703319:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789762662.703341:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000113466cf/0xd08452c77c56daf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56daf9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.703354:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000113466cf/0xd08452c77c56daf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56daf9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762662.703369:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762662.703370:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000483f07e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702148955136:0@lo:103: 00010000:00010000:2.0:1789762662.703371:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762662.703379:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762662.703431:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762662.703509:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148955136 00000100:00100000:1.0:1789762662.703518:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148955136 00010000:00010000:1.0:1789762662.703544:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f51bbf31/0xd08452c77c56daf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56daf2 expref: 13 pid: 5805 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762662.703573:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789762662.703586:0:5798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789762662.703595:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d80b075 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:3277:x1876702148955136:12345-0@lo:103: 00000100:00100000:3.0:1789762662.703601:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789762662.703613:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762662.703620:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f51bbf31/0xd08452c77c56daf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56daf2 expref: 13 pid: 5805 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.703634:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f51bbf31/0xd08452c77c56daf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56daf2 expref: 13 pid: 5805 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.703653:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f51bbf31/0xd08452c77c56daf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56daf2 expref: 13 pid: 5805 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.703673:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.703681:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789762662.703699:0:5797:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001041595s 00010000:00010000:1.0:1789762662.703703:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.703712:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.703718:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.703723:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.703728:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b9e19ee already unused, calling callback (00000000b477c031) 00010000:00010000:1.0:1789762662.703737:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.703744:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.703769:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.703779:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762662.703875:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d80b075 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:3277:x1876702148955136:12345-0@lo:103: Request processed in 288us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762662.703884:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789762662.703926:0:5828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.703932:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762662.703937:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003b9e19ee/0xd08452c77c56db2a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762662.703993:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000483f07e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702148955136:0@lo:103: 00000100:00100000:1.0:1789762662.705428:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a2dd68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:5793:x1876702148954880:12345-0@lo:253: Request processed in 13644us (13738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762662.705434:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789762662.705474:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c6a1472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5793:1876702148954880:0@lo:253: 10000000:01000000:2.0:1789762662.705484:0:5793:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789762662.705485:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789762662.705486:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789762662.705487:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789762662.705488:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789762662.705488:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789762662.705489:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789762662.705490:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789762662.705490:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789762662.705491:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789762662.705492:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789762662.705493:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789762662.705494:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789762662.705501:0:5793:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789762662.708409:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789762662.708711:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789762662.708882:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789762662.709016:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789762662.709228:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789762662.709369:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 40000000:02000000:2.0:1789762662.724624:0:5793:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000020:00080000:2.0:1789762662.735700:0:5847:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789762662.735704:0:5847:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789762662.735708:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1789762662.735936:0:5848:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789762662.740747:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789762662.741885:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789762662.742254:0:5793:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789762662.742263:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789762662.742431:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789762662.743309:0:5793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789762662.743797:0:5793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789762662.743861:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789762662.744207:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789762662.744634:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789762662.747506:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789762662.747974:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789762662.748549:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789762662.749051:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789762662.749388:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789762662.749807:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789762662.750220:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789762662.750645:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789762662.751064:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789762662.751269:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789762662.751557:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789762662.751828:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789762662.752228:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789762662.752483:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789762662.753093:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789762662.753680:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789762662.754888:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789762662.755276:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789762662.755978:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789762662.756590:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789762662.757311:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789762662.758040:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789762662.758702:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789762662.759222:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789762662.759869:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789762662.760530:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789762662.761234:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789762662.761942:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789762662.762577:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789762662.763257:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789762662.763897:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789762662.764560:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789762662.765177:0:5793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789762662.773417:0:5848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789762662.773542:0:5848:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789762662.773547:0:5848:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1789762662.786335:0:5793:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789762662.786367:0:5793:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbeb841d93988 00100000:10000000:1.0:1789762662.786376:0:5793:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789762662.786710:0:5793:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789762662.786732:0:5793:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789762662.786760:0:5793:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1789762662.786777:0:5793:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789762663.462897:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789762664.056648:0:6090:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789762664.487905:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762665.510954:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789762666.201501:0:6291:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe43f166b0 20000000:00000080:3.0:1789762666.201513:0:6291:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d160279800 uarg=0000000000000000 20000000:01000000:3.0:1789762666.201542:0:6291:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789762666.201548:0:6291:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789762666.201552:0:6291:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789762666.201706:0:6291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789762666.201718:0:6291:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789762666.203711:0:6291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789762666.203933:0:6291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789762666.203973:0:6291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789762666.204003:0:6291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789762666.204011:0:6291:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789762666.204023:0:6291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000051abacd/0xd08452c77c56db31 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762666.204038:0:6291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000586b96f8/0xd08452c77c56db07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56db00 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762666.204043:0:6291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000051abacd/0xd08452c77c56db31 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762666.204075:0:6291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000586b96f8/0xd08452c77c56db07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56db00 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762666.204088:0:6291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000586b96f8/0xd08452c77c56db07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56db00 expref: 10 pid: 5805 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762666.204103:0:6291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ccab73b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6291:1876702148955264:0@lo:104: 00000100:00100000:3.0:1789762666.204161:0:6291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762666.204217:0:6291:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed1ab20e going to sleep for 11 seconds 00000100:00100000:1.0:1789762666.204246:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148955264 00000100:00100000:1.0:1789762666.204254:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148955264 00000100:00100000:1.0:1789762666.204293:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789762666.204307:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c3fc2b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:6291:x1876702148955264:12345-0@lo:104: 00010000:00010000:1.0:1789762666.204316:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 000000008dde2b74/0xd08452c77c56db00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56db07 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204369:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789762666.204373:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c3fc2b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:6291:x1876702148955264:12345-0@lo:104: Request processed in 68us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762666.204379:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789762666.204399:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762666.204405:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 000000008dde2b74/0xd08452c77c56db00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56db07 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204423:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008dde2b74 already unused, calling callback (000000003c7fefd3) 10000000:00010000:1.0:1789762666.204426:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 000000008dde2b74/0xd08452c77c56db00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56db07 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204431:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 000000008dde2b74/0xd08452c77c56db00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56db07 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789762666.204437:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 000000008dde2b74/0xd08452c77c56db00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56db07 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762666.204454:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789762666.204478:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 000000008dde2b74/0xd08452c77c56db00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56db07 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204482:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789762666.204501:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 000000008dde2b74/0xd08452c77c56db00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56db07 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204514:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 000000008dde2b74/0xd08452c77c56db00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56db07 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204528:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762666.204530:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762666.204531:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762666.204613:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148955392 00000100:00100000:1.0:1789762666.204617:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148955392 00010000:00010000:1.0:1789762666.204635:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000586b96f8/0xd08452c77c56db07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56db00 expref: 11 pid: 5805 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762666.204654:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789762666.204660:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dd57337 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:3278:x1876702148955392:12345-0@lo:103: 00010000:00010000:1.0:1789762666.204669:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762666.204672:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000586b96f8/0xd08452c77c56db07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56db00 expref: 11 pid: 5805 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204679:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000586b96f8/0xd08452c77c56db07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56db00 expref: 11 pid: 5805 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204695:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000586b96f8/0xd08452c77c56db07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56db00 expref: 11 pid: 5805 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204703:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000051abacd/0xd08452c77c56db31 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204708:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000051abacd/0xd08452c77c56db31 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204725:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000051abacd/0xd08452c77c56db31 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204729:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000051abacd/0xd08452c77c56db31 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204732:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000051abacd/0xd08452c77c56db31 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204736:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000051abacd/0xd08452c77c56db31 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204739:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000051abacd already unused, calling callback (00000000b477c031) 00010000:00010000:1.0:1789762666.204741:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000051abacd/0xd08452c77c56db31 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204745:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000051abacd/0xd08452c77c56db31 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204756:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000051abacd/0xd08452c77c56db31 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762666.204762:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762666.204794:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dd57337 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+10:3278:x1876702148955392:12345-0@lo:103: Request processed in 133us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762666.204804:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789762666.204857:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032ddab41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148955392:0@lo:103: 00010000:00010000:2.0:1789762666.534929:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762667.558891:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789762667.960647:0:6651:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789762667.960651:0:6651:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789762667.960768:0:6651:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000258d390f 00000020:01000004:2.0:1789762667.960780:0:6651:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789762667.960790:0:6651:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789762667.960800:0:6651:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (0000000076855343) 00000020:00000080:2.0:1789762667.960810:0:6651:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789762667.966931:0:6651:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789762667.967109:0:6651:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789762667.977105:0:6651:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789762667.979717:0:6651:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789762667.979732:0:6651:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789762667.979764:0:6651:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789762667.979778:0:6651:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789762667.979961:0:6651:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789762667.979966:0:6651:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789762667.979971:0:6651:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd08452c77c56db3f 00000020:01000004:2.0:1789762667.979976:0:6651:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789762667.979991:0:6651:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789762667.979993:0:6651:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789762667.979998:0:6651:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789762667.980000:0:6651:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789762667.980007:0:6651:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000013264a3e) 00000020:00000080:2.0:1789762667.980012:0:6651:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789762667.981121:0:6651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789762667.981287:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789762667.981291:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789762667.981679:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789762667.981687:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789762667.981891:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789762667.981897:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789762667.983140:0:6651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789762667.983268:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789762667.983273:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789762667.983596:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789762667.983602:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789762667.994960:0:6651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789762667.995137:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789762667.995141:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789762667.996311:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789762667.996318:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789762667.996579:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789762667.996583:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789762667.998354:0:6651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789762667.998469:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789762667.998472:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789762667.998730:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789762667.998740:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789762668.022213:0:6651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789762668.022387:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789762668.022392:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789762668.022982:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789762668.022987:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789762668.023197:0:6651:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789762668.023217:0:6651:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789762668.023222:0:6651:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789762668.032858:0:6651:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789762668.032882:0:6651:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789762668.032886:0:6651:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789762668.032888:0:6651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789762668.032889:0:6651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789762668.032890:0:6651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789762668.032891:0:6651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789762668.032893:0:6651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789762668.032894:0:6651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789762668.032895:0:6651:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789762668.032896:0:6651:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789762668.032897:0:6651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789762668.032898:0:6651:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789762668.032900:0:6651:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789762668.032902:0:6651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789762668.032903:0:6651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789762668.032904:0:6651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789762668.032905:0:6651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789762668.032905:0:6651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789762668.032909:0:6651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789762668.032910:0:6651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789762668.032910:0:6651:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789762668.032911:0:6651:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789762668.032912:0:6651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789762668.032912:0:6651:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789762668.032932:0:6651:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789762668.032944:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148955520:0@lo:253: 00000100:00100000:3.0:1789762668.032992:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.033035:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9a6710b going to sleep for 11 seconds 00000040:00080000:3.0:1789762668.035665:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1789762668.035689:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1789762668.035730:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1789762668.035740:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789762668.035741:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789762668.036009:0:6667:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789762668.036038:0:6667:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789762668.036067:0:6667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789762668.036651:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789762668.036675:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789762668.036706:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789762668.036716:0:5808:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1789762668.036717:0:5808:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1789762668.036722:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789762668.036734:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.036746:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003c84d6bf/0xd08452c77c56da89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56da82 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.036750:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000076f928ca/0xd08452c77c56daa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56da9e expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.036754:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fa3a121b/0xd08452c77c56db15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56db0e expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.036763:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.036781:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fa3a121b/0xd08452c77c56db15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56db0e expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.036789:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fa3a121b/0xd08452c77c56db15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56db0e expref: 10 pid: 5808 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.036796:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd59f317 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5808:1876702148955648:0@lo:104: 00000100:00100000:3.0:1789762668.036818:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789762668.036868:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000076f928ca/0xd08452c77c56daa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56da9e expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.036875:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000076f928ca/0xd08452c77c56daa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56da9e expref: 10 pid: 5808 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.036881:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e17cf4c9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5808:1876702148955776:0@lo:104: 00000100:00100000:1.0:1789762668.036885:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148955648 00000100:00100000:3.0:1789762668.036896:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762668.036902:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148955648 00010000:00010000:3.0:1789762668.036924:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003c84d6bf/0xd08452c77c56da89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56da82 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.036931:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003c84d6bf/0xd08452c77c56da89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56da82 expref: 10 pid: 5805 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.036940:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8fbe2d2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5808:1876702148955904:0@lo:104: 00000100:00100000:1.0:1789762668.036945:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789762668.036955:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033dd23ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:5808:x1876702148955648:12345-0@lo:104: 00010000:00010000:1.0:1789762668.036966:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56db15 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.036966:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.036977:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf656795 going to sleep for 11 seconds 00000100:00100000:2.0:1789762668.036986:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:2.0:1789762668.036994:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:1.0:1789762668.037056:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789762668.037062:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033dd23ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:5808:x1876702148955648:12345-0@lo:104: Request processed in 111us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762668.037069:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789762668.037070:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd59f317 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5808:1876702148955648:0@lo:104: 00010000:00010000:2.0:1789762668.037083:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789762668.037087:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148955904 00010000:00010000:2.0:1789762668.037089:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56db15 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762668.037091:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148955904 00010000:00010000:2.0:1789762668.037101:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000093484017 already unused, calling callback (000000003c7fefd3) 10000000:00010000:2.0:1789762668.037105:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56db15 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037115:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56db15 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762668.037118:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789762668.037128:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e28f7397 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:5808:x1876702148955904:12345-0@lo:104: 10000000:00010000:2.0:1789762668.037129:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56db15 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.037133:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 000000004dfac489/0xd08452c77c56da82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56da89 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762668.037148:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789762668.037172:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789762668.037176:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e28f7397 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:5808:x1876702148955904:12345-0@lo:104: Request processed in 51us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762668.037181:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789762668.037181:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56db15 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037192:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789762668.037216:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56db15 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037223:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 0000000093484017/0xd08452c77c56db0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56db15 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.037227:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c6a1472 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148956032:0@lo:103: 00010000:00010000:1.0:1789762668.037244:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000fe769bcf/0xd08452c77c56da9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56daa5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.037258:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fe769bcf already unused, calling callback (000000003c7fefd3) 10000000:00010000:1.0:1789762668.037260:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000fe769bcf/0xd08452c77c56da9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56daa5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.037268:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789762668.037269:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000fe769bcf/0xd08452c77c56da9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56daa5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037269:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762668.037272:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762668.037275:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789762668.037283:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000fe769bcf/0xd08452c77c56da9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56daa5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762668.037287:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789762668.037312:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000fe769bcf/0xd08452c77c56da9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56daa5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.037312:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148956032 00000100:00100000:2.0:1789762668.037314:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e17cf4c9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5808:1876702148955776:0@lo:104: 00000100:00100000:3.0:1789762668.037317:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148956032 00010000:00010000:1.0:1789762668.037326:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789762668.037338:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8fbe2d2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5808:1876702148955904:0@lo:104: 00010000:00010000:1.0:1789762668.037342:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000fe769bcf/0xd08452c77c56da9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56daa5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.037342:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fa3a121b/0xd08452c77c56db15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56db0e expref: 11 pid: 5808 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037361:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.037364:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000fe769bcf/0xd08452c77c56da9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56daa5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.037381:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789762668.037392:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762668.037393:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005966a201 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:3279:x1876702148956032:12345-0@lo:103: 00010000:00010000:1.0:1789762668.037395:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762668.037411:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762668.037424:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762668.037430:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fa3a121b/0xd08452c77c56db15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56db0e expref: 11 pid: 5808 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762668.037431:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032ddab41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148956160:0@lo:103: 00010000:00010000:3.0:1789762668.037452:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fa3a121b/0xd08452c77c56db15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56db0e expref: 11 pid: 5808 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.037466:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fa3a121b/0xd08452c77c56db15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56db0e expref: 11 pid: 5808 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762668.037473:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789762668.037484:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762668.037499:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148956160 00000100:00100000:2.0:1789762668.037503:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148956160 00000100:00100000:1.0:1789762668.037510:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af1e47fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702148956288:0@lo:103: 00010000:00010000:2.0:1789762668.037521:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000076f928ca/0xd08452c77c56daa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56da9e expref: 11 pid: 5808 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.037523:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005966a201 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:3279:x1876702148956032:12345-0@lo:103: Request processed in 133us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762668.037539:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.037542:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789762668.037559:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148956288 00000100:00100000:2.0:1789762668.037564:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148956288 00000100:00100000:3.0:1789762668.037570:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789762668.037577:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003c84d6bf/0xd08452c77c56da89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56da82 expref: 11 pid: 5805 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.037582:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f353529b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:3276:x1876702148956160:12345-0@lo:103: 00010000:00010000:3.0:1789762668.037595:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762668.037599:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000076f928ca/0xd08452c77c56daa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56da9e expref: 11 pid: 5808 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.037605:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000076f928ca/0xd08452c77c56daa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56da9e expref: 11 pid: 5808 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762668.037615:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789762668.037622:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000076f928ca/0xd08452c77c56daa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56da9e expref: 11 pid: 5808 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762668.037627:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ca1d5b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:3277:x1876702148956288:12345-0@lo:103: 00010000:00010000:2.0:1789762668.037644:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762668.037644:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762668.037651:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003c84d6bf/0xd08452c77c56da89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56da82 expref: 10 pid: 5805 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037663:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003c84d6bf/0xd08452c77c56da89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56da82 expref: 10 pid: 5805 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.037678:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f353529b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+10:3276:x1876702148956160:12345-0@lo:103: Request processed in 100us (208us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762668.037679:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c84d6bf/0xd08452c77c56da89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56da82 expref: 10 pid: 5805 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.037684:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789762668.037703:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037710:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.037718:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c6a1472 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148956032:0@lo:103: 00010000:00010000:2.0:1789762668.037723:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037733:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037739:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037745:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037750:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bfb19ad0 already unused, calling callback (00000000b477c031) 00010000:00010000:2.0:1789762668.037754:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037762:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037777:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.037787:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762668.037791:0:5808:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.037797:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.037801:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bfb19ad0/0xd08452c77c56db4d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789762668.037815:0:5808:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789762668.037829:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ca1d5b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+8:3277:x1876702148956288:12345-0@lo:103: Request processed in 204us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762668.037872:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789762668.037892:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af1e47fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702148956288:0@lo:103: 00000100:00100000:2.0:1789762668.050063:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084b2167c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+7:6651:x1876702148955520:12345-0@lo:253: Request processed in 16964us (17067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762668.050075:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148955520:0@lo:253: 00000100:00100000:2.0:1789762668.050076:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 10000000:01000000:3.0:1789762668.050089:0:6651:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789762668.050092:0:6651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789762668.050094:0:6651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789762668.050095:0:6651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789762668.050096:0:6651:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789762668.050097:0:6651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789762668.050098:0:6651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789762668.050099:0:6651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789762668.050100:0:6651:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789762668.050101:0:6651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789762668.050103:0:6651:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789762668.050122:0:6651:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000258d390f from lustre-OST0000 10000000:01000000:3.0:1789762668.050138:0:6651:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789762668.050141:0:6651:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789762668.050147:0:6651:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d148f33370 local copy 10000000:01000000:3.0:1789762668.050150:0:6651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789762668.050170:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.050178:0:6651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.050185:0:6651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.050199:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148956416:0@lo:101: 00000100:00100000:3.0:1789762668.050230:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.050262:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb5e5550 going to sleep for 11 seconds 00000100:00100000:1.0:1789762668.050283:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148956416 00000100:00100000:1.0:1789762668.050289:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148956416 00000100:00100000:1.0:1789762668.050316:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789762668.050322:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000294167ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+7:6651:x1876702148956416:12345-0@lo:101: 00010000:00010000:1.0:1789762668.050331:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762668.050345:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eb082bf0/0xd08452c77c56db5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56db54 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.050358:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb082bf0/0xd08452c77c56db5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56db54 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.050365:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eb082bf0/0xd08452c77c56db5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56db54 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.050369:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eb082bf0, rc 0) 00000100:00100000:1.0:1789762668.050411:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000294167ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+8:6651:x1876702148956416:12345-0@lo:101: Request processed in 77us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762668.050418:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789762668.050428:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148956416:0@lo:101: 00010000:00010000:3.0:1789762668.050440:0:6651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd08452c77c56db5b expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.050448:0:6651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd08452c77c56db5b expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.050496:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148956544:0@lo:501: 00000100:00100000:3.0:1789762668.050524:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.050538:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb5e5550 going to sleep for 11 seconds 00000100:00100000:2.0:1789762668.050557:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148956544 00000100:00100000:2.0:1789762668.050562:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148956544 00000100:00100000:2.0:1789762668.050587:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789762668.050594:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d826e813 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+8:6651:x1876702148956544:12345-0@lo:501: 00000100:00100000:2.0:1789762668.050732:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d826e813 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+8:6651:x1876702148956544:12345-0@lo:501: Request processed in 140us (208us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789762668.050738:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789762668.050754:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148956544:0@lo:501: 10000000:01000000:3.0:1789762668.050768:0:6651:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789762668.050792:0:6651:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789762668.050795:0:6651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd08452c77c56db5b expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.050800:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd08452c77c56db5b expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.050804:0:6651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd08452c77c56db5b expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.050816:0:6651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789762668.050827:0:6651:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d15277f800 10000000:01000000:3.0:1789762668.050830:0:6651:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789762668.050854:0:6651:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff95d148f33370 00010000:00010000:2.0:1789762668.050856:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1789762668.050857:0:6651:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789762668.050862:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd08452c77c56db5b expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762668.050862:0:6651:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff95d148f33370 from 1 10000000:01000000:3.0:1789762668.050866:0:6651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789762668.050877:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bfb19ad0 already unused, calling callback (000000003c7fefd3) 00010000:00010000:3.0:1789762668.050880:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 0000000076f928ca/0xd08452c77c56db62 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762668.050881:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd08452c77c56db5b expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.050896:0:6651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 0000000076f928ca/0xd08452c77c56db62 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.050899:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd08452c77c56db5b expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.050904:0:6651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 0000000076f928ca/0xd08452c77c56db62 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762668.050916:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd08452c77c56db5b expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.050921:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148956672:0@lo:101: 10000000:01000000:2.0:1789762668.050929:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789762668.050947:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd08452c77c56db5b expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.050954:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789762668.050967:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789762668.050978:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d00c417 going to sleep for 11 seconds 00010000:00010000:2.0:1789762668.050980:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd08452c77c56db5b expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.050986:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000bfb19ad0/0xd08452c77c56db54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd08452c77c56db5b expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.050989:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789762668.050997:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762668.050999:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762668.051001:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762668.051005:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059242318 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148956800:0@lo:103: 00000100:00100000:3.0:1789762668.051026:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762668.051030:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148956672 00000100:00100000:1.0:1789762668.051037:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148956672 00000100:00100000:1.0:1789762668.051067:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789762668.051073:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007975cc7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+8:6651:x1876702148956672:12345-0@lo:101: 00010000:00010000:1.0:1789762668.051080:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762668.051087:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000586b96f8/0xd08452c77c56db69 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56db62 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.051098:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000586b96f8/0xd08452c77c56db69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56db62 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.051103:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000586b96f8/0xd08452c77c56db69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56db62 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.051107:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000586b96f8, rc 0) 00000100:00100000:1.0:1789762668.051134:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007975cc7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:6651:x1876702148956672:12345-0@lo:101: Request processed in 62us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762668.051148:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789762668.051157:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148956672:0@lo:101: 00010000:00010000:3.0:1789762668.051168:0:6651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 0000000076f928ca/0xd08452c77c56db62 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db69 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.051174:0:6651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 0000000076f928ca/0xd08452c77c56db62 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56db69 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762668.051175:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148956800 00000100:00100000:1.0:1789762668.051180:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148956800 10000000:01000000:3.0:1789762668.051191:0:6651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789762668.051203:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 0000000076f928ca/0xd08452c77c56db62 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db69 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762668.051204:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789762668.051211:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000339a5bbf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:3279:x1876702148956800:12345-0@lo:103: 00010000:00010000:3.0:1789762668.051220:0:6651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 0000000076f928ca/0xd08452c77c56db62 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db69 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.051221:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762668.051230:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eb082bf0/0xd08452c77c56db5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd08452c77c56db54 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762668.051232:0:6651:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789762668.051239:0:6651:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789762668.051245:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:3.0:1789762668.051245:0:6651:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789762668.051249:0:6651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789762668.051265:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000fa3a121b/0xd08452c77c56db70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.051271:0:6651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000fa3a121b/0xd08452c77c56db70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762668.051274:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000339a5bbf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+8:3279:x1876702148956800:12345-0@lo:103: Request processed in 63us (247us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762668.051283:0:6651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000fa3a121b/0xd08452c77c56db70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762668.051286:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789762668.051298:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148956928:0@lo:101: 00000100:00100000:1.0:1789762668.051312:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059242318 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148956800:0@lo:103: 00000100:00100000:3.0:1789762668.051330:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.051345:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d00c417 going to sleep for 11 seconds 00000100:00100000:2.0:1789762668.051359:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148956928 00000100:00100000:2.0:1789762668.051364:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148956928 00000100:00100000:2.0:1789762668.051389:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789762668.051395:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059e303c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+8:6651:x1876702148956928:12345-0@lo:101: 00010000:00010000:2.0:1789762668.051417:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762668.051424:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000093484017/0xd08452c77c56db77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56db70 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.051438:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000093484017/0xd08452c77c56db77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56db70 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.051446:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000093484017/0xd08452c77c56db77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56db70 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762668.051453:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000093484017, rc 0) 00000100:00100000:2.0:1789762668.051484:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059e303c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:6651:x1876702148956928:12345-0@lo:101: Request processed in 90us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762668.051489:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789762668.051499:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148956928:0@lo:101: 00010000:00010000:3.0:1789762668.051509:0:6651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000fa3a121b/0xd08452c77c56db70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db77 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.051515:0:6651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000fa3a121b/0xd08452c77c56db70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56db77 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.051552:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957056:0@lo:501: 00000100:00100000:3.0:1789762668.051570:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.051583:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d00c417 going to sleep for 11 seconds 00000100:00100000:1.0:1789762668.051598:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148957056 00000100:00100000:1.0:1789762668.051608:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148957056 00000100:00100000:1.0:1789762668.051631:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789762668.051634:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eba1518c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:6651:x1876702148957056:12345-0@lo:501: 00000100:00100000:1.0:1789762668.051743:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eba1518c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:6651:x1876702148957056:12345-0@lo:501: Request processed in 108us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762668.051749:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789762668.051759:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957056:0@lo:501: 00000100:00100000:3.0:1789762668.051780:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957184:0@lo:503: 00000100:00100000:3.0:1789762668.051807:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.051820:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d00c417 going to sleep for 11 seconds 00000100:00100000:2.0:1789762668.051858:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148957184 00000100:00100000:2.0:1789762668.051863:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148957184 00000100:00100000:2.0:1789762668.051896:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789762668.051903:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cc49db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:6651:x1876702148957184:12345-0@lo:503: 00000100:00100000:2.0:1789762668.052005:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cc49db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:6651:x1876702148957184:12345-0@lo:503: Request processed in 103us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762668.052011:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789762668.052019:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957184:0@lo:503: 00000040:00080000:3.0:1789762668.052172:0:6651:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789762668.052206:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957312:0@lo:502: 00000100:00100000:3.0:1789762668.052242:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.052263:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d00c417 going to sleep for 11 seconds 00000100:00100000:1.0:1789762668.052304:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148957312 00000100:00100000:1.0:1789762668.052310:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148957312 00000100:00100000:1.0:1789762668.052336:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789762668.052340:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000854d29ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:6651:x1876702148957312:12345-0@lo:502: 00000100:00100000:1.0:1789762668.052464:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000854d29ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:6651:x1876702148957312:12345-0@lo:502: Request processed in 123us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762668.052475:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789762668.052480:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957312:0@lo:502: 00000040:00080000:3.0:1789762668.052634:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789762668.052675:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789762668.052693:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789762668.052729:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789762668.052758:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789762668.052777:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789762668.052791:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957440:0@lo:502: 00000100:00100000:3.0:1789762668.052817:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.052859:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d00c417 going to sleep for 11 seconds 00000100:00100000:2.0:1789762668.052872:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148957440 00000100:00100000:2.0:1789762668.052880:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148957440 00000100:00100000:2.0:1789762668.052912:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789762668.052920:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095ac4008 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:6651:x1876702148957440:12345-0@lo:502: 00000100:00100000:2.0:1789762668.053032:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095ac4008 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:6651:x1876702148957440:12345-0@lo:502: Request processed in 113us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762668.053038:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789762668.053046:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957440:0@lo:502: 00000040:00080000:3.0:1789762668.053128:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789762668.053138:0:6651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789762668.053431:0:6674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789762668.053437:0:6674:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789762668.053442:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762668.053444:0:6674:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789762668.053458:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789762668.053469:0:6674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000007e59aef7) 00000020:00000080:3.0:1789762668.053484:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789762668.053487:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789762668.053534:0:6674:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000258d390f from lustre-OST0000, refs=2 00080000:01000000:3.0:1789762668.053539:0:6674:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789762668.053543:0:6674:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd08452c77c56db85 00010000:00010000:3.0:1789762668.056157:0:6674:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789762668.056286:0:6674:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789762668.057723:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789762668.057815:0:6674:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789762668.061241:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789762668.061571:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789762668.062243:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789762668.062248:0:6674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789762668.062251:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762668.062252:0:6674:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789762668.062255:0:6674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789762668.062257:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762668.062258:0:6674:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789762668.062260:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789762668.062261:0:6674:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789762668.062281:0:6674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789762668.062284:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762668.062286:0:6674:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789762668.062287:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789762668.062334:0:6651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789762668.062357:0:6651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789762668.062367:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000fa3a121b/0xd08452c77c56db70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db77 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.062382:0:6651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000fa3a121b/0xd08452c77c56db70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db77 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762668.062388:0:6651:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d15277f800 from 1 10000000:01000000:3.0:1789762668.062389:0:6651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789762668.062414:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 0000000047d0ab47/0xd08452c77c56db8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.062419:0:6651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 0000000047d0ab47/0xd08452c77c56db8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.062424:0:6651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 0000000047d0ab47/0xd08452c77c56db8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.062433:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957568:0@lo:101: 00000100:00100000:3.0:1789762668.062459:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762668.062490:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148957568 00000100:00100000:3.0:1789762668.062492:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fdc7768 going to sleep for 11 seconds 00000100:00100000:1.0:1789762668.062496:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148957568 00000100:00100000:1.0:1789762668.062523:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789762668.062529:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000130ac73f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+9:6651:x1876702148957568:12345-0@lo:101: 00010000:00010000:1.0:1789762668.062536:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762668.062543:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eb082bf0/0xd08452c77c56db93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56db8c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.062555:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb082bf0/0xd08452c77c56db93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56db8c expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.062561:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eb082bf0/0xd08452c77c56db93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56db8c expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.062566:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eb082bf0, rc 0) 00000100:00100000:1.0:1789762668.062595:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000130ac73f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+10:6651:x1876702148957568:12345-0@lo:101: Request processed in 68us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762668.062607:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789762668.062608:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957568:0@lo:101: 00010000:00010000:3.0:1789762668.062621:0:6651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 0000000047d0ab47/0xd08452c77c56db8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db93 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.062628:0:6651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 0000000047d0ab47/0xd08452c77c56db8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56db93 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.062691:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957696:0@lo:501: 00000100:00100000:3.0:1789762668.062715:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.062732:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fdc7768 going to sleep for 11 seconds 00000100:00100000:3.0:1789762668.063004:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957696:0@lo:501: 00000100:00100000:3.0:1789762668.063031:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957824:0@lo:503: 00000100:00100000:3.0:1789762668.063062:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.063085:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fdc7768 going to sleep for 11 seconds 00000100:00100000:1.0:1789762668.063090:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148957824 00000100:00100000:1.0:1789762668.063095:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148957824 00000100:00100000:1.0:1789762668.063120:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789762668.063126:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf7ad530 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+10:6651:x1876702148957824:12345-0@lo:503: 00000100:00100000:1.0:1789762668.063233:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf7ad530 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+10:6651:x1876702148957824:12345-0@lo:503: Request processed in 109us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762668.063239:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789762668.063261:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957824:0@lo:503: 00000040:00080000:3.0:1789762668.063448:0:6651:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789762668.064140:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957952:0@lo:502: 00000100:00100000:3.0:1789762668.064173:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.064196:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ead02f8 going to sleep for 11 seconds 00000100:00100000:3.0:1789762668.064443:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148957952:0@lo:502: 00000040:00080000:3.0:1789762668.064733:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789762668.064781:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789762668.064799:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148958080:0@lo:502: 00000100:00100000:3.0:1789762668.064857:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.064884:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ead02f8 going to sleep for 11 seconds 00000100:00100000:3.0:1789762668.065145:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043536a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148958080:0@lo:502: 00000040:00080000:3.0:1789762668.065225:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789762668.065235:0:6651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789762668.065651:0:6651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789762668.065666:0:6651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789762668.065678:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d141525c00/0xd08452c77c56db8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db93 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.065685:0:6651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d141525c00/0xd08452c77c56db8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56db93 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762668.065709:0:6651:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789762668.065716:0:6651:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d15277f800 10000000:01000000:3.0:1789762668.065718:0:6651:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d15277f800 10000000:01000000:3.0:1789762668.065720:0:6651:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789762668.065722:0:6651:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d15277f800 from 1 10000000:01000000:3.0:1789762668.065724:0:6651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789762668.065745:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d141525e00/0xd08452c77c56db9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.065750:0:6651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d141525e00/0xd08452c77c56db9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.065755:0:6651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d141525e00/0xd08452c77c56db9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.065764:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148958208:0@lo:101: 00000100:00100000:3.0:1789762668.065783:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.065796:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d158253240 going to sleep for 11 seconds 00000100:00100000:3.0:1789762668.065994:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148958208:0@lo:101: 00010000:00010000:3.0:1789762668.066007:0:6651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d141525e00/0xd08452c77c56db9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dba1 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762668.066014:0:6651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d141525e00/0xd08452c77c56db9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56dba1 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.066051:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148958336:0@lo:501: 00000100:00100000:3.0:1789762668.066068:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.066092:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d158253240 going to sleep for 11 seconds 00000100:00100000:3.0:1789762668.066304:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148958336:0@lo:501: 00000100:00100000:3.0:1789762668.066326:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148958464:0@lo:503: 00000100:00100000:3.0:1789762668.066363:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.066378:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d158253240 going to sleep for 11 seconds 00000100:00100000:3.0:1789762668.066558:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148958464:0@lo:503: 00000040:00080000:3.0:1789762668.066731:0:6651:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789762668.066771:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148958592:0@lo:502: 00000100:00100000:3.0:1789762668.066805:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.066820:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d158253240 going to sleep for 11 seconds 00000100:00100000:3.0:1789762668.067142:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148958592:0@lo:502: 00000040:00080000:3.0:1789762668.067487:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789762668.067528:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789762668.067556:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789762668.067618:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789762668.067681:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789762668.067730:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789762668.067767:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789762668.067786:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789762668.067811:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789762668.067861:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789762668.067895:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789762668.067923:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789762668.067943:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789762668.067962:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789762668.067987:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789762668.068007:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789762668.068025:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789762668.068049:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789762668.068068:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789762668.068096:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789762668.068156:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789762668.068181:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789762668.068228:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789762668.068270:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789762668.068293:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789762668.068312:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789762668.068338:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789762668.068359:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789762668.068374:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148958720:0@lo:502: 00000100:00100000:3.0:1789762668.068416:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762668.068440:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d158253240 going to sleep for 11 seconds 00000100:00100000:3.0:1789762668.068624:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148958720:0@lo:502: 00000040:00080000:3.0:1789762668.068675:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789762668.068681:0:6651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789762668.068944:0:6679:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789762668.068954:0:6679:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff95d180de8000) 00000020:00000080:3.0:1789762668.068963:0:6679:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1789762668.069006:0:6679:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d15277f800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789762668.069009:0:6679:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d15277f800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789762668.069011:0:6679:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d15277f800 3 00010000:00080000:3.0:1789762668.069031:0:6679:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d1522a8800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1789762668.070139:0:6679:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1789762668.070276:0:6679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789762668.070292:0:6679:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789762668.070298:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd08452c77c56dbaf 00000100:00080000:3.0:1789762668.070304:0:6679:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789762668.070308:0:6679:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95d1522a8800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1789762668.070324:0:6679:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d173ce9180 x1876702148958848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789762668.070342:0:6679:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789762668.070419:0:2356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789762668.070424:0:2356:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789762668.070427:0:2356:0:(import.c:65:import_set_state_nolock()) ffff95d179da1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789762668.070435:0:2356:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95d179da1000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1789762668.070466:0:2356:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d1463cea00 x1876702148958976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789762668.070485:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148958848 00000100:00100000:3.0:1789762668.070495:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148958848 00000100:00100000:3.0:1789762668.070532:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789762668.070538:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3275:x1876702148958848:12345-0@lo:38: 00010000:00080000:3.0:1789762668.070555:0:5814:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 72 last 0 00000020:00000080:3.0:1789762668.070603:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd08452c77c56dbb6 00000040:00080000:1.0:1789762668.070656:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000004:00100000:3.0:1789762668.070658:0:5814:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:1.0:1789762668.070811:0:6651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789762668.070831:0:6651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00080000:3.0:1789762668.070895:0:5814:0:(import.c:65:import_set_state_nolock()) ffff95d041d8d800 : changing import state from RECOVER to FULL 00010000:00010000:1.0:1789762668.070913:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d141525e00/0xd08452c77c56db9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dba1 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.070922:0:6651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d141525e00/0xd08452c77c56db9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dba1 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.070947:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876702148958848:12345-0@lo:38: Request processed in 407us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762668.070955:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:1.0:1789762668.070968:0:6651:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789762668.070970:0:6651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789762668.070972:0:6651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762668.070975:0:6651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762668.070983:0:6651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762668.070987:0:6651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762668.070990:0:6651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789762668.070993:0:6651:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762668.070995:0:6651:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762668.070997:0:6651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762668.071000:0:6651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789762668.071004:0:6651:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789762668.071009:0:6651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789762668.071014:0:6651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789762668.071017:0:6651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762668.071019:0:6651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762668.071024:0:6651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762668.071026:0:6651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762668.071029:0:6651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789762668.071032:0:6651:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762668.071033:0:6651:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762668.071035:0:6651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762668.071037:0:6651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789762668.071052:0:6651:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789762668.071061:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:6651:1876702148959104:0@lo:253: 00000100:00100000:1.0:1789762668.071098:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762668.071121:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148959104 00000100:00100000:1.0:1789762668.071125:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148959104 00000100:00100000:1.0:1789762668.071162:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789762668.071170:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:6651:x1876702148959104:12345-0@lo:253: 20000000:01000000:1.0:1789762668.071194:0:5805:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789762668.071207:0:5805:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789762668.078521:0:5828:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789762668.078525:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789762668.078536:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d182041a00/0xd08452c77c56dbc4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.078544:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d182041a00/0xd08452c77c56dbc4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789762668.078558:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001041595s 00010000:00010000:1.0:1789762668.078572:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d182041a00/0xd08452c77c56dbc4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.078578:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d182041a00/0xd08452c77c56dbc4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.078583:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d182041a00/0xd08452c77c56dbc4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.078588:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d182041a00/0xd08452c77c56dbc4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.078592:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d182041a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762668.078596:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d182041a00/0xd08452c77c56dbc4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.078601:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d182041a00/0xd08452c77c56dbc4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.078610:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d182041a00/0xd08452c77c56dbc4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.078615:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d182041a00/0xd08452c77c56dbc4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762668.078620:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d182041a00/0xd08452c77c56dbc4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762668.080629:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:6651:x1876702148959104:12345-0@lo:253: Request processed in 9459us (9531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762668.080647:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789762668.583898:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762669.606929:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789762669.943911:0:7024:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1789762670.630938:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789762670.630942:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d1549a0000 from 21 10000000:01000000:3.0:1789762670.630946:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789762670.630981:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762670.630991:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762670.631000:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762670.631017:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148959232:0@lo:101: 00000100:00100000:3.0:1789762670.631067:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762670.631116:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d158253c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789762670.631294:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148959232:0@lo:101: 00010000:00010000:3.0:1789762670.631310:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dbd2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762670.631317:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56dbd2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762670.631356:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148959360:0@lo:501: 00000100:00100000:3.0:1789762670.631375:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762670.631402:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d158253c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789762670.631788:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148959360:0@lo:501: 00000100:00100000:3.0:1789762670.631812:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148959488:0@lo:503: 00000100:00100000:3.0:1789762670.631876:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762670.631919:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d158253c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789762670.632198:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148959488:0@lo:503: 00000100:00100000:3.0:1789762670.632428:0:7128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7128:1876702148959616:0@lo:502: 00000100:00100000:3.0:1789762670.632456:0:7128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762670.632471:0:7128:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d158253780 going to sleep for 11 seconds 00000100:00100000:3.0:1789762670.632687:0:7128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7128:1876702148959616:0@lo:502: 00000100:00100000:3.0:1789762670.632724:0:7128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7128:1876702148959744:0@lo:502: 00000100:00100000:3.0:1789762670.632749:0:7128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762670.632763:0:7128:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d144fb7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789762670.632949:0:7128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7128:1876702148959744:0@lo:502: 00000040:00080000:3.0:1789762670.632974:0:7128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789762670.633033:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789762670.633050:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789762670.633056:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dbd2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762670.633064:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dbd2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762670.633070:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789762670.633072:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d1549a0000 from 3 10000000:01000000:1.0:1789762670.633073:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789762670.633087:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762670.633093:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762670.633099:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762670.633108:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148959872:0@lo:101: 00000100:00100000:1.0:1789762670.633133:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762670.633160:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d145741d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762670.633281:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148959872:0@lo:101: 00010000:00010000:1.0:1789762670.633292:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dbe0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762670.633298:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56dbe0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762670.633338:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148960000:0@lo:256: 00000100:00100000:1.0:1789762670.633362:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762670.633391:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d145741d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762670.633526:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148960000:0@lo:256: 10000000:01000000:1.0:1789762670.633564:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789762670.633568:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dbe0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762670.633573:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dbe0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762670.633577:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789762670.633579:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789762670.633580:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789762670.633591:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762670.633595:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762670.633600:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762670.633607:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148960128:0@lo:101: 00000100:00100000:1.0:1789762670.633627:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762670.633640:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d145741d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762670.633740:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148960128:0@lo:101: 00010000:00010000:1.0:1789762670.633757:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dbee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762670.633763:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56dbee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762670.633788:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148960256:0@lo:501: 00000100:00100000:1.0:1789762670.633807:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762670.633820:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d145741d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762670.634010:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148960256:0@lo:501: 00000100:00100000:1.0:1789762670.634032:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148960384:0@lo:503: 00000100:00100000:1.0:1789762670.634060:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762670.634087:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d145741d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762670.634353:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148960384:0@lo:503: 00000100:00100000:3.0:1789762670.634510:0:7129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7129:1876702148960512:0@lo:502: 00000100:00100000:3.0:1789762670.634543:0:7129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762670.634560:0:7129:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d144fb7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789762670.634748:0:7129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7129:1876702148960512:0@lo:502: 00000020:01000000:3.0:1789762670.634778:0:7129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789762670.634784:0:7129:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789762670.634791:0:7129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762670.634793:0:7129:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789762670.634799:0:7129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789762670.634803:0:7129:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:3.0:1789762670.634824:0:7129:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789762670.634826:0:7129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789762670.634869:0:7129:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff95d180de99b8) 00000020:00000080:3.0:1789762670.634887:0:7129:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789762670.634894:0:7129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789762670.634966:0:7129:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789762670.634971:0:7129:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789762670.634976:0:7129:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd08452c77c56dbfc 00010000:00080000:3.0:1789762670.634997:0:7129:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d158868000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1789762670.635155:0:7129:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789762670.642972:0:7129:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789762670.642986:0:7129:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789762670.643286:0:7129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789762670.643426:0:7129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789762670.643463:0:7129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789762670.643500:0:7129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789762670.643735:0:7130:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789762670.643740:0:7130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1789762670.644200:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1876702148960640:0@lo:8: 00000100:00100000:1.0:1789762670.644246:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789762670.644249:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762670.644262:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702148960768:0@lo:400: 00000100:00100000:3.0:1789762670.644271:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702148960896:0@lo:400: 00000100:00100000:1.0:1789762670.644309:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762670.644309:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148960640 00000100:00100000:2.0:1789762670.644314:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148960640 00000100:00100000:3.0:1789762670.644338:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762670.644342:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789762670.644349:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3275:x1876702148960640:12345-0@lo:8: 00010000:00080000:2.0:1789762670.644366:0:6654:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 75 last 0 00000020:00000080:2.0:1789762670.644404:0:6654:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd08452c77c56dc0a 00000100:00100000:3.0:1789762670.644414:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148960896 00000100:00100000:3.0:1789762670.644419:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148960896 00002000:00100000:2.0:1789762670.644433:0:6654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff95d041bcd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789762670.644440:0:6654:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789762670.644444:0:6654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789762670.644463:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789762670.644474:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702148960896:12345-0@lo:400: 00010000:00080000:1.0:1789762670.644520:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d173ceb480 x1876702148960768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789762686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762670.644532:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702148960768:0@lo:400: 00000100:00100000:3.0:1789762670.644534:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702148960896:12345-0@lo:400: Request processed in 63us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762670.644547:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00100000:2.0:1789762670.644573:0:6654:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1789762670.644588:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d173cea300 x1876702148960896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789762686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789762670.644598:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702148960896:0@lo:400: 00002000:00080000:2.0:1789762670.644795:0:6654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789762670.644813:0:6654:0:(import.c:65:import_set_state_nolock()) ffff95d041bc9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789762670.644878:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3275:x1876702148960640:12345-0@lo:8: Request processed in 529us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762670.644886:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789762670.644909:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d1462c1500 x1876702148960640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789762680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789762670.644919:0:3275:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789762670.644925:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789762670.644932:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789762670.644939:0:3275:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789762670.644942:0:3275:0:(import.c:65:import_set_state_nolock()) ffff95d158868000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789762670.644957:0:3275:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789762670.644964:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1876702148960640:0@lo:8: 00000004:00080000:2.0:1789762670.644977:0:7130:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:3.0:1789762670.645022:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789762670.645047:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789762670.645053:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dbee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762670.645060:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dbee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762670.645073:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789762670.645075:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d1549a0000 from 1 10000000:01000000:3.0:1789762670.645077:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000004:00080000:2.0:1789762670.645089:0:7130:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 75118254635ns, next at 0ns, rc = 0 00010000:00010000:3.0:1789762670.645096:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762670.645103:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762670.645108:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762670.645120:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173cea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148961152:0@lo:101: 00000100:00100000:3.0:1789762670.645146:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762670.645170:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d180dcc480 going to sleep for 11 seconds 00000100:00100000:3.0:1789762670.645350:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173cea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148961152:0@lo:101: 00010000:00010000:3.0:1789762670.645365:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dc18 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762670.645372:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56dc18 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762670.645413:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173cea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148961280:0@lo:501: 00000100:00100000:3.0:1789762670.645436:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762670.645456:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d180dcc480 going to sleep for 11 seconds 00000100:00100000:1.0:1789762670.645473:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148961280 00000100:00100000:1.0:1789762670.645478:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148961280 00000100:00100000:1.0:1789762670.645509:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789762670.645517:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148961280:12345-0@lo:501: 00000100:00100000:1.0:1789762670.645697:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148961280:12345-0@lo:501: Request processed in 181us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762670.645709:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789762670.645863:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173cea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148961280:0@lo:501: 00000100:00100000:3.0:1789762670.645894:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173cea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148961408:0@lo:503: 00000100:00100000:3.0:1789762670.645934:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762670.645976:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d180dcc480 going to sleep for 11 seconds 00000100:00100000:1.0:1789762670.646016:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148961408 00000100:00100000:1.0:1789762670.646022:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148961408 00000100:00100000:1.0:1789762670.646061:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789762670.646071:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148961408:12345-0@lo:503: 00000100:00100000:1.0:1789762670.646477:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148961408:12345-0@lo:503: Request processed in 408us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762670.646484:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789762670.646803:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173cea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148961408:0@lo:503: 00000100:00100000:1.0:1789762670.647151:0:7132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7132:1876702148961536:0@lo:502: 00000100:00100000:1.0:1789762670.647192:0:7132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762670.647220:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148961536 00000100:00100000:1.0:1789762670.647223:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148961536 00000100:00100000:1.0:1789762670.647255:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789762670.647266:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:7132:x1876702148961536:12345-0@lo:502: 00000100:00100000:1.0:1789762670.647522:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:7132:x1876702148961536:12345-0@lo:502: Request processed in 260us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762670.647529:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789762670.647586:0:7132:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d0433256c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789762670.647603:0:7132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7132:1876702148961536:0@lo:502: 00000020:01000000:1.0:1789762670.647631:0:7132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789762670.647636:0:7132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762670.647638:0:7132:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789762670.647644:0:7132:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d1549a0000 00000020:00000080:1.0:1789762670.647647:0:7132:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789762670.647667:0:7132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7132:1876702148961664:0@lo:502: 00000100:00100000:1.0:1789762670.647705:0:7132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762670.647728:0:7132:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d0433256c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789762670.647947:0:7132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7132:1876702148961664:0@lo:502: 00000020:01000000:1.0:1789762670.647977:0:7132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789762670.647984:0:7132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762670.647986:0:7132:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789762670.647991:0:7132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789762670.648070:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789762670.648093:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789762670.648098:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dc18 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762670.648104:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dc18 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762670.648110:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789762670.648112:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95d148f33370 from 1 10000000:01000000:3.0:1789762670.648114:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789762670.648131:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d141525800/0xd08452c77c56dc1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762670.648136:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d141525800/0xd08452c77c56dc1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762670.648142:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d141525800/0xd08452c77c56dc1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762670.648152:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148961792:0@lo:101: 00000100:00100000:3.0:1789762670.648187:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762670.648209:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148961792 00000100:00100000:1.0:1789762670.648214:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148961792 00000100:00100000:3.0:1789762670.648218:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d180dcc300 going to sleep for 11 seconds 00000100:00100000:1.0:1789762670.648253:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789762670.648269:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148961792:12345-0@lo:101: 00010000:00010000:1.0:1789762670.648277:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762670.648289:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d182041600/0xd08452c77c56dc26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dc1f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762670.648307:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d182041600/0xd08452c77c56dc26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dc1f expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762670.648317:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d182041600/0xd08452c77c56dc26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dc1f expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762670.648325:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d182041600, rc 0) 00000100:00100000:1.0:1789762670.648476:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148961792:12345-0@lo:101: Request processed in 212us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762670.648482:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789762670.648493:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148961792:0@lo:101: 00010000:00010000:3.0:1789762670.648506:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d141525800/0xd08452c77c56dc1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dc26 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762670.648512:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d141525800/0xd08452c77c56dc1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56dc26 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762670.648545:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148961920:0@lo:501: 00000100:00100000:3.0:1789762670.648571:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762670.648595:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d180dcc300 going to sleep for 11 seconds 00000100:00100000:1.0:1789762670.648601:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148961920 00000100:00100000:1.0:1789762670.648606:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148961920 00000100:00100000:1.0:1789762670.648636:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789762670.648643:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148961920:12345-0@lo:501: 00000100:00100000:1.0:1789762670.648809:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148961920:12345-0@lo:501: Request processed in 166us (237us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789762670.648814:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789762670.649036:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148961920:0@lo:501: 10000000:01000000:3.0:1789762670.649058:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789762670.649062:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d141525800/0xd08452c77c56dc1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dc26 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762670.649091:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d141525800/0xd08452c77c56dc1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dc26 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762670.653531:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789762670.653559:0:7131:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789762670.653567:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762670.653576:0:7131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876702148962176:0@lo:7: 00000100:00100000:3.0:1789762670.653580:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148962048:0@lo:13: 00000100:00100000:1.0:1789762670.653625:0:7131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762670.653625:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762670.653659:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148962176 00000100:00100000:1.0:1789762670.653663:0:7131:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d0433259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762670.653666:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148962176 00000100:00100000:2.0:1789762670.653700:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789762670.653708:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7131:x1876702148962176:12345-0@lo:7: 00000100:00100000:3.0:1789762670.653934:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789762670.653944:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00010000:00080000:3.0:1789762670.654032:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d1463cfb80 x1876702148962048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789762670.654052:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148962048:0@lo:13: 00002000:00080000:2.0:1789762670.656760:0:6656:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789762670.656765:0:6656:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789762670.656800:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7131:x1876702148962176:12345-0@lo:7: Request processed in 3094us (3180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762670.656805:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789762670.656882:0:7131:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d1463cdf80 x1876702148962176/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789762686 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762670.656891:0:7131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876702148962176:0@lo:7: 00000004:00080000:1.0:1789762670.656899:0:7131:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789762670.656921:0:7131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876702148962304:0@lo:5: 00000100:00100000:1.0:1789762670.656949:0:7131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762670.656974:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148962304 00000100:00100000:2.0:1789762670.656978:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148962304 00000100:00100000:1.0:1789762670.656985:0:7131:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d0433259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762670.657002:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789762670.657008:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7131:x1876702148962304:12345-0@lo:5: 00002000:00080000:2.0:1789762670.657022:0:6654:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789762670.657024:0:6654:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789762670.657145:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7131:x1876702148962304:12345-0@lo:5: Request processed in 136us (195us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789762670.657150:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789762670.657173:0:7131:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d1463cdf80 x1876702148962304/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789762686 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762670.657182:0:7131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876702148962304:0@lo:5: 00000004:00080000:1.0:1789762670.657189:0:7131:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789762670.657205:0:7131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876702148962432:0@lo:700: 00000100:00100000:1.0:1789762670.657225:0:7131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762670.657241:0:7131:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d0433259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762670.657449:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148962560 00000100:00100000:3.0:1789762670.657454:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148962560 00000100:00100000:3.0:1789762670.657483:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789762670.657489:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6662:x1876702148962560:12345-0@lo:700: 40000000:02000000:1.0:1789762670.663865:0:5819:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1789762670.666640:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6662:x1876702148962560:12345-0@lo:700: Request processed in 9150us (9240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762670.666656:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1789762670.683967:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789762670.683984:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1789762670.684039:0:7131:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d1463cd880 x1876702148962432/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789762686 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762670.684052:0:7131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876702148962432:0@lo:700: 00000004:02000040:1.0:1789762670.690364:0:7131:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789762670.692693:0:7131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876702148962688:0@lo:5: 00000100:00100000:1.0:1789762670.692728:0:7131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762670.692768:0:7131:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d043325c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789762670.692789:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148962688 00000100:00100000:2.0:1789762670.692799:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148962688 00000100:00100000:3.0:1789762670.692866:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789762670.692878:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7131:x1876702148962688:12345-0@lo:5: 00002000:00080000:3.0:1789762670.695628:0:6655:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789762670.695640:0:6655:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1789762670.696991:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7131:x1876702148962688:12345-0@lo:5: Request processed in 4116us (4261us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789762670.696997:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789762670.697048:0:7131:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d1463cd880 x1876702148962688/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789762686 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762670.697058:0:7131:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789762670.697067:0:7131:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d1463cd880 x1876702148962688/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789762686 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762670.697074:0:7131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876702148962688:0@lo:5: 00000004:00080000:1.0:1789762670.697082:0:7131:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1789762671.654952:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789762672.274189:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789762672.678947:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762673.703167:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789762674.426018:0:7590:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789762674.426022:0:7590:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789762674.426160:0:7590:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d17fb80000 00000020:01000004:1.0:1789762674.426186:0:7590:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789762674.426196:0:7590:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789762674.426207:0:7590:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff95d148f30000) 00000020:00000080:1.0:1789762674.426218:0:7590:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789762674.432958:0:7590:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789762674.433116:0:7590:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789762674.443360:0:7590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789762674.446046:0:7590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789762674.446063:0:7590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789762674.446104:0:7590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789762674.446122:0:7590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789762674.446315:0:7590:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789762674.446321:0:7590:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789762674.446326:0:7590:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd08452c77c56dc34 00000020:01000004:1.0:1789762674.446331:0:7590:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1789762674.446347:0:7590:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789762674.446364:0:7590:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789762674.446369:0:7590:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789762674.446382:0:7590:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1789762674.446385:0:7590:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789762674.455212:0:7590:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789762674.455233:0:7590:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789762674.455236:0:7590:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789762674.455237:0:7590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789762674.455239:0:7590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762674.455239:0:7590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762674.455240:0:7590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762674.455241:0:7590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762674.455242:0:7590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789762674.455255:0:7590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762674.455256:0:7590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762674.455257:0:7590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762674.455257:0:7590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789762674.455259:0:7590:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789762674.455261:0:7590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789762674.455262:0:7590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789762674.455262:0:7590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762674.455263:0:7590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762674.455266:0:7590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762674.455267:0:7590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762674.455268:0:7590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789762674.455268:0:7590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762674.455269:0:7590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762674.455270:0:7590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762674.455270:0:7590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789762674.455292:0:7590:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789762674.455306:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148962816:0@lo:253: 00000100:00100000:1.0:1789762674.455373:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762674.455426:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d173b86d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789762674.455430:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148962816 00000100:00100000:2.0:1789762674.455444:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148962816 00000100:00100000:2.0:1789762674.455483:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789762674.455492:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:7590:x1876702148962816:12345-0@lo:253: 20000000:01000000:2.0:1789762674.455517:0:5807:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789762674.455521:0:5807:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789762674.455525:0:5807:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789762674.455527:0:5807:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789762674.456212:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789762674.456384:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789762674.456404:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789762674.456441:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789762674.456447:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789762674.456465:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789762674.456493:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789762674.456804:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789762674.456815:0:5807:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:2.0:1789762674.456817:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:2.0:1789762674.456858:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789762674.456864:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789762674.456898:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789762674.456903:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:2.0:1789762674.456921:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789762674.456927:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789762674.456943:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789762674.456970:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789762674.457556:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1789762674.457566:0:5807:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:2.0:1789762674.457568:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:2.0:1789762674.457590:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1789762674.457595:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789762674.457612:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1789762674.457622:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:2.0:1789762674.457643:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1789762674.457648:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789762674.457673:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1789762674.457695:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1789762674.457708:0:5807:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1789762674.457711:0:5807:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1789762674.457718:0:5807:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789762674.457720:0:5807:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789762674.457722:0:5807:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789762674.457732:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789762674.457735:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789762674.457764:0:5807:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789762674.457766:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789762674.458253:0:7592:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789762674.458298:0:7592:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789762674.458319:0:7592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1789762674.458469:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1789762674.458508:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1789762674.458540:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1789762674.458548:0:5807:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789762674.458549:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789762674.458869:0:7593:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789762674.458901:0:7593:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789762674.458950:0:7593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789762674.459078:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1789762674.459102:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1789762674.459121:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1789762674.459128:0:5807:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789762674.459129:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789762674.459413:0:7594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789762674.459518:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789762674.459543:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789762674.459572:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789762674.459579:0:5807:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789762674.459580:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789762674.459855:0:7595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1789762674.459890:0:7595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1789762674.459924:0:7595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789762674.460033:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789762674.460055:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789762674.460085:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1789762674.460096:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789762674.460114:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460126:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d1821f8400/0xd08452c77c56db77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56db70 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460132:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d140030600/0xd08452c77c56dba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56db9a expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460137:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d140030e00/0xd08452c77c56dbd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dbcb expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460141:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d140030c00/0xd08452c77c56dbee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dbe7 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460145:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d182041600/0xd08452c77c56dc26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dc1f expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460150:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460180:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d182041600/0xd08452c77c56dc26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56dc1f expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460189:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d182041600/0xd08452c77c56dc26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56dc1f expref: 16 pid: 5807 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762674.460196:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a257800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5807:1876702148962944:0@lo:104: 00000100:00100000:2.0:1789762674.460220:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789762674.460249:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d140030c00/0xd08452c77c56dbee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56dbe7 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460263:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d140030c00/0xd08452c77c56dbee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56dbe7 expref: 16 pid: 5805 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762674.460270:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a256680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5807:1876702148963072:0@lo:104: 00000100:00100000:2.0:1789762674.460291:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762674.460292:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148962944 00000100:00100000:1.0:1789762674.460298:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148962944 00010000:00010000:2.0:1789762674.460318:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d140030e00/0xd08452c77c56dbd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56dbcb expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460325:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d140030e00/0xd08452c77c56dbd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56dbcb expref: 16 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762674.460332:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a254700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5807:1876702148963200:0@lo:104: 00000100:00100000:1.0:1789762674.460336:0:5843:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789762674.460372:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d140030600/0xd08452c77c56dba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56db9a expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762674.460378:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789762674.460386:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d140030600/0xd08452c77c56dba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56db9a expref: 16 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762674.460391:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148963072 00000100:00100000:2.0:1789762674.460396:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a257480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5807:1876702148963328:0@lo:104: 00000100:00100000:1.0:1789762674.460411:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789762674.460411:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148963072 00000100:00100000:1.0:1789762674.460426:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:5807:x1876702148962944:12345-0@lo:104: 00010000:00010000:1.0:1789762674.460438:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d141525800/0xd08452c77c56dc1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dc26 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762674.460445:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762674.460447:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789762674.460463:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:5807:x1876702148963072:12345-0@lo:104: 00010000:00010000:2.0:1789762674.460474:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d1821f8400/0xd08452c77c56db77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56db70 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.460477:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dbee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.460492:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789762674.460498:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d1821f8400/0xd08452c77c56db77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56db70 expref: 16 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762674.460505:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:5807:x1876702148962944:12345-0@lo:104: Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762674.460521:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a254380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5807:1876702148963456:0@lo:104: 00000100:00100000:1.0:1789762674.460524:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789762674.460545:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148963328 00000100:00100000:1.0:1789762674.460556:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148963328 00010000:00010000:3.0:1789762674.460569:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789762674.460576:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762674.460579:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789762674.460581:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:5807:x1876702148963072:12345-0@lo:104: Request processed in 121us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.460593:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:5807:x1876702148963328:12345-0@lo:104: 00000100:00100000:3.0:1789762674.460596:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789762674.460601:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b0d4d80 going to sleep for 11 seconds 00010000:00010000:1.0:1789762674.460609:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d141525e00/0xd08452c77c56db9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dba1 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762674.460624:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a257800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5807:1876702148962944:0@lo:104: 00000100:00100000:3.0:1789762674.460638:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148963456 00000100:00100000:3.0:1789762674.460643:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148963456 00000100:00100000:2.0:1789762674.460644:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a256680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5807:1876702148963072:0@lo:104: 00000100:00100000:2.0:1789762674.460658:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a254700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5807:1876702148963200:0@lo:104: 00000100:00100000:3.0:1789762674.460679:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789762674.460680:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a257480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5807:1876702148963328:0@lo:104: 00010000:00010000:1.0:1789762674.460693:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789762674.460693:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:5807:x1876702148963456:12345-0@lo:104: 00010000:00010000:2.0:1789762674.460705:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1789762674.460707:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:5807:x1876702148963328:12345-0@lo:104: Request processed in 116us (264us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762674.460708:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d141525000/0xd08452c77c56db70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56db77 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460719:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dbee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762674.460727:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789762674.460742:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d182041c00 already unused, calling callback (ffffffffc1a96c20) 10000000:00010000:2.0:1789762674.460750:0:6670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56dbee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460759:0:6670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56dbee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.460762:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:2.0:1789762674.460770:0:6670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56dbee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762674.460772:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:5807:x1876702148963456:12345-0@lo:104: Request processed in 82us (199us total) trans 0 rc 0/0 10000000:01000000:2.0:1789762674.460776:0:6670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789762674.460791:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1789762674.460802:0:6670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dbee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460808:0:6670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789762674.460813:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148963584:0@lo:103: 00010000:00010000:3.0:1789762674.460814:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789762674.460816:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dbee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.460823:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dbd2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460870:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d182041c00/0xd08452c77c56dbe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dbee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.460878:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524a00 already unused, calling callback (ffffffffc1a96c20) 00000100:00100000:1.0:1789762674.460880:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1789762674.460887:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56dbd2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762674.460907:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789762674.460917:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56dbd2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762674.460918:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148963712:0@lo:103: 00010000:00010000:2.0:1789762674.460920:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762674.460928:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d141525000/0xd08452c77c56db70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56db77 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789762674.460943:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56dbd2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.460947:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525000 already unused, calling callback (ffffffffc1a96c20) 00000100:00100000:1.0:1789762674.460952:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789762674.460954:0:6670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d141525000/0xd08452c77c56db70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56db77 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762674.460966:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789762674.460978:0:6670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d141525000/0xd08452c77c56db70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56db77 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.460995:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dbd2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762674.461001:0:6670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d141525000/0xd08452c77c56db70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56db77 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.461007:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1789762674.461012:0:6670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789762674.461026:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dbd2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.461033:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d141524a00/0xd08452c77c56dbcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dbd2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.461038:0:6670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d141525000/0xd08452c77c56db70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56db77 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.461044:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762674.461048:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762674.461050:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762674.461056:0:6670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789762674.461065:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148963840:0@lo:103: 00010000:00010000:2.0:1789762674.461071:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d141525000/0xd08452c77c56db70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56db77 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762674.461088:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148964096:0@lo:103: 00010000:00010000:2.0:1789762674.461095:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d141525000/0xd08452c77c56db70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56db77 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762674.461106:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789762674.461121:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762674.461126:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762674.461131:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762674.461132:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762674.461137:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789762674.461145:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148963968:0@lo:103: 00000100:00100000:2.0:1789762674.461155:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148963584 00000100:00100000:2.0:1789762674.461166:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148963584 00000100:00100000:3.0:1789762674.461182:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762674.461195:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148963840 00010000:00010000:2.0:1789762674.461199:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d182041600/0xd08452c77c56dc26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dc1f expref: 18 pid: 5807 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762674.461202:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148963840 00000100:00100000:3.0:1789762674.461219:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148964096 00010000:00010000:1.0:1789762674.461220:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d140030e00/0xd08452c77c56dbd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dbcb expref: 19 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762674.461225:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148963968 00000100:00100000:3.0:1789762674.461226:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148964096 00000100:00100000:2.0:1789762674.461232:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148963968 00010000:00010000:3.0:1789762674.461248:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d1821f8400/0xd08452c77c56db77 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56db70 expref: 21 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.461252:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d140030600/0xd08452c77c56dba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56db9a expref: 21 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762674.461254:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789762674.461272:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+21:3278:x1876702148963712:12345-0@lo:103: 00010000:00010000:1.0:1789762674.461283:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789762674.461288:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789762674.461300:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d140030c00/0xd08452c77c56dbee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dbe7 expref: 21 pid: 5805 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762674.461301:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789762674.461302:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+21:3276:x1876702148963840:12345-0@lo:103: 00000100:00100000:2.0:1789762674.461317:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+21:3278:x1876702148964096:12345-0@lo:103: 00010000:00010000:3.0:1789762674.461319:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762674.461329:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d140030e00/0xd08452c77c56dbd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dbcb expref: 21 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.461335:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762674.461336:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d140030c00/0xd08452c77c56dbee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56dbe7 expref: 21 pid: 5805 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.461343:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d1821f8400/0xd08452c77c56db77 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56db70 expref: 21 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.461370:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d140030e00/0xd08452c77c56dbd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56dbcb expref: 21 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.461391:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d140030c00/0xd08452c77c56dbee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56dbe7 expref: 20 pid: 5805 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.461393:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d1821f8400/0xd08452c77c56db77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56db70 expref: 20 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.461425:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d140030e00/0xd08452c77c56dbd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56dbcb expref: 19 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.461431:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762674.461432:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762674.461440:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762674.461490:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:3278:x1876702148963712:12345-0@lo:103: Request processed in 220us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762674.461491:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:3278:x1876702148964096:12345-0@lo:103: Request processed in 177us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762674.461501:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:3276:x1876702148963840:12345-0@lo:103: Request processed in 197us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.461505:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789762674.461514:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789762674.461522:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789762674.461535:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789762674.461546:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:3276:x1876702148963968:12345-0@lo:103: 00010000:00010000:1.0:1789762674.461553:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762674.461557:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d140030600/0xd08452c77c56dba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56db9a expref: 14 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.461566:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d140030600/0xd08452c77c56dba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56db9a expref: 14 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762674.461568:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148963840:0@lo:103: 00010000:00010000:1.0:1789762674.461589:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d140030600/0xd08452c77c56dba1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56db9a expref: 14 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.461603:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.461613:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.461618:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1821f8400/0xd08452c77c56db77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56db70 expref: 13 pid: 5808 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.461636:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762674.461641:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a254380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5807:1876702148963456:0@lo:104: 00010000:00010000:1.0:1789762674.461651:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.461657:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.461662:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.461667:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f8a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762674.461667:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.461670:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.461685:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.461686:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.461703:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x54a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.461705:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789762674.461711:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1789762674.461716:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dc3b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.461729:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762674.461760:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:3276:x1876702148963968:12345-0@lo:103: Request processed in 219us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.461765:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789762674.461788:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148963968:0@lo:103: 00000100:00100000:1.0:1789762674.472828:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:7590:x1876702148962816:12345-0@lo:253: Request processed in 17335us (17452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.472860:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789762674.472878:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148962816:0@lo:253: 10000000:01000000:3.0:1789762674.472891:0:7590:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789762674.472894:0:7590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789762674.472896:0:7590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789762674.472897:0:7590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789762674.472899:0:7590:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789762674.472900:0:7590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789762674.472901:0:7590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789762674.472903:0:7590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789762674.472905:0:7590:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789762674.472906:0:7590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789762674.472908:0:7590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789762674.472921:0:7590:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d17fb80000 from lustre-OST0001 10000000:01000000:3.0:1789762674.472935:0:7590:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789762674.472937:0:7590:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789762674.472942:0:7590:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d148f33370 local copy 10000000:01000000:3.0:1789762674.472944:0:7590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789762674.472959:0:7590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.472971:0:7590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.472978:0:7590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762674.472987:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148964224:0@lo:101: 00000100:00100000:3.0:1789762674.473011:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762674.473043:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148964224 00000100:00100000:3.0:1789762674.473047:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d152628d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762674.473048:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148964224 00000100:00100000:1.0:1789762674.473077:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789762674.473083:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+11:7590:x1876702148964224:12345-0@lo:101: 00010000:00010000:1.0:1789762674.473091:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762674.473100:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1588cdc00/0xd08452c77c56dc49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dc42 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.473112:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1588cdc00/0xd08452c77c56dc49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dc42 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.473119:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1588cdc00/0xd08452c77c56dc49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dc42 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.473123:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cdc00, rc 0) 00000100:00100000:1.0:1789762674.473151:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:7590:x1876702148964224:12345-0@lo:101: Request processed in 69us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.473156:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789762674.473166:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148964224:0@lo:101: 00010000:00010000:3.0:1789762674.473179:0:7590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd08452c77c56dc49 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.473185:0:7590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd08452c77c56dc49 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762674.473242:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148964352:0@lo:501: 00000100:00100000:3.0:1789762674.473261:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762674.473275:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d152628d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762674.473291:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148964352 00000100:00100000:1.0:1789762674.473295:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148964352 00000100:00100000:1.0:1789762674.473316:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789762674.473321:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:7590:x1876702148964352:12345-0@lo:501: 00000100:00100000:1.0:1789762674.473447:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:7590:x1876702148964352:12345-0@lo:501: Request processed in 125us (184us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789762674.473454:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789762674.473479:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148964352:0@lo:501: 10000000:01000000:3.0:1789762674.473494:0:7590:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789762674.473521:0:7590:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789762674.473525:0:7590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd08452c77c56dc49 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.473531:0:7590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd08452c77c56dc49 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.473540:0:7590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd08452c77c56dc49 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.473554:0:7590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789762674.473567:0:7590:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d17fb80000 10000000:01000000:3.0:1789762674.473570:0:7590:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789762674.473573:0:7590:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789762674.473576:0:7590:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789762674.473578:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1789762674.473579:0:7590:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789762674.473583:0:7590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789762674.473585:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd08452c77c56dc49 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.473595:0:7590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56dc50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.473601:0:7590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56dc50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.473602:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8e00 already unused, calling callback (ffffffffc1a96c20) 10000000:00010000:2.0:1789762674.473608:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xd08452c77c56dc49 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.473611:0:7590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56dc50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.473622:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xd08452c77c56dc49 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762674.473627:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148964480:0@lo:101: 10000000:00010000:2.0:1789762674.473640:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd08452c77c56dc49 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762674.473644:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789762674.473655:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789762674.473660:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd08452c77c56dc49 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.473665:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789762674.473671:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1526280c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789762674.473685:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd08452c77c56dc49 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762674.473686:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148964480 00000100:00100000:1.0:1789762674.473692:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148964480 00010000:00010000:2.0:1789762674.473695:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d1583a8e00/0xd08452c77c56dc42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd08452c77c56dc49 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.473707:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762674.473711:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762674.473715:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762674.473730:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789762674.473739:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:7590:x1876702148964480:12345-0@lo:101: 00010000:00010000:1.0:1789762674.473748:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762674.473757:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1588cde00/0xd08452c77c56dc57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dc50 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.473769:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1588cde00/0xd08452c77c56dc57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dc50 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.473777:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1588cde00/0xd08452c77c56dc57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dc50 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762674.473777:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148964608 00000100:00100000:3.0:1789762674.473785:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148964608 00010000:00010000:1.0:1789762674.473786:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cde00, rc 0) 00000100:00100000:1.0:1789762674.473822:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:7590:x1876702148964480:12345-0@lo:101: Request processed in 85us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762674.473827:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789762674.473828:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789762674.473862:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:3279:x1876702148964608:12345-0@lo:103: 00010000:00010000:3.0:1789762674.473874:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789762674.473878:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148964480:0@lo:101: 00010000:00010000:3.0:1789762674.473888:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1588cdc00/0xd08452c77c56dc49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd08452c77c56dc42 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.473890:0:7590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56dc50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dc57 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.473899:0:7590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56dc50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56dc57 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.473918:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762674.473955:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:3279:x1876702148964608:12345-0@lo:103: Request processed in 98us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762674.473963:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a254380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148964736:0@lo:501: 00000100:00100000:3.0:1789762674.473964:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789762674.474000:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762674.474024:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b0d4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762674.474031:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148964736 00000100:00100000:1.0:1789762674.474035:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148964736 00000100:00100000:1.0:1789762674.474057:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789762674.474063:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:7590:x1876702148964736:12345-0@lo:501: 00000100:00100000:1.0:1789762674.474165:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:7590:x1876702148964736:12345-0@lo:501: Request processed in 103us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.474170:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789762674.474192:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a254380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148964736:0@lo:501: 00000100:00100000:2.0:1789762674.474218:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a254380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148964864:0@lo:503: 00000100:00100000:2.0:1789762674.474249:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762674.474263:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b0d4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762674.474267:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148964864 00000100:00100000:1.0:1789762674.474271:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148964864 00000100:00100000:1.0:1789762674.474290:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789762674.474294:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:7590:x1876702148964864:12345-0@lo:503: 00000100:00100000:1.0:1789762674.474393:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:7590:x1876702148964864:12345-0@lo:503: Request processed in 97us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.474404:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789762674.474411:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a254380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148964864:0@lo:503: 00000040:00080000:2.0:1789762674.474558:0:7590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789762674.474597:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a254380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148964992:0@lo:502: 00000100:00100000:2.0:1789762674.474624:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762674.474639:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b0d4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762674.474651:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148964992 00000100:00100000:1.0:1789762674.474655:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148964992 00000100:00100000:1.0:1789762674.474676:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789762674.474680:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:7590:x1876702148964992:12345-0@lo:502: 00000100:00100000:1.0:1789762674.474771:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:7590:x1876702148964992:12345-0@lo:502: Request processed in 90us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.474777:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789762674.474786:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a254380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148964992:0@lo:502: 00000040:00080000:2.0:1789762674.474976:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789762674.475006:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789762674.475025:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789762674.475051:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789762674.475074:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789762674.475111:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789762674.475132:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a254380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148965120:0@lo:502: 00000100:00100000:2.0:1789762674.475158:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762674.475177:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b0d4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762674.475187:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148965120 00000100:00100000:1.0:1789762674.475191:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148965120 00000100:00100000:1.0:1789762674.475212:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789762674.475216:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:7590:x1876702148965120:12345-0@lo:502: 00000100:00100000:1.0:1789762674.475302:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:7590:x1876702148965120:12345-0@lo:502: Request processed in 85us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.475308:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789762674.475319:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a254380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148965120:0@lo:502: 00000040:00080000:2.0:1789762674.475391:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789762674.475398:0:7590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789762674.475619:0:7596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789762674.475625:0:7596:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789762674.475629:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762674.475631:0:7596:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789762674.475634:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789762674.475642:0:7596:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff95d148f319b8) 00000020:00000080:1.0:1789762674.475654:0:7596:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789762674.475657:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789762674.475700:0:7596:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d17fb80000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789762674.475705:0:7596:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789762674.475709:0:7596:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd08452c77c56dc65 00010000:00010000:1.0:1789762674.478009:0:7596:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1789762674.478130:0:7596:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789762674.479496:0:7596:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789762674.479595:0:7596:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789762674.481370:0:7596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789762674.481674:0:7596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789762674.482379:0:7596:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789762674.482384:0:7596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789762674.482388:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762674.482389:0:7596:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789762674.482392:0:7596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789762674.482395:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762674.482396:0:7596:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789762674.482399:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789762674.482400:0:7596:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789762674.482421:0:7596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789762674.482424:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762674.482425:0:7596:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789762674.482427:0:7596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000100:00100000:1.0:1789762674.482640:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148965248 00000100:00100000:1.0:1789762674.482645:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148965248 00000100:00100000:1.0:1789762674.482677:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789762674.482684:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:7590:x1876702148965248:12345-0@lo:101: 00010000:00010000:1.0:1789762674.482691:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762674.482698:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1588cd400/0xd08452c77c56dc73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dc6c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.482711:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1588cd400/0xd08452c77c56dc73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dc6c expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.482717:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1588cd400/0xd08452c77c56dc73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dc6c expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.482723:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cd400, rc 0) 00000100:00100000:1.0:1789762674.482756:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:7590:x1876702148965248:12345-0@lo:101: Request processed in 74us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.482761:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789762674.482932:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148965376 00000100:00100000:1.0:1789762674.482936:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148965376 00000100:00100000:1.0:1789762674.482967:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789762674.482974:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:7590:x1876702148965376:12345-0@lo:501: 00000100:00100000:1.0:1789762674.483117:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:7590:x1876702148965376:12345-0@lo:501: Request processed in 144us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.483124:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789762674.483245:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148965504 00000100:00100000:1.0:1789762674.483249:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148965504 00000100:00100000:1.0:1789762674.483276:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789762674.483285:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:7590:x1876702148965504:12345-0@lo:503: 00000100:00100000:1.0:1789762674.483561:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:7590:x1876702148965504:12345-0@lo:503: Request processed in 278us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.483568:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789762674.483887:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148965632 00000100:00100000:1.0:1789762674.483892:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148965632 00000100:00100000:1.0:1789762674.483923:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789762674.483929:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:7590:x1876702148965632:12345-0@lo:502: 00000100:00100000:1.0:1789762674.484058:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:7590:x1876702148965632:12345-0@lo:502: Request processed in 129us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.484064:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789762674.484464:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148965760 00000100:00100000:1.0:1789762674.484469:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148965760 00000100:00100000:1.0:1789762674.484493:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789762674.484499:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:7590:x1876702148965760:12345-0@lo:502: 00000100:00100000:1.0:1789762674.484643:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:7590:x1876702148965760:12345-0@lo:502: Request processed in 144us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.484649:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000020:01000000:1.0:1789762674.485192:0:7590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789762674.485208:0:7590:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789762674.485229:0:7590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d140030800/0xd08452c77c56dc6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dc73 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.485237:0:7590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d140030800/0xd08452c77c56dc6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dc73 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762674.485273:0:7590:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789762674.485275:0:7590:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d17fb80000 10000000:01000000:1.0:1789762674.485277:0:7590:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d17fb80000 10000000:01000000:1.0:1789762674.485280:0:7590:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789762674.485283:0:7590:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d17fb80000 from 1 10000000:01000000:1.0:1789762674.485284:0:7590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789762674.485298:0:7590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.485304:0:7590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.485310:0:7590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762674.485319:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148965888:0@lo:101: 00000100:00100000:1.0:1789762674.485347:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762674.485385:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762674.485394:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148965888 00000100:00100000:2.0:1789762674.485399:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148965888 00000100:00100000:2.0:1789762674.485427:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789762674.485434:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:7590:x1876702148965888:12345-0@lo:101: 00010000:00010000:2.0:1789762674.485441:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762674.485454:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f8200/0xd08452c77c56dc81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dc7a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.485466:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f8200/0xd08452c77c56dc81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dc7a expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.485473:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f8200/0xd08452c77c56dc81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dc7a expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.485478:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f8200, rc 0) 00000100:00100000:2.0:1789762674.485511:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:7590:x1876702148965888:12345-0@lo:101: Request processed in 78us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762674.485516:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789762674.485541:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148965888:0@lo:101: 00010000:00010000:1.0:1789762674.485553:0:7590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dc81 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.485561:0:7590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56dc81 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762674.485614:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148966016:0@lo:501: 00000100:00100000:1.0:1789762674.485647:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762674.485669:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762674.485681:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148966016 00000100:00100000:3.0:1789762674.485687:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148966016 00000100:00100000:3.0:1789762674.485720:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789762674.485729:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:7590:x1876702148966016:12345-0@lo:501: 00000100:00100000:3.0:1789762674.485948:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:7590:x1876702148966016:12345-0@lo:501: Request processed in 221us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762674.485955:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789762674.485966:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148966016:0@lo:501: 00000100:00100000:1.0:1789762674.485993:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148966144:0@lo:503: 00000100:00100000:1.0:1789762674.486029:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762674.486050:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148966144 00000100:00100000:1.0:1789762674.486055:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762674.486055:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148966144 00000100:00100000:2.0:1789762674.486088:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789762674.486098:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:7590:x1876702148966144:12345-0@lo:503: 00000100:00100000:2.0:1789762674.486277:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:7590:x1876702148966144:12345-0@lo:503: Request processed in 180us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762674.486284:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789762674.486303:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148966144:0@lo:503: 00000040:00080000:1.0:1789762674.486472:0:7590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789762674.486516:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148966272:0@lo:502: 00000100:00100000:1.0:1789762674.486550:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762674.486568:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762674.486580:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148966272 00000100:00100000:2.0:1789762674.486584:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148966272 00000100:00100000:2.0:1789762674.486605:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789762674.486610:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:7590:x1876702148966272:12345-0@lo:502: 00000100:00100000:2.0:1789762674.486715:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:7590:x1876702148966272:12345-0@lo:502: Request processed in 104us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762674.486721:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789762674.486733:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148966272:0@lo:502: 00000040:00080000:1.0:1789762674.486922:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789762674.486954:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789762674.486973:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789762674.487014:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789762674.487040:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789762674.487067:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789762674.487088:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789762674.487107:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789762674.487153:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789762674.487179:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789762674.487199:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789762674.487225:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789762674.487246:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789762674.487267:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789762674.487299:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789762674.487320:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789762674.487344:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789762674.487389:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789762674.487422:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789762674.487442:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789762674.487469:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789762674.487490:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789762674.487508:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789762674.487534:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789762674.487554:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789762674.487573:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789762674.487599:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789762674.487619:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1789762674.487639:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789762674.487677:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1789762674.487703:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1789762674.487722:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1789762674.487742:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1789762674.487769:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1789762674.487789:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1789762674.487816:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1789762674.487876:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1789762674.487892:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148966400:0@lo:502: 00000100:00100000:1.0:1789762674.487922:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762674.487941:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762674.487949:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148966400 00000100:00100000:2.0:1789762674.487954:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148966400 00000100:00100000:2.0:1789762674.487982:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789762674.487986:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:7590:x1876702148966400:12345-0@lo:502: 00000100:00100000:2.0:1789762674.488089:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:7590:x1876702148966400:12345-0@lo:502: Request processed in 100us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762674.488096:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789762674.488103:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148966400:0@lo:502: 00000040:00080000:1.0:1789762674.488156:0:7590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1789762674.488161:0:7590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789762674.488486:0:7601:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789762674.488506:0:7601:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff95d17430cd28) 00000020:00000080:1.0:1789762674.488520:0:7601:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1789762674.488589:0:7601:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d17fb80000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789762674.488594:0:7601:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d17fb80000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789762674.488598:0:7601:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d17fb80000 3 00010000:00080000:1.0:1789762674.488634:0:7601:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d17b47b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1789762674.490145:0:7601:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1789762674.490282:0:7601:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789762674.490304:0:7601:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789762674.490313:0:7601:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd08452c77c56dc8f 00000100:00080000:1.0:1789762674.490319:0:7601:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789762674.490323:0:7601:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95d17b47b800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1789762674.490364:0:7601:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d1463cdf80 x1876702148966528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789762674.490388:0:7601:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789762674.490421:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1876702148966528:0@lo:38: 00000100:00100000:2.0:1789762674.490482:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762674.490491:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702148966656:0@lo:400: 00000100:00100000:1.0:1789762674.490533:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762674.490564:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789762674.490566:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148966528 00000100:00100000:1.0:1789762674.490573:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702148966784:0@lo:400: 00000100:00100000:2.0:1789762674.490574:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148966528 00000100:00100000:2.0:1789762674.490606:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148966656 00000100:00100000:2.0:1789762674.490609:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148966656 00000100:00100000:1.0:1789762674.490620:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762674.490653:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789762674.490667:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702148966656:12345-0@lo:400: 00000100:00100000:1.0:1789762674.490668:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789762674.490679:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3275:x1876702148966528:12345-0@lo:38: 00010000:00080000:1.0:1789762674.490699:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 78 last 0 00000100:00100000:2.0:1789762674.490727:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702148966656:12345-0@lo:400: Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762674.490734:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:00000080:1.0:1789762674.490739:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd08452c77c56dc96 00000100:00100000:2.0:1789762674.490751:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000004:00100000:1.0:1789762674.490754:0:6681:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1789762674.490762:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702148966784:12345-0@lo:400: 00000100:00080000:1.0:1789762674.490789:0:6681:0:(import.c:65:import_set_state_nolock()) ffff95d041932800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789762674.490801:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702148966784:12345-0@lo:400: Request processed in 42us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762674.490810:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789762674.490880:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876702148966528:12345-0@lo:38: Request processed in 200us (397us total) trans 0 rc 0/0 00010000:00080000:2.0:1789762674.490882:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d1463cdf80 x1876702148966528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789762684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762674.490896:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789762674.490898:0:3275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789762674.490904:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789762674.490911:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789762674.490918:0:3275:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789762674.490928:0:3275:0:(import.c:65:import_set_state_nolock()) ffff95d17b47b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789762674.490935:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1876702148966528:0@lo:38: 00010000:00080000:2.0:1789762674.490979:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d1462c3800 x1876702148966784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789762690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762674.490988:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702148966784:0@lo:400: 00010000:00080000:2.0:1789762674.491003:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d1462c2d80 x1876702148966656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789762690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762674.491018:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702148966656:0@lo:400: 00000040:00080000:2.0:1789762674.491267:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1789762674.491314:0:7590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789762674.491334:0:7590:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789762674.491362:0:7590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dc81 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762674.491375:0:7590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dc81 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789762674.491422:0:7590:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789762674.491425:0:7590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789762674.491426:0:7590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789762674.491427:0:7590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789762674.491428:0:7590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789762674.491429:0:7590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789762674.491430:0:7590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789762674.491432:0:7590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789762674.491433:0:7590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789762674.491434:0:7590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789762674.491436:0:7590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789762674.491440:0:7590:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789762674.491443:0:7590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789762674.491448:0:7590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789762674.491450:0:7590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789762674.491451:0:7590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789762674.491452:0:7590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789762674.491453:0:7590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789762674.491454:0:7590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789762674.491455:0:7590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789762674.491456:0:7590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789762674.491457:0:7590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789762674.491458:0:7590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789762674.491470:0:7590:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789762674.491477:0:7590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148967168:0@lo:253: 00000100:00100000:2.0:1789762674.491507:0:7590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762674.491538:0:7590:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b0d43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762674.491561:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148967168 00000100:00100000:2.0:1789762674.491565:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148967168 00000100:00100000:2.0:1789762674.491597:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789762674.491607:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:7590:x1876702148967168:12345-0@lo:253: 20000000:01000000:2.0:1789762674.491640:0:5807:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789762674.491652:0:5807:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1789762674.491801:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:1.0:1789762674.499317:0:5828:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789762674.499322:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789762674.499339:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.499368:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d140030a00/0xd08452c77c56dbe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dbd9 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.499375:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.499402:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d140030a00/0xd08452c77c56dbe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56dbd9 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762674.499415:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d140030a00/0xd08452c77c56dbe0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56dbd9 expref: 14 pid: 5805 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762674.499425:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5828:1876702148967296:0@lo:104: 00000100:00100000:1.0:1789762674.499464:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762674.499500:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789762674.499503:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148967296 00000100:00100000:3.0:1789762674.499510:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148967296 00000100:00100000:3.0:1789762674.499551:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789762674.499561:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:5828:x1876702148967296:12345-0@lo:104: 00010000:00010000:3.0:1789762674.499577:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dbe0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.499644:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789762674.499652:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:5828:x1876702148967296:12345-0@lo:104: Request processed in 93us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762674.499653:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5828:1876702148967296:0@lo:104: 00000100:00100000:3.0:1789762674.499667:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789762674.499670:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.499696:0:6671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762674.499704:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dbe0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.499712:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d182041a00 already unused, calling callback (ffffffffc1a96c20) 10000000:00010000:3.0:1789762674.499715:0:6671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56dbe0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.499722:0:6671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56dbe0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789762674.499729:0:6671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56dbe0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762674.499734:0:6671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789762674.499765:0:6671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dbe0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.499770:0:6671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789762674.499790:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dbe0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.499795:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d182041a00/0xd08452c77c56dbd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dbe0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.499817:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762674.499821:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762674.499824:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762674.499970:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148967424 00000100:00100000:3.0:1789762674.499975:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148967424 00010000:00010000:3.0:1789762674.499994:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d140030a00/0xd08452c77c56dbe0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dbd9 expref: 15 pid: 5805 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762674.500017:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789762674.500025:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:3279:x1876702148967424:12345-0@lo:103: 00010000:00010000:3.0:1789762674.500033:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762674.500038:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d140030a00/0xd08452c77c56dbe0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dbd9 expref: 15 pid: 5805 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.500046:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d140030a00/0xd08452c77c56dbe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56dbd9 expref: 15 pid: 5805 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.500057:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d140030a00/0xd08452c77c56dbe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56dbd9 expref: 15 pid: 5805 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.500068:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.500074:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789762674.500088:0:5798:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001041595s 00010000:00010000:3.0:1789762674.500093:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.500112:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.500121:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.500129:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.500136:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cd000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762674.500140:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.500147:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.500164:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.500173:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762674.500216:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:3279:x1876702148967424:12345-0@lo:103: Request processed in 193us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762674.500223:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789762674.500255:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148967424:0@lo:103: 00010000:00010000:3.0:1789762674.500273:0:5828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.500279:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762674.500292:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1588cd000/0xd08452c77c56dc9d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762674.501516:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:7590:x1876702148967168:12345-0@lo:253: Request processed in 9909us (10005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762674.501525:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789762674.501529:0:7590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:7590:1876702148967168:0@lo:253: 10000000:01000000:2.0:1789762674.501541:0:7590:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789762674.501544:0:7590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789762674.501545:0:7590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789762674.501546:0:7590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789762674.501547:0:7590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789762674.501549:0:7590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789762674.501550:0:7590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789762674.501551:0:7590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789762674.501553:0:7590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789762674.501554:0:7590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789762674.501555:0:7590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789762674.501557:0:7590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789762674.501567:0:7590:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789762674.504714:0:7590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789762674.504877:0:7590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789762674.505054:0:7590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789762674.505175:0:7590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789762674.505298:0:7590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789762674.505468:0:7590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00002000:00080000:2.0:1789762674.582456:0:7590:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789762674.582463:0:7590:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789762674.582502:0:7590:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789762674.582548:0:7590:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789762674.582558:0:7590:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789762674.582581:0:7590:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789762675.750939:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762675.878941:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148967552:0@lo:13: 00000100:00100000:2.0:1789762675.878999:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789762675.879204:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d173ce9c00 x1876702148967552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762675.879222:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148967552:0@lo:13: 00000001:02000400:3.0:1789762676.284613:0:7944:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789762676.774966:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762677.798974:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762678.777152:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762678.777191:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140563584 00000100:00100000:2.0:1789762678.777200:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140563584 00000100:00100000:2.0:1789762678.777248:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:2.0:1789762678.777258:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2341:x1876702140563584:12345-192.168.203.31@tcp:250: 00010000:00080000:2.0:1789762678.777283:0:5805:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 10092651-e3dd-4a03-ad8e-f8dd26fd4c3e@192.168.203.31@tcp t0 exp 0000000000000000 cur 83 last 0 00000020:00000080:2.0:1789762678.777311:0:5805:0:(genops.c:1385:class_connect()) connect: client 10092651-e3dd-4a03-ad8e-f8dd26fd4c3e, cookie 0xd08452c77c56dca4 00000100:00080000:2.0:1789762678.777497:0:5805:0:(import.c:65:import_set_state_nolock()) ffff95d174454800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789762678.777545:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+5:2341:x1876702140563584:12345-192.168.203.31@tcp:250: Request processed in 287us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762678.777561:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:3.0:1789762678.778183:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762678.778210:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140563712 00000100:00100000:3.0:1789762678.778215:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140563712 00000100:00100000:3.0:1789762678.778251:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:3.0:1789762678.778260:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+5:5560:x1876702140563712:12345-192.168.203.31@tcp:101: 00010000:00010000:3.0:1789762678.778269:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762678.778282:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1583a8600/0xd08452c77c56dcab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e374 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762678.778303:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1583a8600/0xd08452c77c56dcab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e374 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762678.778312:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1583a8600/0xd08452c77c56dcab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e374 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762678.778332:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a8600, rc 0) 00000100:00100000:3.0:1789762678.778367:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+6:5560:x1876702140563712:12345-192.168.203.31@tcp:101: Request processed in 109us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762678.778375:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:1.0:1789762678.778985:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762678.780549:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140563968 00000100:00100000:1.0:1789762678.780554:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140563968 00000100:00100000:1.0:1789762678.780580:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:1.0:1789762678.780589:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+6:5560:x1876702140563968:12345-192.168.203.31@tcp:101: 00010000:00010000:1.0:1789762678.780596:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762678.780604:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1588cc600/0xd08452c77c56dcb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e37b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762678.780627:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1588cc600/0xd08452c77c56dcb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e37b expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762678.780635:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1588cc600/0xd08452c77c56dcb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e37b expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762678.780641:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cc600, rc 0) 00000100:00100000:1.0:1789762678.780672:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+7:5560:x1876702140563968:12345-192.168.203.31@tcp:101: Request processed in 85us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762678.780678:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:3.0:1789762678.781240:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762678.781944:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762678.781979:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140564224 00000100:00100000:1.0:1789762678.781983:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140564224 00000100:00100000:1.0:1789762678.782005:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:1.0:1789762678.782010:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+8:5560:x1876702140564224:12345-192.168.203.31@tcp:503: 00000100:00100000:1.0:1789762678.782217:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+8:5560:x1876702140564224:12345-192.168.203.31@tcp:503: Request processed in 206us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762678.782222:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:2.0:1789762678.783006:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762678.791621:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762678.791674:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140564480 00000100:00100000:1.0:1789762678.791682:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140564480 00000100:00100000:1.0:1789762678.791714:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:1.0:1789762678.791720:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+8:5578:x1876702140564480:12345-192.168.203.31@tcp:502: 00000100:00100000:1.0:1789762678.791924:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+8:5578:x1876702140564480:12345-192.168.203.31@tcp:502: Request processed in 202us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762678.791932:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:3.0:1789762678.795245:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762678.796507:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762678.796538:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140564736 00000100:00100000:1.0:1789762678.796549:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140564736 00000100:00100000:1.0:1789762678.796575:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:1.0:1789762678.796581:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+9:5560:x1876702140564736:12345-192.168.203.31@tcp:256: 20000000:01000000:1.0:1789762678.796594:0:5807:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789762678.796608:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789762678.796611:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789762678.796614:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789762678.796616:0:5807:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789762678.797174:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+9:5560:x1876702140564736:12345-192.168.203.31@tcp:256: Request processed in 591us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762678.797181:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:3.0:1789762678.798284:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762678.799225:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762678.799293:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140564992 00000100:00100000:1.0:1789762678.799298:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140564992 00000100:00100000:1.0:1789762678.799338:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:1.0:1789762678.799346:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:5560:x1876702140564992:12345-192.168.203.31@tcp:501: 00000100:00100000:1.0:1789762678.799485:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:5560:x1876702140564992:12345-192.168.203.31@tcp:501: Request processed in 140us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762678.799491:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:3.0:1789762678.800055:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762678.801176:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762678.801210:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140565248 00000100:00100000:1.0:1789762678.801216:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140565248 00000100:00100000:1.0:1789762678.801240:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:1.0:1789762678.801246:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a133c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:5580:x1876702140565248:12345-192.168.203.31@tcp:502: 00000100:00100000:1.0:1789762678.801361:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a133c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:5580:x1876702140565248:12345-192.168.203.31@tcp:502: Request processed in 114us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762678.801366:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:2.0:1789762678.801936:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762678.802975:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762678.803015:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140565504 00000100:00100000:2.0:1789762678.803020:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140565504 00000100:00100000:2.0:1789762678.803045:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1789762678.803052:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2341:x1876702140565504:12345-192.168.203.31@tcp:38: 00010000:00080000:2.0:1789762678.803069:0:5814:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp t0 exp 0000000000000000 cur 83 last 0 00000020:00000080:2.0:1789762678.803103:0:5814:0:(genops.c:1385:class_connect()) connect: client 77777931-b235-4c03-82d2-4b1d12553008, cookie 0xd08452c77c56dcc7 00000004:00100000:2.0:1789762678.803124:0:5814:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789762678.803129:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789762678.809522:0:5814:0:(import.c:65:import_set_state_nolock()) ffff95d15886c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789762678.809569:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2341:x1876702140565504:12345-192.168.203.31@tcp:38: Request processed in 6516us (6593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762678.809580:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1789762679.810451:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762679.810486:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762679.810509:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140565632 00000100:00100000:1.0:1789762679.810518:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140565632 00000100:00080000:3.0:1789762679.810581:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762679.810609:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1789762679.810622:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+7:0:x1876702140565632:12345-192.168.203.31@tcp:41: 00000004:00000024:3.0:1789762679.810649:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789762679.810708:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+7:0:x1876702140565632:12345-192.168.203.31@tcp:41: Request processed in 90us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762679.810719:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:2.0:1789762679.811669:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762679.811704:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140565888 00000100:00100000:3.0:1789762679.811709:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140565888 00000100:00100000:3.0:1789762679.811734:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1789762679.811740:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+6:5560:x1876702140565888:12345-192.168.203.31@tcp:40: 00000100:00100000:3.0:1789762679.811775:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+6:5560:x1876702140565888:12345-192.168.203.31@tcp:40: Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762679.811789:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1789762679.812556:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762679.812603:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140566016 00000100:00100000:2.0:1789762679.812608:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762679.812609:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140566016 00000100:00100000:1.0:1789762679.812676:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1789762679.812682:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876702140566016:12345-192.168.203.31@tcp:8: 00010000:00080000:1.0:1789762679.812704:0:6654:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp t0 exp 0000000000000000 cur 84 last 0 00000020:00000080:1.0:1789762679.812728:0:6654:0:(genops.c:1385:class_connect()) connect: client 77777931-b235-4c03-82d2-4b1d12553008, cookie 0xd08452c77c56dcce 00002000:00100000:1.0:1789762679.812738:0:6654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 77777931-b235-4c03-82d2-4b1d12553008/ffff95d0418cb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1789762679.812747:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00002000:00100000:1.0:1789762679.812754:0:6654:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789762679.812871:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1789762679.812880:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1789762679.813040:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00002000:00080000:1.0:1789762679.813177:0:6654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789762679.813209:0:6654:0:(import.c:65:import_set_state_nolock()) ffff95d0418ce800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789762679.813242:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2341:x1876702140566016:12345-192.168.203.31@tcp:8: Request processed in 559us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762679.813248:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1789762679.813269:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:1.0:1789762679.813273:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876702140566144:12345-192.168.203.31@tcp:8: 00010000:00080000:1.0:1789762679.813285:0:6654:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp t0 exp 0000000000000000 cur 84 last 0 00000020:00000080:1.0:1789762679.813296:0:6654:0:(genops.c:1385:class_connect()) connect: client 77777931-b235-4c03-82d2-4b1d12553008, cookie 0xd08452c77c56dcd5 00002000:00100000:1.0:1789762679.813300:0:6654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 77777931-b235-4c03-82d2-4b1d12553008/ffff95d0418ce000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789762679.813332:0:6654:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789762679.813446:0:6654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789762679.813458:0:6654:0:(import.c:65:import_set_state_nolock()) ffff95d0418cd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789762679.813485:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2341:x1876702140566144:12345-192.168.203.31@tcp:8: Request processed in 212us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762679.813490:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00010000:00010000:2.0:1789762679.846937:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762679.889348:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762679.889406:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140566528 00000100:00100000:1.0:1789762679.889417:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140566528 00000100:00100000:1.0:1789762679.889474:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:1.0:1789762679.889499:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+6:5597:x1876702140566528:12345-192.168.203.31@tcp:101: 00010000:00010000:1.0:1789762679.889520:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762679.889543:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc000/0xd08452c77c56dcdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e3d6 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762679.889602:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588ccc00/0xd08452c77c56dce3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762679.889616:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588ccc00/0xd08452c77c56dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762679.889630:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588ccc00/0xd08452c77c56dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762679.889664:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789762679.889668:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762679.889683:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588ccc00/0xd08452c77c56dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762679.889717:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc000/0xd08452c77c56dcdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3d6 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762679.889734:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588ccc00/0xd08452c77c56dce3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3d6 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762679.889743:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:1.0:1789762679.889746:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762679.889749:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588ccc00, rc 0) 00000100:00100000:1.0:1789762679.889810:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+7:5597:x1876702140566528:12345-192.168.203.31@tcp:101: Request processed in 315us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762679.889828:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:2.0:1789762679.975029:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148968064:0@lo:400: 00000100:00100000:1.0:1789762679.975044:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173cead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702148967808:0@lo:400: 00000100:00100000:3.0:1789762679.975044:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702148967936:0@lo:400: 00000100:00100000:2.0:1789762679.975125:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762679.975125:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762679.975147:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148967680 00000100:00100000:1.0:1789762679.975154:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148967680 00000100:00100000:3.0:1789762679.975196:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148967936 00000100:00100000:3.0:1789762679.975200:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148967936 00000100:00100000:1.0:1789762679.975207:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789762679.975209:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762679.975221:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:3277:x1876702148967680:12345-0@lo:400: 00000100:00100000:3.0:1789762679.975253:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148967808 00000100:00100000:3.0:1789762679.975258:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148967808 00000100:00100000:2.0:1789762679.975271:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789762679.975281:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:3277:x1876702148967680:12345-0@lo:400: Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762679.975289:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789762679.975296:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702148967936:12345-0@lo:400: 00000100:00100000:3.0:1789762679.975305:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789762679.975330:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702148967808:12345-0@lo:400: 00000100:00100000:1.0:1789762679.975358:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762679.975386:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702148967936:12345-0@lo:400: Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762679.975403:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702148967808:12345-0@lo:400: Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762679.975411:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789762679.975417:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702148967680:0@lo:400: 00000100:00100000:3.0:1789762679.975421:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789762679.975433:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148968192 00000100:00100000:2.0:1789762679.975437:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148968192 00000100:00080000:3.0:1789762679.975450:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762679.975455:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762679.975478:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789762679.975488:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702148968192:12345-0@lo:400: 00000100:00100000:3.0:1789762679.975524:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702148968192:12345-0@lo:400: Request processed in 39us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762679.975532:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789762679.975544:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702148967936:0@lo:400: 00000100:00100000:1.0:1789762679.975552:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702148968192:0@lo:400: 00000100:00100000:1.0:1789762680.487105:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148968320 00000100:00100000:1.0:1789762680.487113:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148968320 00000100:00100000:1.0:1789762680.487162:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789762680.487171:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:5810:x1876702148968320:12345-0@lo:101: 00010000:00010000:1.0:1789762680.487183:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762680.487193:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1588cc000/0xd08452c77c56dcf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dcea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.487212:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1588cc000/0xd08452c77c56dcf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dcea expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.487220:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1588cc000/0xd08452c77c56dcf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dcea expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.487239:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cc000, rc 0) 00000100:00100000:1.0:1789762680.487285:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:5810:x1876702148968320:12345-0@lo:101: Request processed in 116us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762680.487291:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789762680.487441:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148968448 00000100:00100000:1.0:1789762680.487446:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148968448 00000100:00100000:1.0:1789762680.487465:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789762680.487470:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:5810:x1876702148968448:12345-0@lo:501: 00000100:00100000:1.0:1789762680.487664:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:5810:x1876702148968448:12345-0@lo:501: Request processed in 193us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762680.487670:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789762680.487802:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148968576 00000100:00100000:1.0:1789762680.487809:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148968576 00000100:00100000:1.0:1789762680.488087:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148968576:0@lo:503: 00000100:00100000:1.0:1789762680.488333:0:8162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8162:1876702148968704:0@lo:502: 00000100:00100000:1.0:1789762680.488362:0:8162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.488390:0:8162:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789762680.488402:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148968704 00000100:00100000:2.0:1789762680.488408:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148968704 00000100:00100000:2.0:1789762680.488434:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789762680.488441:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:8162:x1876702148968704:12345-0@lo:502: 00000100:00100000:2.0:1789762680.488573:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:8162:x1876702148968704:12345-0@lo:502: Request processed in 133us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762680.488580:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789762680.488599:0:8162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8162:1876702148968704:0@lo:502: 00000100:00100000:1.0:1789762680.488639:0:8162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8162:1876702148968832:0@lo:502: 00000100:00100000:1.0:1789762680.488665:0:8162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.488678:0:8162:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789762680.488897:0:8162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8162:1876702148968832:0@lo:502: 00000040:00080000:1.0:1789762680.488922:0:8162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:2.0:1789762680.489127:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148968960 00000100:00100000:2.0:1789762680.489133:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148968960 00000100:00100000:2.0:1789762680.489156:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789762680.489162:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:5810:x1876702148968960:12345-0@lo:101: 00010000:00010000:2.0:1789762680.489169:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762680.489176:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f8e00/0xd08452c77c56dcff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dcf8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762680.489188:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f8e00/0xd08452c77c56dcff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dcf8 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762680.489195:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f8e00/0xd08452c77c56dcff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dcf8 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762680.489200:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f8e00, rc 0) 00000100:00100000:2.0:1789762680.489231:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148968960:12345-0@lo:101: Request processed in 69us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762680.489246:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789762680.489365:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148969088 00000100:00100000:1.0:1789762680.489374:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148969088 00000100:00100000:1.0:1789762680.489398:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789762680.489404:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148969088:12345-0@lo:501: 00000100:00100000:1.0:1789762680.489507:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148969088:12345-0@lo:501: Request processed in 103us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762680.489513:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789762680.489645:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148969216 00000100:00100000:2.0:1789762680.489651:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148969216 00000100:00100000:2.0:1789762680.489675:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789762680.489682:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148969216:12345-0@lo:503: 00000100:00100000:2.0:1789762680.489926:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148969216:12345-0@lo:503: Request processed in 243us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762680.489935:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789762680.490179:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148969344 00000100:00100000:1.0:1789762680.490183:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148969344 00000100:00100000:1.0:1789762680.490207:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789762680.490214:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:8163:x1876702148969344:12345-0@lo:502: 00000100:00100000:1.0:1789762680.490343:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:8163:x1876702148969344:12345-0@lo:502: Request processed in 130us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762680.490349:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789762680.490494:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148969472 00000100:00100000:2.0:1789762680.490498:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148969472 00000100:00100000:2.0:1789762680.490520:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789762680.490526:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:8163:x1876702148969472:12345-0@lo:502: 00000100:00100000:2.0:1789762680.490619:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:8163:x1876702148969472:12345-0@lo:502: Request processed in 93us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762680.490625:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000020:01000000:1.0:1789762680.490705:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789762680.490720:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789762680.490725:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d140030e00/0xd08452c77c56dcf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dcff expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.490732:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d140030e00/0xd08452c77c56dcf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dcff expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762680.490739:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789762680.490740:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d1549a0000 from 30 10000000:01000000:1.0:1789762680.490742:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789762680.490755:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.490763:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.490783:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762680.490797:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148969600:0@lo:101: 00000100:00100000:1.0:1789762680.490821:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.490884:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789762680.490977:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148969600:0@lo:101: 00010000:00010000:1.0:1789762680.490993:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dd0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.490999:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56dd0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762680.491026:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148969728:0@lo:501: 00000100:00100000:1.0:1789762680.491044:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.491058:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762680.491078:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148969728 00000100:00100000:2.0:1789762680.491082:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148969728 00000100:00100000:2.0:1789762680.491102:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789762680.491108:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148969728:12345-0@lo:501: 00000100:00100000:2.0:1789762680.491218:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148969728:12345-0@lo:501: Request processed in 109us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762680.491224:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789762680.491242:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148969728:0@lo:501: 00000100:00100000:1.0:1789762680.491264:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148969856:0@lo:503: 00000100:00100000:1.0:1789762680.491291:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.491318:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789762680.491451:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148969856:0@lo:503: 00000100:00100000:2.0:1789762680.491665:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148969984 00000100:00100000:2.0:1789762680.491669:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148969984 00000100:00100000:2.0:1789762680.491689:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789762680.491695:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:8164:x1876702148969984:12345-0@lo:502: 00000100:00100000:2.0:1789762680.491795:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:8164:x1876702148969984:12345-0@lo:502: Request processed in 99us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762680.491801:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789762680.491914:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148970112 00000100:00100000:1.0:1789762680.491920:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148970112 00000100:00100000:1.0:1789762680.491947:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789762680.491954:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:8164:x1876702148970112:12345-0@lo:502: 00000100:00100000:1.0:1789762680.492060:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:8164:x1876702148970112:12345-0@lo:502: Request processed in 107us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762680.492068:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000020:01000000:1.0:1789762680.492124:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789762680.492140:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789762680.492144:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dd0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.492151:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dd0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762680.492157:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789762680.492158:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d1549a0000 from 5 10000000:01000000:1.0:1789762680.492160:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789762680.492172:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1588cd800/0xd08452c77c56dd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.492177:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d1588cd800/0xd08452c77c56dd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.492182:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d1588cd800/0xd08452c77c56dd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762680.492190:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148970240:0@lo:101: 00000100:00100000:1.0:1789762680.492208:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.492221:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1602c8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789762680.492248:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148970240 00000100:00100000:2.0:1789762680.492252:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148970240 00000100:00100000:2.0:1789762680.492272:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789762680.492278:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148970240:12345-0@lo:101: 00010000:00010000:2.0:1789762680.492283:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762680.492289:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f9a00/0xd08452c77c56dd1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dd14 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762680.492301:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f9a00/0xd08452c77c56dd1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dd14 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762680.492327:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f9a00/0xd08452c77c56dd1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dd14 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762680.492333:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f9a00, rc 0) 00000100:00100000:2.0:1789762680.492360:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148970240:12345-0@lo:101: Request processed in 84us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762680.492366:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789762680.492387:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148970240:0@lo:101: 00010000:00010000:1.0:1789762680.492399:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d1588cd800/0xd08452c77c56dd14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dd1b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.492414:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d1588cd800/0xd08452c77c56dd14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56dd1b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762680.492444:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148970368:0@lo:256: 00000100:00100000:1.0:1789762680.492467:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.492480:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1602c8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762680.492622:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148970368:0@lo:256: 10000000:01000000:1.0:1789762680.492660:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789762680.492664:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1588cd800/0xd08452c77c56dd14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dd1b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.492670:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d1588cd800/0xd08452c77c56dd14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dd1b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762680.492674:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789762680.492675:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789762680.492677:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789762680.492688:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1588cce00/0xd08452c77c56dd22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.492693:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d1588cce00/0xd08452c77c56dd22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.492698:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d1588cce00/0xd08452c77c56dd22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762680.492705:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148970496:0@lo:101: 00000100:00100000:1.0:1789762680.492729:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.492743:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762680.492758:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148970496 00000100:00100000:2.0:1789762680.492762:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148970496 00000100:00100000:2.0:1789762680.492780:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789762680.492785:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148970496:12345-0@lo:101: 00010000:00010000:2.0:1789762680.492790:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762680.492796:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f8800/0xd08452c77c56dd29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dd22 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762680.492813:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f8800/0xd08452c77c56dd29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dd22 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762680.492819:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f8800/0xd08452c77c56dd29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dd22 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762680.492824:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f8800, rc 0) 00000100:00100000:2.0:1789762680.492868:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148970496:12345-0@lo:101: Request processed in 83us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762680.492874:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789762680.492893:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148970496:0@lo:101: 00010000:00010000:1.0:1789762680.492909:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d1588cce00/0xd08452c77c56dd22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dd29 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.492918:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d1588cce00/0xd08452c77c56dd22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56dd29 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762680.492947:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148970624:0@lo:501: 00000100:00100000:1.0:1789762680.492965:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.492990:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789762680.493148:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148970624:0@lo:501: 00000100:00100000:1.0:1789762680.493168:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148970752:0@lo:503: 00000100:00100000:1.0:1789762680.493194:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.493209:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762680.493218:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148970752 00000100:00100000:2.0:1789762680.493222:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148970752 00000100:00100000:2.0:1789762680.493243:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789762680.493247:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148970752:12345-0@lo:503: 00000100:00100000:2.0:1789762680.493457:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148970752:12345-0@lo:503: Request processed in 210us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762680.493463:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789762680.493482:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148970752:0@lo:503: 00000100:00100000:1.0:1789762680.493641:0:8165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8165:1876702148970880:0@lo:502: 00000100:00100000:1.0:1789762680.493667:0:8165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.493680:0:8165:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d152185b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789762680.493923:0:8165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8165:1876702148970880:0@lo:502: 00000020:01000000:1.0:1789762680.493947:0:8165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789762680.493952:0:8165:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789762680.493956:0:8165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762680.493957:0:8165:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789762680.493961:0:8165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789762680.493967:0:8165:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:1.0:1789762680.493992:0:8165:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789762680.493994:0:8165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789762680.494005:0:8165:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff95d17430b370) 00000020:00000080:1.0:1789762680.494033:0:8165:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789762680.494038:0:8165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789762680.494093:0:8165:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789762680.494097:0:8165:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789762680.494102:0:8165:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd08452c77c56dd37 00010000:00080000:1.0:1789762680.494123:0:8165:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d17a8ab800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1789762680.494287:0:8165:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789762680.494474:0:8165:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789762680.494482:0:8165:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789762680.494973:0:8165:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789762680.495139:0:8165:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789762680.495185:0:8165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789762680.495224:0:8165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789762680.495434:0:8166:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789762680.495439:0:8166:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789762680.495722:0:8165:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789762680.495727:0:8165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789762680.495742:0:8165:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789762680.495753:0:8165:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd08452c77c56dd3e 00000100:00080000:1.0:1789762680.495758:0:8165:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789762680.495762:0:8165:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d17a8ab800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1789762680.495778:0:8165:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d1463cf100 x1876702148971008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789762680.495797:0:8165:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789762680.495852:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1876702148971008:0@lo:8: 00000020:01000000:1.0:1789762680.495870:0:8165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789762680.495874:0:8165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762680.495881:0:8165:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789762680.495885:0:8165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789762680.495889:0:8165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762680.495891:0:8165:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000100:00100000:2.0:1789762680.495892:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1789762680.495894:0:8165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789762680.495896:0:8165:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789762680.495913:0:8165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8165:1876702148971136:0@lo:502: 00000100:00100000:1.0:1789762680.495958:0:8165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.495983:0:8165:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1527c3000 going to sleep for 11 seconds 00000100:00100000:3.0:1789762680.496016:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148971136 00000100:00100000:3.0:1789762680.496026:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148971136 00000100:00100000:3.0:1789762680.496074:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789762680.496088:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:8165:x1876702148971136:12345-0@lo:502: 00010000:00080000:2.0:1789762680.496302:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1463cf100 x1876702148971008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789762690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762680.496324:0:3275:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789762680.496329:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789762680.496338:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:3.0:1789762680.496343:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:8165:x1876702148971136:12345-0@lo:502: Request processed in 261us (388us total) trans 0 rc 0/0 00000100:00080000:2.0:1789762680.496344:0:3275:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789762680.496349:0:3275:0:(import.c:65:import_set_state_nolock()) ffff95d17a8ab800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789762680.496357:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789762680.496368:0:8165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8165:1876702148971136:0@lo:502: 00000004:00080000:2.0:1789762680.496375:0:3275:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789762680.496382:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1876702148971008:0@lo:8: 00000020:01000000:1.0:1789762680.496398:0:8165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789762680.496403:0:8165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762680.496406:0:8165:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000004:00080000:2.0:1789762680.496406:0:8166:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000040:00080000:1.0:1789762680.496410:0:8165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:2.0:1789762680.496501:0:8166:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 84969665996ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789762680.496621:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148971264 00000100:00100000:2.0:1789762680.496627:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148971264 00000100:00100000:2.0:1789762680.496654:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789762680.496663:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148971264:12345-0@lo:101: 00010000:00010000:2.0:1789762680.496671:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762680.496680:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f9c00/0xd08452c77c56dd53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dd4c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762680.496696:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f9c00/0xd08452c77c56dd53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dd4c expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762680.496705:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f9c00/0xd08452c77c56dd53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dd4c expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762680.496713:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f9c00, rc 0) 00000100:00100000:2.0:1789762680.496748:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148971264:12345-0@lo:101: Request processed in 87us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762680.496756:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789762680.496938:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148971392 00000100:00100000:1.0:1789762680.496944:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148971392 00000100:00100000:1.0:1789762680.496985:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789762680.496994:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148971392:12345-0@lo:501: 00000100:00100000:1.0:1789762680.497172:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148971392:12345-0@lo:501: Request processed in 177us (261us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789762680.497180:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789762680.497216:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148971392:0@lo:501: 10000000:01000000:1.0:1789762680.497248:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789762680.497254:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d140030600/0xd08452c77c56dd4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dd53 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762680.497264:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d140030600/0xd08452c77c56dd4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dd53 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762680.505056:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148971520:0@lo:13: 00000100:00100000:1.0:1789762680.505107:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.505180:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148971520 00000100:00100000:1.0:1789762680.505184:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148971520 00000100:00100000:1.0:1789762680.505229:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789762680.505240:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1876702148971520:12345-0@lo:13: 00002000:00000024:1.0:1789762680.505256:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789762680.505301:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1876702148971520:12345-0@lo:13: Request processed in 65us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762680.505324:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789762680.505343:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1462c0380 x1876702148971520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762680.505359:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148971520:0@lo:13: 00000100:00100000:1.0:1789762680.506930:0:8167:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150ff39c0 going to sleep for 11 seconds 00010000:00080000:1.0:1789762680.508629:0:8167:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1462c0e00 x1876702148971648/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789762696 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762680.508639:0:8167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8167:1876702148971648:0@lo:7: 00000004:00080000:1.0:1789762680.508647:0:8167:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789762680.508664:0:8167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463ce300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8167:1876702148971776:0@lo:5: 00000100:00100000:1.0:1789762680.508687:0:8167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.508720:0:8167:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b0d4600 going to sleep for 11 seconds 00010000:00080000:1.0:1789762680.508970:0:8167:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1463ce300 x1876702148971776/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789762696 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762680.508980:0:8167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463ce300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8167:1876702148971776:0@lo:5: 00000004:00080000:1.0:1789762680.508986:0:8167:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789762680.509003:0:8167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8167:1876702148971904:0@lo:700: 00000100:00100000:1.0:1789762680.509030:0:8167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762680.509053:0:8167:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b0d4600 going to sleep for 11 seconds 00000100:00100000:1.0:1789762680.509171:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148972032 00000100:00100000:1.0:1789762680.509176:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148972032 00000100:00100000:1.0:1789762680.509201:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789762680.509207:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6662:x1876702148972032:12345-0@lo:700: 40000000:02000000:1.0:1789762680.516030:0:5819:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1789762680.518961:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6662:x1876702148972032:12345-0@lo:700: Request processed in 9751us (9816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762680.518970:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789762680.518991:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6662:1876702148972032:0@lo:700: 40000000:02000000:2.0:1789762680.519003:0:6662:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1789762680.536043:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8167:x1876702148971904:12345-0@lo:700: Request processed in 26943us (27007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762680.536056:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789762680.536079:0:8167:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1463cf100 x1876702148971904/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789762696 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762680.536092:0:8167:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789762680.536110:0:8167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8167:1876702148971904:0@lo:700: 00000100:00100000:2.0:1789762680.544580:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148972160 00000100:00100000:2.0:1789762680.544587:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148972160 00000100:00100000:2.0:1789762680.544634:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789762680.544645:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8167:x1876702148972160:12345-0@lo:5: 00002000:00080000:2.0:1789762680.547550:0:6656:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789762680.547562:0:6656:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789762680.549021:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8167:x1876702148972160:12345-0@lo:5: Request processed in 4378us (4488us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789762680.549027:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1789762680.870986:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762680.998995:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148972288:0@lo:13: 00000100:00100000:1.0:1789762680.999055:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789762680.999267:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d173ce9180 x1876702148972288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762680.999283:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148972288:0@lo:13: 00000100:00100000:3.0:1789762681.264107:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00080000:3.0:1789762681.264230:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762681.265800:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762681.265886:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140566784 00000100:00100000:1.0:1789762681.265892:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140566784 00000100:00100000:1.0:1789762681.265935:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1789762681.265941:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:77777931-b235-4c03-82d2-4b1d12553008+6:5649:x1876702140566784:12345-192.168.203.31@tcp:13: 00002000:00000024:1.0:1789762681.265956:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789762681.265958:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762681.265993:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:77777931-b235-4c03-82d2-4b1d12553008+6:5649:x1876702140566784:12345-192.168.203.31@tcp:13: Request processed in 51us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762681.266016:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1789762681.266797:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00080000:3.0:1789762681.266967:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1789762682.117721:0:8254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1789762683.054056:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000040:00080000:2.0:1789762683.240046:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789762683.241020:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789762683.241051:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789762683.241071:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789762683.241080:0:8404:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789762683.241082:0:8404:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789762683.241491:0:8407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789762683.242037:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1789762683.242535:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148972416 00000100:00100000:3.0:1789762683.242544:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148972416 00000100:00100000:3.0:1789762683.242597:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148972544 00000100:00100000:3.0:1789762683.242603:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148972544 00000100:00100000:1.0:1789762683.242619:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789762683.242634:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:8404:x1876702148972416:12345-0@lo:104: 00000100:00100000:2.0:1789762683.242636:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789762683.242648:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d140030600/0xd08452c77c56dd4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dd53 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762683.242650:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:8404:x1876702148972544:12345-0@lo:104: 00010000:00010000:2.0:1789762683.242666:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d1588cce00/0xd08452c77c56dd22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dd29 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762683.242691:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789762683.242709:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148972672 00000100:00100000:3.0:1789762683.242714:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148972672 00010000:00010000:1.0:1789762683.242726:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789762683.242739:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789762683.242740:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:8404:x1876702148972416:12345-0@lo:104: Request processed in 111us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762683.242748:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789762683.242752:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:8404:x1876702148972544:12345-0@lo:104: Request processed in 103us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762683.242761:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789762683.242765:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:8404:x1876702148972672:12345-0@lo:104: 00000100:00100000:2.0:1789762683.242772:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789762683.242776:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dd0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762683.242786:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148972800 00000100:00100000:1.0:1789762683.242793:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148972800 00010000:00010000:2.0:1789762683.242805:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789762683.242815:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d140030600/0xd08452c77c56dd4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dd53 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.242867:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc1a96c20) 10000000:00010000:2.0:1789762683.242871:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d140030600/0xd08452c77c56dd4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56dd53 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.242879:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d140030600/0xd08452c77c56dd4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56dd53 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762683.242889:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d140030600/0xd08452c77c56dd4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56dd53 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762683.242907:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789762683.242942:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d140030600/0xd08452c77c56dd4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dd53 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.242948:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789762683.242963:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d140030600/0xd08452c77c56dd4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dd53 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.242981:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d140030600/0xd08452c77c56dd4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dd53 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.243009:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762683.243015:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dd0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.243023:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cda00 already unused, calling callback (ffffffffc1a96c20) 10000000:00010000:2.0:1789762683.243026:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56dd0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.243043:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56dd0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762683.243050:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56dd0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762683.243055:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789762683.243074:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dd0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.243079:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789762683.243094:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789762683.243100:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dd0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.243107:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d1588cda00/0xd08452c77c56dd06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dd0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762683.243108:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:8404:x1876702148972800:12345-0@lo:104: 00010000:00010000:1.0:1789762683.243123:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d140030e00/0xd08452c77c56dcf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dcff expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.243127:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762683.243132:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762683.243135:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762683.243147:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148973312:0@lo:103: 00010000:00010000:1.0:1789762683.243177:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789762683.243184:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:8404:x1876702148972800:12345-0@lo:104: Request processed in 81us (442us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762683.243190:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789762683.243191:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789762683.243200:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:8404:x1876702148972672:12345-0@lo:104: Request processed in 439us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762683.243204:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762683.243220:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148972928 00000100:00100000:3.0:1789762683.243221:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789762683.243226:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148972928 00000100:00100000:1.0:1789762683.243255:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789762683.243267:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:8404:x1876702148972928:12345-0@lo:104: 00010000:00010000:1.0:1789762683.243275:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d140031200/0xd08452c77c56dcea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dcf1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762683.243311:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148973312 00010000:00010000:2.0:1789762683.243317:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789762683.243317:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148973312 00010000:00010000:2.0:1789762683.243325:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d140030e00/0xd08452c77c56dcf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dcff expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.243333:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030e00 already unused, calling callback (ffffffffc1a96c20) 10000000:00010000:2.0:1789762683.243336:0:6670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d140030e00/0xd08452c77c56dcf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56dcff expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.243337:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d140030c00/0xd08452c77c56dd0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dd06 expref: 21 pid: 5808 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762683.243351:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789762683.243364:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:8404:x1876702148972928:12345-0@lo:104: Request processed in 98us (504us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762683.243368:0:6670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d140030e00/0xd08452c77c56dcf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56dcff expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762683.243373:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 10000000:00010000:2.0:1789762683.243383:0:6670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d140030e00/0xd08452c77c56dcf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56dcff expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762683.243384:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789762683.243389:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+21:3276:x1876702148973184:12345-0@lo:103: 10000000:01000000:2.0:1789762683.243401:0:6670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789762683.243404:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762683.243406:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762683.243412:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d1821f8800/0xd08452c77c56dd29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dd22 expref: 21 pid: 5805 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762683.243419:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d140031200/0xd08452c77c56dcea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dcf1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.243427:0:6670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d140030e00/0xd08452c77c56dcf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dcff expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762683.243428:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc1a96c20) 10000000:00010000:1.0:1789762683.243434:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d140031200/0xd08452c77c56dcea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56dcf1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.243448:0:6670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789762683.243451:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d1821f8800/0xd08452c77c56dd29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56dd22 expref: 21 pid: 5805 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762683.243453:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d140031200/0xd08452c77c56dcea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56dcf1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.243458:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d140030e00/0xd08452c77c56dcf8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dcff expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789762683.243475:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d140031200/0xd08452c77c56dcea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56dcf1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.243477:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d140030e00/0xd08452c77c56dcf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dcff expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.243477:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:1.0:1789762683.243493:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789762683.243504:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762683.243509:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762683.243513:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762683.243515:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d140031200/0xd08452c77c56dcea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dcf1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762683.243521:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789762683.243528:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+21:3276:x1876702148973184:12345-0@lo:103: Request processed in 142us (381us total) trans 0 rc 0/0 00010000:00010000:1.0:1789762683.243536:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d140031200/0xd08452c77c56dcea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dcf1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762683.243540:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148973440:0@lo:103: 00000100:00100000:3.0:1789762683.243548:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789762683.243555:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d140031200/0xd08452c77c56dcea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dcf1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762683.243575:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789762683.243577:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762683.243580:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762683.243584:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762683.243590:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762683.243591:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702148973312:12345-0@lo:103: 00000100:00100000:1.0:1789762683.243606:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148973440 00010000:00010000:3.0:1789762683.243606:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789762683.243612:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148973440 00010000:00010000:3.0:1789762683.243616:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d140030c00/0xd08452c77c56dd0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dd06 expref: 19 pid: 5808 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762683.243632:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d1821f8e00/0xd08452c77c56dcff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dcf8 expref: 20 pid: 5805 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.243635:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d140030c00/0xd08452c77c56dd0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56dd06 expref: 20 pid: 5808 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762683.243646:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148973568 00000100:00100000:2.0:1789762683.243652:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148973568 00010000:00010000:3.0:1789762683.243653:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762683.243658:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789762683.243672:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+21:3279:x1876702148973440:12345-0@lo:103: 00010000:00010000:2.0:1789762683.243672:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d1588cc000/0xd08452c77c56dcf1 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dcea expref: 21 pid: 5807 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762683.243686:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762683.243694:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d1821f8e00/0xd08452c77c56dcff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dcf8 expref: 21 pid: 5805 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762683.243703:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+21:3278:x1876702148973312:12345-0@lo:103: Request processed in 118us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762683.243704:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1789762683.243706:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d1821f8e00/0xd08452c77c56dcff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56dcf8 expref: 21 pid: 5805 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762683.243718:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+21:3276:x1876702148973568:12345-0@lo:103: 00000100:00100000:3.0:1789762683.243720:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789762683.243729:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762683.243735:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762683.243744:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d1588cc000/0xd08452c77c56dcf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dcea expref: 20 pid: 5807 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.243767:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d1588cc000/0xd08452c77c56dcf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56dcea expref: 20 pid: 5807 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762683.243770:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148973312:0@lo:103: 00000100:00100000:1.0:1789762683.243774:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+20:3279:x1876702148973440:12345-0@lo:103: Request processed in 105us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762683.243792:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789762683.243797:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762683.243808:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762683.243865:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148973440:0@lo:103: 00000100:00100000:2.0:1789762683.243875:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702148973568:12345-0@lo:103: Request processed in 160us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762683.243886:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789762683.243998:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148973952 00000100:00100000:2.0:1789762683.244003:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148973952 00000100:00100000:2.0:1789762683.244033:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789762683.244044:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:8404:x1876702148973952:12345-0@lo:104: 00010000:00010000:2.0:1789762683.244051:0:6669:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dc81 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762683.244070:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148974080 00000100:00100000:1.0:1789762683.244076:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148974080 00010000:00010000:2.0:1789762683.244097:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789762683.244109:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789762683.244109:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:8404:x1876702148973952:12345-0@lo:104: Request processed in 62us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762683.244123:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:8404:x1876702148974080:12345-0@lo:104: 00000100:00100000:2.0:1789762683.244127:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1789762683.244135:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56dc50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dc57 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.244149:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762683.244156:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dc81 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.244175:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc400 already unused, calling callback (ffffffffc1a96c20) 10000000:00010000:2.0:1789762683.244179:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56dc81 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762683.244186:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789762683.244193:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789762683.244195:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:8404:x1876702148974080:12345-0@lo:104: Request processed in 74us (161us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762683.244201:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56dc50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dc57 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.244215:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56dc81 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762683.244216:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789762683.244220:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9000 already unused, calling callback (ffffffffc1a96c20) 10000000:00010000:3.0:1789762683.244227:0:6670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56dc50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56dc57 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762683.244233:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56dc81 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.244237:0:6670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56dc50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56dc57 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762683.244246:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1789762683.244253:0:6670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56dc50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56dc57 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762683.244259:0:6670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789762683.244277:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dc81 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.244282:0:6670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56dc50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dc57 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.244299:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789762683.244302:0:6670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789762683.244316:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dc81 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.244321:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56dc50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dc57 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.244324:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d1588cc400/0xd08452c77c56dc7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dc81 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.244333:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56dc50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dc57 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762683.244335:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789762683.244350:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148974336:0@lo:103: 00010000:00010000:2.0:1789762683.244351:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762683.244356:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762683.244360:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762683.244367:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762683.244377:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762683.244379:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762683.244392:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762683.244425:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762683.244466:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789762683.244477:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:3279:x1876702148974336:12345-0@lo:103: 00010000:00010000:1.0:1789762683.244485:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762683.244490:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d1588cde00/0xd08452c77c56dc57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dc50 expref: 15 pid: 5805 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762683.244507:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d1588cde00/0xd08452c77c56dc57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56dc50 expref: 15 pid: 5805 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762683.244525:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1588cde00/0xd08452c77c56dc57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56dc50 expref: 15 pid: 5805 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762683.244537:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762683.244570:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:3279:x1876702148974336:12345-0@lo:103: Request processed in 97us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762683.244577:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789762683.244602:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148974336:0@lo:103: 00000100:00100000:3.0:1789762683.244628:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148974208:0@lo:103: 00000100:00100000:3.0:1789762683.245233:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762683.245269:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140567040 00000100:00100000:2.0:1789762683.245275:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140567040 00010000:00010000:2.0:1789762683.245308:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d1583a8600/0xd08452c77c56dcab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e374 expref: 10 pid: 5807 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762683.245335:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1789762683.245343:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a04ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:2344:x1876702140567040:12345-192.168.203.31@tcp:103: 00010000:00010000:2.0:1789762683.245360:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762683.245367:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d1583a8600/0xd08452c77c56dcab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e374 expref: 10 pid: 5807 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.245377:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d1583a8600/0xd08452c77c56dcab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e374 expref: 10 pid: 5807 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.245390:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1583a8600/0xd08452c77c56dcab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e374 expref: 10 pid: 5807 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762683.245401:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762683.245434:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a04ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+9:2344:x1876702140567040:12345-192.168.203.31@tcp:103: Request processed in 92us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762683.245442:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1789762683.245612:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762683.245638:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140567168 00000100:00100000:3.0:1789762683.245643:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140567168 00010000:00010000:3.0:1789762683.245656:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d1588cc600/0xd08452c77c56dcb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e37b expref: 9 pid: 5807 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762683.245723:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:3.0:1789762683.245730:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+9:2345:x1876702140567168:12345-192.168.203.31@tcp:103: 00010000:00010000:3.0:1789762683.245736:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762683.245740:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d1588cc600/0xd08452c77c56dcb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e37b expref: 9 pid: 5807 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.245746:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d1588cc600/0xd08452c77c56dcb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e37b expref: 9 pid: 5807 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.245754:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1588cc600/0xd08452c77c56dcb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e37b expref: 9 pid: 5807 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.245762:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d140031600/0xd08452c77c56dd5a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.245768:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d140031600/0xd08452c77c56dd5a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.245776:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d140031600/0xd08452c77c56dd5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.245789:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d140031600/0xd08452c77c56dd5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.245793:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d140031600/0xd08452c77c56dd5a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.245798:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d140031600/0xd08452c77c56dd5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.245801:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762683.245804:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d140031600/0xd08452c77c56dd5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.245808:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d140031600/0xd08452c77c56dd5a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.245819:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d140031600/0xd08452c77c56dd5a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762683.245825:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762683.245875:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+8:2345:x1876702140567168:12345-192.168.203.31@tcp:103: Request processed in 143us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762683.245883:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00010000:00010000:1.0:1789762683.942936:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762684.967002:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762685.300613:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140567296 00000100:00100000:2.0:1789762685.300625:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140567296 00000100:00100000:3.0:1789762685.300634:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140567424 00000100:00100000:1.0:1789762685.300636:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140567552 00000100:00100000:3.0:1789762685.300641:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140567424 00000100:00100000:1.0:1789762685.300644:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140567552 00000100:00100000:2.0:1789762685.300687:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:2.0:1789762685.300702:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+8:2344:x1876702140567296:12345-192.168.203.31@tcp:400: 00000100:00100000:3.0:1789762685.300709:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1789762685.300717:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:3.0:1789762685.300724:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140567424:12345-192.168.203.31@tcp:400: 00000100:00100000:1.0:1789762685.300733:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140567552:12345-192.168.203.31@tcp:400: 00000100:00100000:3.0:1789762685.300798:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140567424:12345-192.168.203.31@tcp:400: Request processed in 72us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762685.300800:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+8:2344:x1876702140567296:12345-192.168.203.31@tcp:400: Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762685.300801:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140567552:12345-192.168.203.31@tcp:400: Request processed in 64us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762685.300821:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:1.0:1789762685.300828:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:3.0:1789762685.300828:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00080000:3.0:1789762685.300897:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762685.300902:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762685.300905:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762685.607038:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148974464:0@lo:400: 00000100:00100000:3.0:1789762685.607038:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148974592:0@lo:13: 00000100:00100000:2.0:1789762685.607121:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762685.607126:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762685.607191:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148974976:0@lo:400: 00000100:00100000:3.0:1789762685.607192:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702148975104:0@lo:400: 00000100:00100000:2.0:1789762685.607231:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762685.607248:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762685.607312:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148974976 00000100:00100000:3.0:1789762685.607318:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148974592 00000100:00100000:3.0:1789762685.607325:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148974592 00000100:00100000:2.0:1789762685.607327:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148974976 00000100:00100000:3.0:1789762685.607398:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789762685.607409:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702148974592:12345-0@lo:13: 00000100:00080000:2.0:1789762685.607438:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1789762685.607439:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789762685.607444:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762685.607460:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148975232 00000100:00100000:1.0:1789762685.607464:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148974464 00000100:00100000:2.0:1789762685.607466:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148975232 00000100:00100000:1.0:1789762685.607472:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148974464 00000100:00100000:3.0:1789762685.607488:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1876702148974592:12345-0@lo:13: Request processed in 82us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762685.607496:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789762685.607500:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789762685.607512:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148974976:12345-0@lo:400: 00000100:00100000:1.0:1789762685.607513:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789762685.607528:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148974720 00000100:00100000:1.0:1789762685.607529:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:3279:x1876702148974464:12345-0@lo:400: 00000100:00100000:3.0:1789762685.607534:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148974720 00000100:00100000:2.0:1789762685.607567:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148974976:12345-0@lo:400: Request processed in 59us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762685.607577:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789762685.607582:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789762685.607588:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:3279:x1876702148974464:12345-0@lo:400: Request processed in 61us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762685.607598:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702148975104:12345-0@lo:400: 00000100:00100000:2.0:1789762685.607599:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789762685.607609:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789762685.607614:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702148975232:12345-0@lo:400: 00000100:00100000:1.0:1789762685.607660:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789762685.607661:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702148975104:12345-0@lo:400: Request processed in 66us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762685.607667:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702148975232:12345-0@lo:400: Request processed in 55us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762685.607679:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148974720:12345-0@lo:400: 00000100:00100000:3.0:1789762685.607679:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789762685.607685:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789762685.607711:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762685.607737:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148974720:12345-0@lo:400: Request processed in 65us (437us total) trans 0 rc 0/0 00010000:00080000:2.0:1789762685.607745:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1463ce680 x1876702148974976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762685.607748:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789762685.607767:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148974976:0@lo:400: 00000100:00100000:2.0:1789762685.607794:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148974464:0@lo:400: 00000100:00100000:1.0:1789762685.607814:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702148974848:0@lo:400: 00000100:00100000:1.0:1789762685.607900:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702148975104:0@lo:400: 00010000:00080000:1.0:1789762685.607913:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1522ff480 x1876702148974592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762685.607929:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148974592:0@lo:13: 00010000:00010000:2.0:1789762685.990944:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762686.119108:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148975360 00000100:00100000:3.0:1789762686.119116:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148975360 00000100:00100000:3.0:1789762686.119164:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789762686.119173:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148975360:12345-0@lo:13: 00002000:00000024:3.0:1789762686.119216:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762686.119261:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148975360:12345-0@lo:13: Request processed in 89us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762686.119285:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789762687.014944:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762687.015141:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148975488 00000100:00100000:2.0:1789762687.015150:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148975488 00000100:00100000:2.0:1789762687.015196:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789762687.015205:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+12:5810:x1876702148975488:12345-0@lo:101: 00010000:00010000:2.0:1789762687.015217:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762687.015227:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f8400/0xd08452c77c56dd68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dd61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.015253:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f8400/0xd08452c77c56dd68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dd61 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.015297:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f8400/0xd08452c77c56dd68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dd61 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.015304:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f8400, rc 0) 00000100:00100000:2.0:1789762687.015344:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:5810:x1876702148975488:12345-0@lo:101: Request processed in 140us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.015349:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789762687.015540:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148975616 00000100:00100000:2.0:1789762687.015544:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148975616 00000100:00100000:2.0:1789762687.015565:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789762687.015570:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:5810:x1876702148975616:12345-0@lo:501: 00000100:00100000:2.0:1789762687.015747:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:5810:x1876702148975616:12345-0@lo:501: Request processed in 176us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.015753:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789762687.015952:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148975744 00000100:00100000:2.0:1789762687.015957:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148975744 00000100:00100000:2.0:1789762687.015987:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789762687.015995:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:5810:x1876702148975744:12345-0@lo:503: 00000100:00100000:2.0:1789762687.016109:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:5810:x1876702148975744:12345-0@lo:503: Request processed in 116us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.016124:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789762687.016400:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8424:1876702148975872:0@lo:502: 00000100:00100000:2.0:1789762687.016429:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762687.016450:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a76180 going to sleep for 11 seconds 00000100:00100000:2.0:1789762687.016762:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8424:1876702148975872:0@lo:502: 00000100:00100000:2.0:1789762687.016799:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8424:1876702148976000:0@lo:502: 00000100:00100000:2.0:1789762687.016824:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762687.016877:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d180d5c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789762687.017068:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8424:1876702148976000:0@lo:502: 00000040:00080000:2.0:1789762687.017088:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:2.0:1789762687.017313:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148976128 00000100:00100000:2.0:1789762687.017317:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148976128 00000100:00100000:2.0:1789762687.017340:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789762687.017344:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+13:5810:x1876702148976128:12345-0@lo:101: 00010000:00010000:2.0:1789762687.017349:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762687.017357:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f9000/0xd08452c77c56dd76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dd6f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.017369:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f9000/0xd08452c77c56dd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dd6f expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.017376:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f9000/0xd08452c77c56dd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dd6f expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.017382:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f9000, rc 0) 00000100:00100000:2.0:1789762687.017406:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:5810:x1876702148976128:12345-0@lo:101: Request processed in 62us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.017412:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789762687.017554:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148976256 00000100:00100000:2.0:1789762687.017558:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148976256 00000100:00100000:2.0:1789762687.017578:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789762687.017589:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:5810:x1876702148976256:12345-0@lo:501: 00000100:00100000:2.0:1789762687.017711:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:5810:x1876702148976256:12345-0@lo:501: Request processed in 122us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.017717:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789762687.017821:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148976384 00000100:00100000:2.0:1789762687.017825:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148976384 00000100:00100000:2.0:1789762687.017888:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789762687.017895:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:5810:x1876702148976384:12345-0@lo:503: 00000100:00100000:2.0:1789762687.018010:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:5810:x1876702148976384:12345-0@lo:503: Request processed in 115us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.018016:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789762687.018214:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8425:1876702148976512:0@lo:502: 00000100:00100000:2.0:1789762687.018245:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762687.018294:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d152135f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789762687.018466:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8425:1876702148976512:0@lo:502: 00000020:01000000:2.0:1789762687.018494:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762687.018502:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762687.018504:0:8425:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789762687.018510:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789762687.018531:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8425:1876702148976640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762687.018563:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762687.018577:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1510d2780 going to sleep for 11 seconds 00000100:00100000:2.0:1789762687.018734:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8425:1876702148976640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762687.018755:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762687.018759:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762687.018760:0:8425:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789762687.018762:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000100:00100000:2.0:1789762687.018959:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148976768 00000100:00100000:2.0:1789762687.018966:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148976768 00000100:00100000:2.0:1789762687.018998:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789762687.019005:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+14:5810:x1876702148976768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762687.019011:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762687.019018:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dd84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dd7d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.019029:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dd84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dd7d expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.019035:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f8a00/0xd08452c77c56dd84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dd7d expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.019040:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f8a00, rc 0) 00000100:00100000:2.0:1789762687.019067:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148976768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 64us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.019072:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789762687.019164:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148976896 00000100:00100000:2.0:1789762687.019170:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148976896 00000100:00100000:2.0:1789762687.019191:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789762687.019196:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148976896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762687.019325:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148976896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.019334:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789762687.019415:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148977024 00000100:00100000:2.0:1789762687.019419:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148977024 00000100:00100000:2.0:1789762687.019441:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789762687.019446:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148977024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762687.019532:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148977024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.019537:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789762687.019720:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8426:1876702148977152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762687.019749:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762687.019765:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1506e9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789762687.019962:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8426:1876702148977152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762687.020001:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8426:1876702148977280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762687.020028:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762687.020076:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1506e9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789762687.020326:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8426:1876702148977280:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789762687.020349:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:2.0:1789762687.020498:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148977408 00000100:00100000:2.0:1789762687.020503:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148977408 00000100:00100000:2.0:1789762687.020526:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789762687.020531:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+15:5810:x1876702148977408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762687.020537:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762687.020543:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f8200/0xd08452c77c56dd92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dd8b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.020554:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f8200/0xd08452c77c56dd92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dd8b expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.020561:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f8200/0xd08452c77c56dd92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dd8b expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.020574:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f8200, rc 0) 00000100:00100000:2.0:1789762687.020599:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148977408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.020604:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789762687.020730:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148977536 00000100:00100000:2.0:1789762687.020734:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148977536 00000100:00100000:2.0:1789762687.020754:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789762687.020758:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148977536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762687.020895:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148977536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.020901:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789762687.020995:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148977664 00000100:00100000:2.0:1789762687.020999:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148977664 00000100:00100000:2.0:1789762687.021022:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789762687.021027:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148977664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762687.021199:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148977664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.021209:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789762687.021424:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8427:1876702148977792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762687.021451:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762687.021466:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1506e9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789762687.021665:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8427:1876702148977792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762687.021691:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762687.021697:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762687.021705:0:8427:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789762687.021711:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789762687.021730:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8427:1876702148977920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762687.021762:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762687.021777:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1506e9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789762687.021949:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8427:1876702148977920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762687.021975:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762687.021980:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762687.021982:0:8427:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789762687.021985:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000100:00100000:2.0:1789762687.022119:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148978048 00000100:00100000:2.0:1789762687.022124:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148978048 00000100:00100000:2.0:1789762687.022149:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789762687.022154:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148978048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762687.022160:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762687.022166:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f8e00/0xd08452c77c56dda0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dd99 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.022178:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f8e00/0xd08452c77c56dda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dd99 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.022184:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f8e00/0xd08452c77c56dda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dd99 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.022189:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f8e00, rc 0) 00000100:00100000:2.0:1789762687.022216:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148978048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.022221:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789762687.022335:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148978176 00000100:00100000:2.0:1789762687.022344:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148978176 00000100:00100000:2.0:1789762687.022368:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789762687.022372:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148978176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762687.022475:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148978176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.022482:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789762687.022555:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148978304 00000100:00100000:2.0:1789762687.022559:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148978304 00000100:00100000:2.0:1789762687.022580:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789762687.022584:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148978304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762687.022666:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148978304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.022672:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789762687.022893:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8428:1876702148978432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762687.022921:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762687.022946:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1506e9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789762687.023101:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8428:1876702148978432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762687.023134:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8428:1876702148978560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762687.023160:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762687.023174:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1506e9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789762687.023336:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8428:1876702148978560:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789762687.023358:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:2.0:1789762687.023493:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148978688 00000100:00100000:2.0:1789762687.023497:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148978688 00000100:00100000:2.0:1789762687.023519:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789762687.023530:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148978688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762687.023536:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762687.023543:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f8800/0xd08452c77c56ddae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dda7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.023554:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f8800/0xd08452c77c56ddae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dda7 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.023560:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f8800/0xd08452c77c56ddae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dda7 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.023564:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f8800, rc 0) 00000100:00100000:2.0:1789762687.023588:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148978688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 60us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.023594:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789762687.023706:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148978816 00000100:00100000:2.0:1789762687.023710:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148978816 00000100:00100000:2.0:1789762687.023731:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789762687.023735:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148978816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762687.023863:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148978816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.023872:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789762687.023941:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148978944 00000100:00100000:2.0:1789762687.023946:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148978944 00000100:00100000:2.0:1789762687.023979:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789762687.023989:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148978944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762687.024086:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148978944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.024097:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789762687.024276:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8429:1876702148979072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762687.024303:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762687.024317:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1506e99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762687.024483:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8429:1876702148979072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762687.024504:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762687.024509:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762687.024510:0:8429:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789762687.024514:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789762687.024525:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8429:1876702148979200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762687.024550:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762687.024564:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1506e99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762687.024726:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8429:1876702148979200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762687.024750:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762687.024755:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762687.024756:0:8429:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789762687.024759:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:2.0:1789762687.024917:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148979328 00000100:00100000:2.0:1789762687.024922:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148979328 00000100:00100000:2.0:1789762687.024949:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789762687.024957:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148979328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762687.024965:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762687.024974:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f9c00/0xd08452c77c56ddbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56ddb5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.024990:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f9c00/0xd08452c77c56ddbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56ddb5 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.025002:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f9c00/0xd08452c77c56ddbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56ddb5 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762687.025007:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f9c00, rc 0) 00000100:00100000:2.0:1789762687.025035:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148979328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762687.025041:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789762687.025143:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148979456 00000100:00100000:2.0:1789762687.025147:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148979456 00000100:00100000:2.0:1789762687.025168:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789762687.025173:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148979456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762687.025281:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148979456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (155us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789762687.025287:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00010000:00010000:1.0:1789762688.038947:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762688.372232:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762688.373201:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762688.374201:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762688.375190:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762688.376009:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762688.376879:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762688.377566:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000020:00000080:2.0:1789762688.638594:0:8466:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe510d4bf0 20000000:00000080:2.0:1789762688.638608:0:8466:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d16fdca000 uarg=0000000000000000 20000000:01000000:2.0:1789762688.638636:0:8466:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789762688.638640:0:8466:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789762688.638644:0:8466:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789762688.639157:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:3.0:1789762688.642431:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148979712 00000100:00100000:3.0:1789762688.642440:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148979712 00010000:00010000:0.0:1789762688.642481:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d182040200/0xd08452c77c56db93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56db8c expref: 18 pid: 5805 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762688.642489:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148979840 00000100:00100000:2.0:1789762688.642495:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148979840 00000100:00100000:0.0:1789762688.642501:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876702148979968:0@lo:104: 00000100:00100000:0.0:1789762688.642523:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762688.642527:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789762688.642533:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789762688.642539:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:8466:x1876702148979712:12345-0@lo:104: 00010000:00010000:2.0:1789762688.642551:0:6669:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d140030800/0xd08452c77c56dc6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dc73 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762688.642567:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789762688.642569:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148979968 00000100:00100000:3.0:1789762688.642577:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148979968 00000100:00100000:0.0:1789762688.642580:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789762688.642592:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:8466:x1876702148979840:12345-0@lo:104: 00010000:00010000:0.0:1789762688.642601:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dc18 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.642612:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789762688.642617:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789762688.642622:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:8466:x1876702148979712:12345-0@lo:104: Request processed in 87us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762688.642624:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 4 min 2 max 56 00000100:00100000:3.0:1789762688.642631:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174119c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:8466:x1876702148979968:12345-0@lo:104: 00000100:00100000:1.0:1789762688.642637:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_004' 00000100:00100000:2.0:1789762688.642637:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789762688.642643:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789762688.642644:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d141525c00/0xd08452c77c56db8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56db93 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762688.642651:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:8466:x1876702148979840:12345-0@lo:104: Request processed in 61us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762688.642661:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1789762688.642666:0:6671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789762688.642672:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d140030800/0xd08452c77c56dc6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dc73 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.642679:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030800 already unused, calling callback (ffffffffc1a96c20) 10000000:00010000:2.0:1789762688.642683:0:6671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d140030800/0xd08452c77c56dc6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56dc73 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.642690:0:6671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d140030800/0xd08452c77c56dc6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56dc73 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762688.642696:0:6671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d140030800/0xd08452c77c56dc6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56dc73 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762688.642701:0:6671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789762688.642718:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789762688.642721:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876702148979712:0@lo:104: 00000100:00100000:3.0:1789762688.642728:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174119c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:8466:x1876702148979968:12345-0@lo:104: Request processed in 101us (201us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762688.642733:0:6671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d140030800/0xd08452c77c56dc6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dc73 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762688.642737:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789762688.642755:0:6671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789762688.642762:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876702148979840:0@lo:104: 00000100:00100000:0.0:1789762688.642780:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876702148979968:0@lo:104: 00010000:00010000:2.0:1789762688.642784:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d140030800/0xd08452c77c56dc6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dc73 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.642795:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d140030800/0xd08452c77c56dc6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dc73 expref: -99 pid: 7590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.642797:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789762688.642807:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dc18 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.642814:0:6671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762688.642821:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d141525c00/0xd08452c77c56db8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56db93 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.642821:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524e00 already unused, calling callback (ffffffffc1a96c20) 00000100:00100000:0.0:1789762688.642824:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148980096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789762688.642858:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525c00 already unused, calling callback (ffffffffc1a96c20) 00010000:00010000:1.0:1789762688.642861:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789762688.642864:0:6671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d141525c00/0xd08452c77c56db8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56db93 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789762688.642864:0:6670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56dc18 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.642876:0:6671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d141525c00/0xd08452c77c56db8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56db93 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762688.642885:0:6671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d141525c00/0xd08452c77c56db8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56db93 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762688.642894:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789762688.642897:0:6671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789762688.642922:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148980096 00010000:00010000:2.0:1789762688.642925:0:6671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d141525c00/0xd08452c77c56db8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56db93 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762688.642928:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148980096 00010000:00010000:2.0:1789762688.642936:0:6671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789762688.642955:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d1588cd400/0xd08452c77c56dc73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dc6c expref: 19 pid: 5807 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.642959:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d141525c00/0xd08452c77c56db8c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56db93 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762688.642972:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148980224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789762688.642980:0:6670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56dc18 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762688.642985:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789762688.642986:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d141525c00/0xd08452c77c56db8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56db93 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762688.642996:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702148980096:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789762688.643009:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789762688.643014:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:3.0:1789762688.643020:0:6670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56dc18 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762688.643024:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d1588cd400/0xd08452c77c56dc73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dc6c expref: 19 pid: 5807 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.643027:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789762688.643031:0:6670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789762688.643032:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762688.643036:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762688.643042:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d1588cd400/0xd08452c77c56dc73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56dc6c expref: 19 pid: 5807 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762688.643058:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1588cd400/0xd08452c77c56dc73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56dc6c expref: 19 pid: 5807 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762688.643060:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148980224 00010000:00010000:3.0:1789762688.643064:0:6670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dc18 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762688.643066:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148980224 00010000:00010000:1.0:1789762688.643072:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762688.643073:0:6670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789762688.643086:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d182040200/0xd08452c77c56db93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56db8c expref: 19 pid: 5805 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.643093:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dc18 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762688.643101:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702148980352:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789762688.643101:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d141524e00/0xd08452c77c56dc11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dc18 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762688.643118:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789762688.643119:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702148980096:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (227us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762688.643124:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762688.643129:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762688.643131:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789762688.643133:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702148980224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789762688.643136:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762688.643138:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789762688.643148:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789762688.643153:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148980352 00010000:00010000:2.0:1789762688.643153:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d182040200/0xd08452c77c56db93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56db8c expref: 18 pid: 5805 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.643163:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d182040200/0xd08452c77c56db93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56db8c expref: 18 pid: 5805 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762688.643166:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148980352 00010000:00010000:2.0:1789762688.643177:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d182040200/0xd08452c77c56db93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56db8c expref: 19 pid: 5805 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762688.643183:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d140031800/0xd08452c77c56dc18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dc11 expref: 19 pid: 5808 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.643192:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762688.643202:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148980096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789762688.643210:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789762688.643219:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:3277:x1876702148980352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789762688.643225:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762688.643229:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d140031800/0xd08452c77c56dc18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dc11 expref: 18 pid: 5808 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762688.643231:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:3276:x1876702148980224:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762688.643239:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148980224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789762688.643257:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789762688.643266:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d140031800/0xd08452c77c56dc18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56dc11 expref: 18 pid: 5808 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762688.643278:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d140031800/0xd08452c77c56dc18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56dc11 expref: 17 pid: 5808 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762688.643286:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762688.643320:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:3277:x1876702148980352:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762688.643325:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789762688.643348:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702148980352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789762688.643382:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522ffb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876702148979584:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789762688.643411:0:8466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d1747fe000/0xd08452c77c56ddd1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762688.643514:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762688.643582:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140568704 00000100:00100000:3.0:1789762688.643586:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140568704 00010000:00010000:3.0:1789762688.643600:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d140030200/0xd08452c77c56dcc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3ac expref: 10 pid: 5808 timeout: 193 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762688.643621:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1789762688.643626:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:2344:x1876702140568704:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762688.643640:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762688.643644:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d140030200/0xd08452c77c56dcc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3ac expref: 10 pid: 5808 timeout: 193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.643651:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d140030200/0xd08452c77c56dcc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3ac expref: 10 pid: 5808 timeout: 193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.643660:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d140030200/0xd08452c77c56dcc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3ac expref: 10 pid: 5808 timeout: 193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.643673:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d1747fe000/0xd08452c77c56ddd1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.643682:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1747fe000/0xd08452c77c56ddd1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.643695:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d1747fe000/0xd08452c77c56ddd1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.643704:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d1747fe000/0xd08452c77c56ddd1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.643712:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d1747fe000/0xd08452c77c56ddd1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.643717:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d1747fe000/0xd08452c77c56ddd1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.643721:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fe000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762688.643724:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d1747fe000/0xd08452c77c56ddd1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.643738:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d1747fe000/0xd08452c77c56ddd1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.643751:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d1747fe000/0xd08452c77c56ddd1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.643758:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762688.643770:0:8466:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d1747fe000/0xd08452c77c56ddd1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762688.643777:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d1747fe000/0xd08452c77c56ddd1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762688.643782:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1747fe000/0xd08452c77c56ddd1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762688.643786:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+9:2344:x1876702140568704:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 158us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762688.643797:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 10000000:01000000:0.0:1789762688.822888:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789762688.822894:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d17fb80000 from 4 10000000:01000000:0.0:1789762688.822897:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789762688.822935:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762688.822945:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762688.822954:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762688.822973:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148980480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789762688.823034:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762688.823079:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789762688.823097:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148980480 00000100:00100000:2.0:1789762688.823105:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148980480 00000100:00100000:2.0:1789762688.823160:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789762688.823168:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148980480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762688.823189:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762688.823201:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f8c00/0xd08452c77c56dddf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56ddd8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.823220:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f8c00/0xd08452c77c56dddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56ddd8 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.823228:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f8c00/0xd08452c77c56dddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56ddd8 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.823235:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f8c00, rc 0) 00000100:00100000:2.0:1789762688.823288:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148980480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762688.823294:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789762688.823326:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148980480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789762688.823338:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dddf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762688.823356:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56dddf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762688.823397:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148980608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762688.823418:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762688.823434:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789762688.823456:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148980608 00000100:00100000:2.0:1789762688.823460:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148980608 00000100:00100000:2.0:1789762688.823481:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789762688.823486:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148980608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762688.823677:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148980608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762688.823683:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789762688.823713:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148980608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762688.823735:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148980736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789762688.823767:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762688.823781:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789762688.823808:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148980736 00000100:00100000:2.0:1789762688.823812:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148980736 00000100:00100000:2.0:1789762688.823851:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789762688.823858:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148980736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762688.823975:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148980736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762688.823993:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789762688.824013:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148980736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762688.824311:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8487:1876702148980864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762688.824339:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762688.824359:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1602c8900 going to sleep for 11 seconds 00000100:00100000:0.0:1789762688.824383:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148980864 00000100:00100000:0.0:1789762688.824387:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148980864 00000100:00100000:0.0:1789762688.824412:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789762688.824417:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:8487:x1876702148980864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789762688.824526:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:8487:x1876702148980864:12345-0@lo:502:llog_process_th.0 Request processed in 108us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762688.824532:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789762688.824553:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8487:1876702148980864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762688.824577:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762688.824585:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762688.824586:0:8487:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789762688.824592:0:8487:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d17fb80000 00000020:00000080:2.0:1789762688.824594:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789762688.824643:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8487:1876702148980992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762688.824669:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762688.824683:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d1602c8900 going to sleep for 11 seconds 00000100:00100000:0.0:1789762688.824708:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148980992 00000100:00100000:0.0:1789762688.824713:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148980992 00000100:00100000:0.0:1789762688.824736:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789762688.824742:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:8487:x1876702148980992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762688.824860:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8487:1876702148980992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789762688.824865:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:8487:x1876702148980992:12345-0@lo:502:llog_process_th.0 Request processed in 121us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762688.824880:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000020:01000000:2.0:1789762688.824884:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762688.824889:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762688.824890:0:8487:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789762688.824895:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789762688.824947:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789762688.824968:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789762688.824974:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dddf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762688.824981:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dddf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762688.824988:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789762688.824990:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d15277f800 from 4 10000000:01000000:0.0:1789762688.824992:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789762688.825007:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762688.825013:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762688.825018:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762688.825028:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148981120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789762688.825058:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762688.825087:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148981120 00000100:00100000:0.0:1789762688.825090:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd4840 going to sleep for 11 seconds 00000100:00100000:2.0:1789762688.825092:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148981120 00000100:00100000:2.0:1789762688.825124:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789762688.825131:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148981120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762688.825138:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762688.825145:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f9200/0xd08452c77c56dded lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56dde6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.825158:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f9200/0xd08452c77c56dded lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56dde6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.825173:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f9200/0xd08452c77c56dded lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dde6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.825181:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f9200, rc 0) 00000100:00100000:2.0:1789762688.825222:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148981120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762688.825231:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789762688.825264:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148981120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789762688.825276:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dded expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762688.825283:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56dded expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762688.825328:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148981248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762688.825353:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762688.825367:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd4840 going to sleep for 11 seconds 00000100:00100000:2.0:1789762688.825378:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148981248 00000100:00100000:2.0:1789762688.825382:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148981248 00000100:00100000:2.0:1789762688.825409:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789762688.825416:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148981248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762688.825550:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148981248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762688.825556:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789762688.825581:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148981248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762688.825611:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148981376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789762688.825646:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762688.825661:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd4840 going to sleep for 11 seconds 00000100:00100000:2.0:1789762688.825665:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148981376 00000100:00100000:2.0:1789762688.825669:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148981376 00000100:00100000:2.0:1789762688.825696:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789762688.825702:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148981376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762688.825830:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148981376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762688.825862:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148981376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762688.825864:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789762688.826090:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8489:1876702148981504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762688.826124:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762688.826153:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150fe8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789762688.826164:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148981504 00000100:00100000:3.0:1789762688.826170:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148981504 00000100:00100000:3.0:1789762688.826199:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789762688.826206:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:8489:x1876702148981504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762688.826348:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:8489:x1876702148981504:12345-0@lo:502:llog_process_th.0 Request processed in 141us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762688.826355:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789762688.826369:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8489:1876702148981504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762688.826398:0:8489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762688.826403:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762688.826404:0:8489:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789762688.826408:0:8489:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d15277f800 00000020:00000080:2.0:1789762688.826410:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789762688.826448:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8489:1876702148981632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762688.826478:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762688.826494:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150fe8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789762688.826515:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148981632 00000100:00100000:3.0:1789762688.826519:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148981632 00000100:00100000:3.0:1789762688.826544:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789762688.826551:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:8489:x1876702148981632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762688.826684:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:8489:x1876702148981632:12345-0@lo:502:llog_process_th.0 Request processed in 131us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762688.826687:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8489:1876702148981632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762688.826700:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000020:01000000:2.0:1789762688.826710:0:8489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762688.826715:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762688.826716:0:8489:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789762688.826720:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789762688.826769:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789762688.826784:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789762688.826789:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dded expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.826803:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56dded expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762688.826811:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789762688.826812:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d1549a0000 from 4 10000000:01000000:3.0:1789762688.826820:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789762688.826854:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.826860:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.826867:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762688.826879:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148981760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789762688.826909:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762688.826931:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148981760 00000100:00100000:3.0:1789762688.826935:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a79480 going to sleep for 11 seconds 00000100:00100000:2.0:1789762688.826936:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148981760 00000100:00100000:2.0:1789762688.826964:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789762688.826971:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148981760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762688.826979:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762688.826987:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1821f9600/0xd08452c77c56ddfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56ddf4 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.827002:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1821f9600/0xd08452c77c56ddfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56ddf4 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.827013:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1821f9600/0xd08452c77c56ddfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56ddf4 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.827021:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f9600, rc 0) 00000100:00100000:2.0:1789762688.827070:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148981760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762688.827084:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789762688.827090:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148981760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762688.827105:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56ddfb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762688.827112:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56ddfb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762688.827150:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148981888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762688.827172:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762688.827200:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a79480 going to sleep for 11 seconds 00000100:00100000:2.0:1789762688.827201:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148981888 00000100:00100000:2.0:1789762688.827206:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148981888 00000100:00100000:2.0:1789762688.827231:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789762688.827238:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148981888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762688.827369:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148981888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762688.827374:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789762688.827394:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148981888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762688.827419:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148982016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762688.827450:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762688.827466:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a79480 going to sleep for 11 seconds 00000100:00100000:2.0:1789762688.827470:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148982016 00000100:00100000:2.0:1789762688.827474:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148982016 00000100:00100000:2.0:1789762688.827501:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789762688.827509:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148982016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762688.827610:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148982016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762688.827617:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789762688.827624:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148982016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762688.827862:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8490:1876702148982144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762688.827896:0:8490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762688.827918:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148982144 00000100:00100000:3.0:1789762688.827921:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a79300 going to sleep for 11 seconds 00000100:00100000:2.0:1789762688.827923:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148982144 00000100:00100000:2.0:1789762688.827953:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789762688.827961:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:8490:x1876702148982144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762688.828117:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:8490:x1876702148982144:12345-0@lo:502:llog_process_th.0 Request processed in 157us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762688.828124:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789762688.828139:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8490:1876702148982144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789762688.828162:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789762688.828168:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762688.828169:0:8490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789762688.828174:0:8490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d1549a0000 00000020:00000080:3.0:1789762688.828177:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789762688.828222:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8490:1876702148982272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762688.828273:0:8490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762688.828291:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a79300 going to sleep for 11 seconds 00000100:00100000:0.0:1789762688.828302:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148982272 00000100:00100000:0.0:1789762688.828308:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148982272 00000100:00100000:0.0:1789762688.828344:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789762688.828353:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:8490:x1876702148982272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789762688.828468:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:8490:x1876702148982272:12345-0@lo:502:llog_process_th.0 Request processed in 117us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762688.828475:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789762688.828482:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:8490:1876702148982272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789762688.828504:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789762688.828508:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762688.828509:0:8490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789762688.828512:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789762688.828555:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789762688.828578:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789762688.828583:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56ddfb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762688.828598:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56ddfb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762689.062923:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762689.652082:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762689.652122:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140568832 00000100:00100000:3.0:1789762689.652132:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140568832 00000100:00100000:3.0:1789762689.652184:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:3.0:1789762689.652203:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+9:5574:x1876702140568832:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762689.652218:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762689.652232:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1583a9800/0xd08452c77c56de02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e3eb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762689.652270:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1583a9800/0xd08452c77c56de02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3eb expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762689.652283:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1583a9800/0xd08452c77c56de02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3eb expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762689.652292:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9800, rc 0) 00000100:00100000:3.0:1789762689.652351:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:5574:x1876702140568832:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 152us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762689.652357:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:3.0:1789762689.653005:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762689.653043:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140568960 00000100:00100000:0.0:1789762689.653049:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140568960 00000100:00100000:0.0:1789762689.653079:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:0.0:1789762689.653088:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:5574:x1876702140568960:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762689.653329:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:5574:x1876702140568960:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 241us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762689.653338:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:2.0:1789762689.653829:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762689.653876:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140569088 00000100:00100000:0.0:1789762689.653887:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140569088 00000100:00100000:0.0:1789762689.653913:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:0.0:1789762689.653921:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:5574:x1876702140569088:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789762689.654051:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:5574:x1876702140569088:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 131us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762689.654058:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:2.0:1789762689.654883:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762689.654922:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140569216 00000100:00100000:1.0:1789762689.654927:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140569216 00000100:00100000:1.0:1789762689.654955:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:1.0:1789762689.654962:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:6255:x1876702140569216:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789762689.655080:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:6255:x1876702140569216:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 118us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762689.655087:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:2.0:1789762689.655709:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762689.655748:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140569344 00000100:00100000:0.0:1789762689.655754:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140569344 00000100:00100000:0.0:1789762689.655779:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:0.0:1789762689.655785:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:6255:x1876702140569344:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789762689.656001:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:6255:x1876702140569344:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 214us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762689.656010:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 180 00010000:00010000:1.0:1789762690.086922:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789762690.395061:0:8764:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1789762690.421544:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762690.421572:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762690.421601:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140569472 00000100:00100000:1.0:1789762690.421612:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140569472 00000100:00100000:2.0:1789762690.421626:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762690.421634:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140569728 00000100:00100000:0.0:1789762690.421657:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140569728 00000100:00100000:2.0:1789762690.421682:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762690.421686:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:1.0:1789762690.421697:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:2342:x1876702140569472:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762690.421705:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140569856 00000100:00100000:0.0:1789762690.421709:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140569856 00000100:00100000:2.0:1789762690.421710:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140569600 00000100:00100000:2.0:1789762690.421717:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140569600 00000100:00100000:0.0:1789762690.421729:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1789762690.421739:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140569728:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762690.421769:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1789762690.421770:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:2342:x1876702140569472:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 70us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762690.421776:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140569728:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 39us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762690.421784:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140569600:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762690.421790:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:1.0:1789762690.421802:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:0.0:1789762690.421815:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1789762690.421824:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140569856:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762690.421831:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140569600:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 51us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762690.421839:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1789762690.421875:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140569856:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 52us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762690.421887:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00080000:0.0:1789762690.421909:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762690.421914:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789762690.421917:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762690.727021:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702148982528:0@lo:400:kworker.0 00000100:00100000:2.0:1789762690.727054:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148982400:0@lo:400:kworker.0 00000100:00100000:2.0:1789762690.727102:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762690.727102:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762690.727154:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173cead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148983040:0@lo:400:kworker.0 00000100:00100000:2.0:1789762690.727155:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702148982912:0@lo:400:kworker.0 00000100:00100000:2.0:1789762690.727185:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762690.727185:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762690.727250:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702148982656:0@lo:400:kworker.0 00000100:00100000:3.0:1789762690.727284:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762690.727291:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148982400 00000100:00100000:2.0:1789762690.727298:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148982400 00000100:00100000:3.0:1789762690.727312:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148983168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762690.727339:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762690.727345:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789762690.727362:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789762690.727365:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702148982400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762690.727369:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148982784:0@lo:400:kworker.0 00000100:00100000:3.0:1789762690.727408:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762690.727423:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702148982400:12345-0@lo:400:kworker.0 Request processed in 61us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762690.727432:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789762690.727475:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148982528 00000100:00100000:2.0:1789762690.727480:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148982528 00000100:00100000:1.0:1789762690.727501:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148982912 00000100:00100000:1.0:1789762690.727508:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148982912 00000100:00100000:2.0:1789762690.727516:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148982656 00000100:00100000:3.0:1789762690.727516:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148983168 00000100:00100000:2.0:1789762690.727522:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148982656 00000100:00080000:0.0:1789762690.727538:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762690.727577:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789762690.727586:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789762690.727591:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702148982528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762690.727598:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789762690.727600:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702148982912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762690.727615:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702148982656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762690.727623:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148983168 00000100:00100000:1.0:1789762690.727647:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702148982528:12345-0@lo:400:kworker.0 Request processed in 60us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762690.727655:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789762690.727662:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702148982912:12345-0@lo:400:kworker.0 Request processed in 65us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762690.727670:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789762690.727681:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702148982656:12345-0@lo:400:kworker.0 Request processed in 68us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762690.727685:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148983040 00000100:00100000:2.0:1789762690.727691:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789762690.727692:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148983040 00000100:00100000:3.0:1789762690.727725:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789762690.727739:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148982784 00000100:00100000:3.0:1789762690.727739:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702148983168:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762690.727746:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148982784 00000100:00100000:2.0:1789762690.727761:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148982400:0@lo:400:kworker.0 00002000:00000024:3.0:1789762690.727775:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762690.727782:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789762690.727786:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702148982912:0@lo:400:kworker.0 00000100:00100000:0.0:1789762690.727796:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789762690.727797:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702148983040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762690.727807:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789762690.727817:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702148983168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762690.727825:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789762690.727866:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702148982656:0@lo:400:kworker.0 00000100:00100000:1.0:1789762690.727878:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702148983040:12345-0@lo:400:kworker.0 Request processed in 86us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762690.727886:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789762690.727890:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1463cdc00 x1876702148983168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762690.727903:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789762690.727904:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789762690.727911:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789762690.727916:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148982784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762690.727925:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148983168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762690.727957:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148982784:12345-0@lo:400:kworker.0 Request processed in 42us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762690.727963:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1789762690.728034:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762690.728038:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789762690.728075:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d173cea300 x1876702148982784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789762690.728088:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148982784:0@lo:400:kworker.0 00000100:00100000:3.0:1789762690.728150:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702148982528:0@lo:400:kworker.0 00010000:00080000:3.0:1789762690.728163:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d173cead80 x1876702148983040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789762690.728172:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173cead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148983040:0@lo:400:kworker.0 00010000:00010000:2.0:1789762691.110979:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762691.239026:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148983296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762691.239098:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762691.239135:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148983296 00000100:00100000:3.0:1789762691.239143:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148983296 00000100:00100000:3.0:1789762691.239187:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789762691.239196:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148983296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762691.239239:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762691.239285:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148983296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762691.239292:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789762691.239319:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1463cdc00 x1876702148983296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762691.239337:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148983296:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789762691.747399:0:9012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing yml_node 00010000:00010000:3.0:1789762692.134935:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789762693.068536:0:9203:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.106 00010000:00010000:1.0:1789762693.158910:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789762693.854822:0:9300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.106 00010000:00010000:1.0:1789762694.182959:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789762694.628955:0:9397:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.106 00000001:02000400:2.0:1789762695.126185:0:9445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanityn ============----- Fri Sep 18 16:18:14 EDT 2026 00010000:00010000:2.0:1789762695.206943:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762695.540356:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762695.540401:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762695.540429:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140569984 00000100:00100000:2.0:1789762695.540437:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762695.540438:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140570112 00000100:00100000:3.0:1789762695.540439:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140569984 00000100:00100000:1.0:1789762695.540446:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140570112 00000100:00100000:2.0:1789762695.540476:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762695.540492:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:1.0:1789762695.540505:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:3.0:1789762695.540507:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:2345:x1876702140569984:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762695.540516:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140570368 00000100:00100000:1.0:1789762695.540519:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140570112:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762695.540523:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140570368 00000100:00100000:2.0:1789762695.540567:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140570240 00000100:00100000:3.0:1789762695.540572:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:2345:x1876702140569984:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 69us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762695.540573:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140570112:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 56us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762695.540574:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140570240 00000100:00100000:1.0:1789762695.540591:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:3.0:1789762695.540593:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:2.0:1789762695.540609:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1789762695.540621:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140570368:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762695.540629:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1789762695.540638:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140570240:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762695.540662:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140570368:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 42us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762695.540675:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1789762695.540676:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140570240:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 36us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762695.540684:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00080000:1.0:1789762695.540708:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789762695.540712:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762695.540714:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762695.847946:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148983424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762695.848006:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762695.848084:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148983424 00000100:00100000:2.0:1789762695.848090:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148983424 00000100:00100000:2.0:1789762695.848140:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789762695.848149:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148983424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789762695.848177:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762695.848232:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148983424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762695.848239:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789762695.848285:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762695.848300:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148983552:0@lo:400:kworker.0 00000100:00100000:3.0:1789762695.848325:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702148983680:0@lo:400:kworker.0 00000100:00100000:2.0:1789762695.848330:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762695.848369:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762695.848373:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702148984064:0@lo:400:kworker.0 00000100:00100000:0.0:1789762695.848379:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702148983808:0@lo:400:kworker.0 00000100:00100000:2.0:1789762695.848411:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762695.848434:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762695.848437:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789762695.848443:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148983936:0@lo:400:kworker.0 00000100:00100000:2.0:1789762695.848467:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762695.848483:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148983680 00000100:00100000:0.0:1789762695.848489:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148983680 00000100:00100000:2.0:1789762695.848499:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148983552 00000100:00100000:2.0:1789762695.848504:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148983552 00000100:00100000:0.0:1789762695.848524:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148984064 00000100:00100000:0.0:1789762695.848529:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148984064 00000100:00100000:2.0:1789762695.848533:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789762695.848541:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702148983552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762695.848572:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148983808 00000100:00100000:2.0:1789762695.848575:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702148983552:12345-0@lo:400:kworker.0 Request processed in 36us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762695.848578:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148983808 00000100:00100000:2.0:1789762695.848584:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789762695.848608:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789762695.848615:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789762695.848621:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702148983680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762695.848628:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702148984064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762695.848667:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702148984064:12345-0@lo:400:kworker.0 Request processed in 44us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762695.848672:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789762695.848683:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702148983680:12345-0@lo:400:kworker.0 Request processed in 66us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762695.848688:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789762695.848698:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702148983808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762695.848699:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789762695.848732:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702148983808:12345-0@lo:400:kworker.0 Request processed in 36us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762695.848738:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789762695.848757:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702148983680:0@lo:400:kworker.0 00000100:00100000:2.0:1789762695.848758:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148983936 00000100:00100000:2.0:1789762695.848763:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148983936 00000100:00100000:2.0:1789762695.848787:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789762695.848793:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148983936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762695.848815:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148983936:12345-0@lo:400:kworker.0 Request processed in 23us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762695.848829:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789762695.848898:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1742ebb80 x1876702148983424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762695.848918:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148983424:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789762695.849089:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762695.849093:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762695.849113:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702148983808:0@lo:400:kworker.0 00010000:00080000:2.0:1789762695.849559:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1522ffb80 x1876702148983936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762695.849568:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148983936:0@lo:400:kworker.0 00000100:00100000:2.0:1789762695.849581:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702148984064:0@lo:400:kworker.0 00000100:00100000:2.0:1789762695.849588:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148983552:0@lo:400:kworker.0 00010000:00010000:3.0:1789762696.230958:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762696.358972:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148984192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762696.359032:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762696.359082:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148984192 00000100:00100000:3.0:1789762696.359090:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148984192 00000100:00100000:3.0:1789762696.359138:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789762696.359148:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148984192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762696.359180:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762696.359240:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148984192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762696.359247:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789762696.359280:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1463cf800 x1876702148984192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762696.359299:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148984192:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762697.254932:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762698.279967:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762699.303046:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789762700.067312:0:10172:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 40a 00010000:00010000:3.0:1789762700.326957:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789762700.489612:0:10221:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 33a 00000100:00100000:0.0:1789762700.662512:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762700.662574:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140570624 00000100:00100000:2.0:1789762700.662584:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140570624 00000100:00100000:0.0:1789762700.662589:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00080000:1.0:1789762700.662647:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762700.662659:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:2.0:1789762700.662675:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140570624:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762700.662721:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140570496 00000100:00100000:3.0:1789762700.662727:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140570496 00000100:00100000:2.0:1789762700.662757:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140570624:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762700.662764:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:2.0:1789762700.662775:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:3.0:1789762700.662777:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:2344:x1876702140570496:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762700.662816:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:2344:x1876702140570496:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762700.662821:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:3.0:1789762700.663152:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762700.663205:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140570752 00000100:00100000:1.0:1789762700.663211:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140570752 00000100:00100000:1.0:1789762700.663257:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00080000:0.0:1789762700.663260:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762700.663269:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2341:x1876702140570752:12345-192.168.203.31@tcp:9:kworker.0 00000100:00100000:3.0:1789762700.663277:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000020:00000080:1.0:1789762700.663302:0:6654:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd08452c77c56dcce 00000100:00100000:2.0:1789762700.663304:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140570880 00000100:00100000:2.0:1789762700.663311:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140570880 00000100:00080000:1.0:1789762700.663315:0:6654:0:(import.c:65:import_set_state_nolock()) ffff95d0418ce800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1789762700.663341:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:1.0:1789762700.663346:0:6654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1789762700.663354:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762700.663356:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1789762700.663369:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2341:x1876702140570880:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:2.0:1789762700.663393:0:8803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd08452c77c56dcd5 00000100:00080000:2.0:1789762700.663402:0:8803:0:(import.c:65:import_set_state_nolock()) ffff95d0418cd000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789762700.663437:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789762700.663443:0:8803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789762700.663713:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+2:2341:x1876702140570752:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 440us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762700.663721:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1789762700.663869:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+2:2341:x1876702140570880:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 501us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762700.663876:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000001:02000400:1.0:1789762700.917187:0:10269:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanityn: start setup 16:18:20 (1789762700) === 00000100:00100000:0.0:1789762700.966956:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789762700.966973:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702148984704:0@lo:400:kworker.0 00000100:00100000:2.0:1789762700.966973:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702148984576:0@lo:400:kworker.0 00000100:00100000:3.0:1789762700.966999:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148984832:0@lo:400:kworker.0 00000100:00100000:0.0:1789762700.967047:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762700.967055:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762700.967088:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148984448:0@lo:400:kworker.0 00000100:00100000:0.0:1789762700.967126:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148984320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762700.967134:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762700.967149:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148984832 00000100:00100000:3.0:1789762700.967168:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148984832 00000100:00100000:0.0:1789762700.967177:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762700.967186:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702148984960:0@lo:400:kworker.0 00000100:00100000:2.0:1789762700.967216:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762700.967226:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789762700.967231:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148984704 00000100:00100000:0.0:1789762700.967238:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148984704 00000100:00100000:3.0:1789762700.967239:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148984832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762700.967246:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789762700.967257:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148984448 00000100:00100000:2.0:1789762700.967259:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148985088:0@lo:400:kworker.0 00000100:00100000:1.0:1789762700.967264:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148984448 00000100:00100000:0.0:1789762700.967283:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148984960 00000100:00100000:0.0:1789762700.967289:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148984960 00000100:00100000:3.0:1789762700.967294:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148984832:12345-0@lo:400:kworker.0 Request processed in 59us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762700.967301:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789762700.967311:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762700.967325:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148985088 00000100:00100000:0.0:1789762700.967330:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789762700.967331:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148985088 00000100:00100000:0.0:1789762700.967347:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702148984704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762700.967360:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789762700.967374:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702148984960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762700.967376:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789762700.967377:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789762700.967397:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148985088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762700.967398:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702148984448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762700.967400:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702148984704:12345-0@lo:400:kworker.0 Request processed in 59us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762700.967414:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789762700.967419:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702148984960:12345-0@lo:400:kworker.0 Request processed in 51us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762700.967426:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789762700.967445:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148984320 00000100:00100000:3.0:1789762700.967450:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148985088:12345-0@lo:400:kworker.0 Request processed in 60us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762700.967452:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148984320 00000100:00100000:1.0:1789762700.967458:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702148984448:12345-0@lo:400:kworker.0 Request processed in 69us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762700.967459:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789762700.967471:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1462c1880 x1876702148985088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762700.967476:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:3.0:1789762700.967480:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762700.967487:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762700.967491:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762700.967492:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789762700.967495:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148985088:0@lo:400:kworker.0 00000100:00100000:0.0:1789762700.967505:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148984320:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762700.967511:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148984448:0@lo:400:kworker.0 00000100:00100000:1.0:1789762700.967527:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789762700.967528:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1462c3800 x1876702148984832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1789762700.967531:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762700.967534:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702148984960:0@lo:400:kworker.0 00000100:00100000:3.0:1789762700.967557:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148984832:0@lo:400:kworker.0 00000100:00100000:1.0:1789762700.967577:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148984576 00000100:00100000:0.0:1789762700.967583:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148984320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762700.967585:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148984576 00000100:00100000:0.0:1789762700.967594:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789762700.967625:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789762700.967629:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702148984704:0@lo:400:kworker.0 00000100:00100000:1.0:1789762700.967636:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702148984576:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789762700.967661:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1742ebb80 x1876702148984320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762700.967676:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702148984576:12345-0@lo:400:kworker.0 Request processed in 42us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762700.967680:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148984320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762700.967685:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789762700.967697:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702148984576:0@lo:400:kworker.0 00000001:00100000:1.0:1789762700.974587:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:1.0:1789762700.974592:0:7606:0:(genops.c:885:class_export_put()) final put ffff95d0418ce000/77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:3.0:1789762700.974661:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d0418ce000/77777931-b235-4c03-82d2-4b1d12553008 for lustre-OST0001 00000020:00000080:3.0:1789762700.974695:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d0418cd000 for lustre-OST0001 00000100:00100000:3.0:1789762701.037208:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762701.037278:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140571008 00000100:00100000:2.0:1789762701.037288:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140571008 00000100:00100000:2.0:1789762701.037335:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:2.0:1789762701.037344:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+10:8447:x1876702140571008:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789762701.037358:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762701.037385:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d148e50a00/0xd08452c77c56de09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e3f2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762701.037410:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d148e50a00/0xd08452c77c56de09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3f2 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762701.037419:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d148e50a00/0xd08452c77c56de09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3f2 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762701.037426:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50a00, rc 0) 00000100:00100000:2.0:1789762701.037474:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+11:8447:x1876702140571008:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 130us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762701.037481:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:0.0:1789762701.038241:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762701.038283:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140571136 00000100:00100000:1.0:1789762701.038289:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140571136 00000100:00100000:1.0:1789762701.038319:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:1.0:1789762701.038325:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+11:8447:x1876702140571136:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789762701.038522:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+11:8447:x1876702140571136:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 197us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762701.038528:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:0.0:1789762701.039219:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762701.039262:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140571264 00000100:00100000:2.0:1789762701.039267:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140571264 00000100:00100000:2.0:1789762701.039291:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:2.0:1789762701.039297:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+11:8447:x1876702140571264:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789762701.039419:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+11:8447:x1876702140571264:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 120us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762701.039428:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:3.0:1789762701.040298:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762701.040343:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140571392 00000100:00100000:1.0:1789762701.040348:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140571392 00000100:00100000:1.0:1789762701.040377:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:1.0:1789762701.040383:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+11:8451:x1876702140571392:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789762701.040512:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+11:8451:x1876702140571392:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 128us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762701.040518:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:0.0:1789762701.046480:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762701.046535:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140571520 00000100:00100000:2.0:1789762701.046541:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140571520 00000100:00100000:2.0:1789762701.046570:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:2.0:1789762701.046577:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+11:8451:x1876702140571520:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789762701.046727:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+11:8451:x1876702140571520:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 148us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762701.046735:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:0.0:1789762701.047653:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762701.047695:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140571648 00000100:00100000:1.0:1789762701.047701:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140571648 00000100:00100000:1.0:1789762701.047736:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:1.0:1789762701.047746:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+11:8447:x1876702140571648:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789762701.047757:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762701.047772:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1588cd400/0xd08452c77c56de10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e41c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762701.047789:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1588cd400/0xd08452c77c56de10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e41c expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762701.047797:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1588cd400/0xd08452c77c56de10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e41c expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762701.047803:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cd400, rc 0) 00000100:00100000:1.0:1789762701.047853:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+12:8447:x1876702140571648:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 90us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762701.047859:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:3.0:1789762701.049129:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762701.049198:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140571776 00000100:00100000:2.0:1789762701.049203:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140571776 00000100:00100000:2.0:1789762701.049231:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:2.0:1789762701.049237:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+12:8447:x1876702140571776:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789762701.049250:0:5805:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789762701.049266:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789762701.049269:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789762701.049271:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789762701.049273:0:5805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789762701.049939:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+12:8447:x1876702140571776:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 701us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762701.049945:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:0.0:1789762701.051790:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762701.051872:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140571904 00000100:00100000:1.0:1789762701.051878:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140571904 00000100:00100000:1.0:1789762701.051908:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:1.0:1789762701.051914:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+12:8447:x1876702140571904:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789762701.051922:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762701.051931:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1588cd000/0xd08452c77c56de17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e423 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762701.051945:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1588cd000/0xd08452c77c56de17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e423 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762701.051963:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1588cd000/0xd08452c77c56de17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e423 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762701.051968:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cd000, rc 0) 00000100:00100000:1.0:1789762701.051995:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:8447:x1876702140571904:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762701.052000:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:3.0:1789762701.052559:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762701.052597:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140572032 00000100:00100000:2.0:1789762701.052602:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140572032 00000100:00100000:2.0:1789762701.052629:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:2.0:1789762701.052635:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:8447:x1876702140572032:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789762701.052820:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:8447:x1876702140572032:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 184us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762701.052826:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:0.0:1789762701.053395:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762701.053430:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140572160 00000100:00100000:1.0:1789762701.053435:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140572160 00000100:00100000:1.0:1789762701.053459:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:1.0:1789762701.053463:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:8447:x1876702140572160:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789762701.053585:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:8447:x1876702140572160:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 120us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762701.053590:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:0.0:1789762701.054365:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762701.054416:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140572288 00000100:00100000:2.0:1789762701.054421:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140572288 00000100:00100000:2.0:1789762701.054449:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:2.0:1789762701.054455:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:8454:x1876702140572288:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789762701.054596:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:8454:x1876702140572288:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 140us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762701.054605:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:3.0:1789762701.055119:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762701.055200:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140572416 00000100:00100000:1.0:1789762701.055205:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140572416 00000100:00100000:1.0:1789762701.055233:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:1.0:1789762701.055238:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:8454:x1876702140572416:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789762701.055333:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:8454:x1876702140572416:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 94us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762701.055338:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:0.0:1789762701.056714:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762701.056758:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140572544 00000100:00100000:2.0:1789762701.056763:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140572544 00000100:00100000:2.0:1789762701.056789:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1789762701.056795:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2341:x1876702140572544:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789762701.056813:0:5814:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9ed6d081-3f08-4f7b-834f-c9f807e3a9cb@192.168.203.31@tcp t0 exp 0000000000000000 cur 105 last 0 00000020:00000080:2.0:1789762701.056856:0:5814:0:(genops.c:1385:class_connect()) connect: client 9ed6d081-3f08-4f7b-834f-c9f807e3a9cb, cookie 0xd08452c77c56de1e 00000004:00100000:2.0:1789762701.056880:0:5814:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789762701.057024:0:5814:0:(import.c:65:import_set_state_nolock()) ffff95d17b47e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789762701.057058:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+6:2341:x1876702140572544:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 263us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762701.057065:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1789762701.057917:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762701.057948:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762701.057990:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140572800 00000100:00100000:3.0:1789762701.057995:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140572800 00000100:00100000:2.0:1789762701.058004:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140572672 00000100:00100000:2.0:1789762701.058011:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140572672 00000100:00080000:0.0:1789762701.058041:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762701.058043:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:3.0:1789762701.058055:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+7:8447:x1876702140572800:12345-192.168.203.31@tcp:41:mount.lustre.0 00000100:00100000:2.0:1789762701.058060:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1789762701.058074:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+7:0:x1876702140572672:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789762701.058088:0:6681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:2.0:1789762701.058090:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789762701.058184:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+7:0:x1876702140572672:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 113us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762701.058197:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+7:8447:x1876702140572800:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 143us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762701.058198:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:3.0:1789762701.058212:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:3.0:1789762701.058900:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762701.058941:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140572928 00000100:00100000:2.0:1789762701.058945:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140572928 00000100:00100000:2.0:1789762701.058973:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1789762701.058982:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+6:8447:x1876702140572928:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789762701.059024:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+6:8447:x1876702140572928:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 43us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762701.059032:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1789762701.059714:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762701.059738:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762701.059796:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140573056 00000100:00100000:1.0:1789762701.059803:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140573056 00000100:00100000:1.0:1789762701.059829:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140573184 00000100:00100000:1.0:1789762701.059856:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140573184 00000100:00100000:2.0:1789762701.059869:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1789762701.059877:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1876702140573056:12345-192.168.203.31@tcp:8:mount.lustre.0 00000100:00100000:3.0:1789762701.059883:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1789762701.059891:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1789762701.059891:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1876702140573184:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789762701.059901:0:8803:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9ed6d081-3f08-4f7b-834f-c9f807e3a9cb@192.168.203.31@tcp t0 exp 0000000000000000 cur 105 last 0 00000100:00100000:1.0:1789762701.059902:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789762701.059905:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00080000:3.0:1789762701.059914:0:6656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9ed6d081-3f08-4f7b-834f-c9f807e3a9cb@192.168.203.31@tcp t0 exp 0000000000000000 cur 105 last 0 00000020:00000080:2.0:1789762701.059930:0:8803:0:(genops.c:1385:class_connect()) connect: client 9ed6d081-3f08-4f7b-834f-c9f807e3a9cb, cookie 0xd08452c77c56de25 00000020:00000080:3.0:1789762701.059938:0:6656:0:(genops.c:1385:class_connect()) connect: client 9ed6d081-3f08-4f7b-834f-c9f807e3a9cb, cookie 0xd08452c77c56de2c 00000100:00100000:0.0:1789762701.059939:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140573312 00002000:00100000:2.0:1789762701.059941:0:8803:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9ed6d081-3f08-4f7b-834f-c9f807e3a9cb/ffff95d17b47b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1789762701.059946:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140573312 00002000:00100000:3.0:1789762701.059949:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9ed6d081-3f08-4f7b-834f-c9f807e3a9cb/ffff95d041c1b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789762701.059958:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:2.0:1789762701.059960:0:8803:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789762701.059982:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:0.0:1789762701.059995:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+6:8447:x1876702140573312:12345-192.168.203.31@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789762701.060051:0:8160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00002000:00080000:2.0:1789762701.060066:0:8803:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789762701.060088:0:8803:0:(import.c:65:import_set_state_nolock()) ffff95d17b478000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789762701.060109:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+6:8447:x1876702140573312:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 116us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762701.060118:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:2.0:1789762701.060120:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+6:2341:x1876702140573056:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 241us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762701.060127:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00002000:00080000:3.0:1789762701.060196:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789762701.060218:0:6656:0:(import.c:65:import_set_state_nolock()) ffff95d041c1e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789762701.060251:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+6:2341:x1876702140573184:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 359us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762701.060329:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00010000:00010000:2.0:1789762701.350965:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762701.479972:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789762701.479990:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148985216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762701.480046:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762701.480087:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148985216 00000100:00100000:2.0:1789762701.480095:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148985216 00000100:00100000:2.0:1789762701.480159:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789762701.480170:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148985216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762701.480191:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762701.480239:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148985216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762701.480246:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789762701.480273:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1463cdf80 x1876702148985216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762701.480289:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148985216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762702.374960:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789762702.619777:0:10464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789762703.398934:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789762703.534945:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:3.0:1789762703.534951:0:6684:0:(genops.c:885:class_export_put()) final put ffff95d0418cb000/77777931-b235-4c03-82d2-4b1d12553008 00000001:00100000:3.0:1789762703.534970:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9ed6d081-3f08-4f7b-834f-c9f807e3a9cb 00000020:00000080:2.0:1789762703.534975:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d0418cb000/77777931-b235-4c03-82d2-4b1d12553008 for lustre-OST0000 00000020:00000080:2.0:1789762703.535014:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d0418ce800 for lustre-OST0000 00010000:00010000:0.0:1789762704.422989:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762705.446916:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762706.086979:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148985344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762706.087039:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762706.087075:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148985344 00000100:00100000:3.0:1789762706.087084:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148985344 00000100:00080000:1.0:1789762706.087141:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762706.087160:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789762706.087172:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148985344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789762706.087204:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762706.087255:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148985344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762706.087263:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789762706.087292:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1463cdf80 x1876702148985344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762706.087311:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148985344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762706.088159:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148985472:0@lo:400:kworker.0 00000100:00100000:1.0:1789762706.088193:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762706.088222:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148985472 00000100:00100000:3.0:1789762706.088227:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148985472 00000100:00100000:1.0:1789762706.088239:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702148985984:0@lo:400:kworker.0 00000100:00100000:3.0:1789762706.088266:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789762706.088277:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762706.088279:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702148985472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762706.088308:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789762706.088318:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702148985600:0@lo:400:kworker.0 00000100:00100000:3.0:1789762706.088326:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702148985472:12345-0@lo:400:kworker.0 Request processed in 51us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762706.088332:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789762706.088355:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762706.088375:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148985984 00000100:00100000:3.0:1789762706.088380:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148985984 00000100:00100000:3.0:1789762706.088423:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148985600 00000100:00100000:3.0:1789762706.088426:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148985600 00000100:00100000:0.0:1789762706.088436:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148985856:0@lo:400:kworker.0 00000100:00100000:3.0:1789762706.088451:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789762706.088461:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702148985984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762706.088482:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762706.088520:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702148985984:12345-0@lo:400:kworker.0 Request processed in 58us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762706.088529:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789762706.088559:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789762706.088570:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702148985728:0@lo:400:kworker.0 00000100:00100000:0.0:1789762706.088607:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762706.088642:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148985728 00000100:00100000:0.0:1789762706.088646:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148985728 00000100:00100000:0.0:1789762706.088679:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789762706.088689:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702148985600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762706.088727:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702148985600:12345-0@lo:400:kworker.0 Request processed in 42us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762706.088734:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789762706.088751:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789762706.088759:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702148985728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762706.088797:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702148985728:12345-0@lo:400:kworker.0 Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762706.088805:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789762706.088860:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148985856 00000100:00100000:0.0:1789762706.088864:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148985856 00000100:00080000:2.0:1789762706.088876:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789762706.088883:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762706.088912:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789762706.088923:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148985856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762706.088968:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148985856:12345-0@lo:400:kworker.0 Request processed in 48us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762706.088984:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789762706.089038:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702148985728:0@lo:400:kworker.0 00010000:00080000:0.0:1789762706.089056:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d174164a80 x1876702148985856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762706.089065:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148985856:0@lo:400:kworker.0 00000100:00100000:0.0:1789762706.089106:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702148985600:0@lo:400:kworker.0 00000100:00100000:0.0:1789762706.089134:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148985472:0@lo:400:kworker.0 00000100:00100000:0.0:1789762706.089152:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702148985984:0@lo:400:kworker.0 00000001:00100000:3.0:1789762706.101665:0:5834:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9ed6d081-3f08-4f7b-834f-c9f807e3a9cb 00000001:00100000:0.0:1789762706.102424:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9ed6d081-3f08-4f7b-834f-c9f807e3a9cb 00000100:00100000:0.0:1789762706.292236:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762706.292272:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762706.292274:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140573568 00000100:00100000:0.0:1789762706.292290:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762706.292290:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140573568 00000100:00100000:1.0:1789762706.292305:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140573440 00000100:00100000:1.0:1789762706.292312:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140573440 00000100:00100000:0.0:1789762706.292324:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762706.292329:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140573696 00000100:00100000:3.0:1789762706.292337:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140573696 00000100:00100000:0.0:1789762706.292362:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762706.292367:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:2.0:1789762706.292370:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:1.0:1789762706.292382:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140573440:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762706.292387:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140573568:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762706.292388:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1789762706.292401:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140573824 00000100:00100000:3.0:1789762706.292403:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140573696:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762706.292407:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140573824 00000100:00100000:0.0:1789762706.292444:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140573952 00000100:00100000:0.0:1789762706.292446:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140573952 00000100:00100000:2.0:1789762706.292456:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140573568:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 73us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762706.292460:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140573440:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762706.292460:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140573696:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 55us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762706.292468:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1789762706.292471:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1789762706.292480:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:1.0:1789762706.292487:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:0.0:1789762706.292488:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140573824:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:2.0:1789762706.292498:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789762706.292503:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789762706.292507:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762706.292514:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1789762706.292524:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140573824:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 40us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762706.292530:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140573952:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762706.292536:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1789762706.292570:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140573952:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 46us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762706.292577:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00010000:00010000:3.0:1789762706.470924:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762706.598977:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148986112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762706.599044:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762706.599082:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148986112 00000100:00100000:2.0:1789762706.599090:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148986112 00000100:00100000:2.0:1789762706.599145:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789762706.599154:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148986112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762706.599181:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762706.599228:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148986112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762706.599233:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789762706.599265:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d174166680 x1876702148986112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789762706.599285:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148986112:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789762707.457807:0:11165:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789762707.496260:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789762708.501061:0:11312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd194c2dc0 20000000:00000080:0.0:1789762708.501073:0:11312:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d1747de000 uarg=0000000000000000 20000000:01000000:0.0:1789762708.501115:0:11312:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789762708.501120:0:11312:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789762708.501124:0:11312:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789762708.501648:0:11313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789762708.501726:0:11312:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789762708.504959:0:11312:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789762708.504976:0:11312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.504991:0:11312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d1821f8c00/0xd08452c77c56dddf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56ddd8 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.504996:0:11312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d1821f9200/0xd08452c77c56dded lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56dde6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505001:0:11312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d1821f9600/0xd08452c77c56ddfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56ddf4 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505008:0:11312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d1583a9800/0xd08452c77c56de02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3eb expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505013:0:11312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d1588cd000/0xd08452c77c56de17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e423 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505017:0:11312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505048:0:11312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d1588cd000/0xd08452c77c56de17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e423 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505067:0:11312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d1588cd000/0xd08452c77c56de17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e423 expref: 12 pid: 5807 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762708.505078:0:11312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11312:1876702148986240:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762708.505173:0:11312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d1583a9800/0xd08452c77c56de02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3eb expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505180:0:11312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d1583a9800/0xd08452c77c56de02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3eb expref: 12 pid: 5807 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762708.505186:0:11312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11312:1876702148986368:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762708.505207:0:11312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d1821f9600/0xd08452c77c56ddfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56ddf4 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505212:0:11312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d1821f9600/0xd08452c77c56ddfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56ddf4 expref: 18 pid: 5808 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762708.505219:0:11312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11312:1876702148986496:0@lo:104: 00000100:00100000:0.0:1789762708.505246:0:11312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789762708.505282:0:11312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d1821f9200/0xd08452c77c56dded lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56dde6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505289:0:11312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d1821f9200/0xd08452c77c56dded lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56dde6 expref: 18 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762708.505294:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148986496 00000100:00100000:0.0:1789762708.505296:0:11312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11312:1876702148986624:0@lo:104: 00000100:00100000:1.0:1789762708.505305:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148986496 00000100:00100000:0.0:1789762708.505323:0:11312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762708.505364:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148986624 00010000:00010000:0.0:1789762708.505369:0:11312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d1821f8c00/0xd08452c77c56dddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd08452c77c56ddd8 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762708.505371:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148986624 00000100:00100000:2.0:1789762708.505382:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789762708.505385:0:11312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d1821f8c00/0xd08452c77c56dddf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd08452c77c56ddd8 expref: 18 pid: 5808 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762708.505398:0:11312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11312:1876702148986752:0@lo:104: 00000100:00100000:2.0:1789762708.505399:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:11312:x1876702148986496:12345-0@lo:104: 00000100:00100000:3.0:1789762708.505400:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789762708.505416:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56ddfb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762708.505417:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+4:11312:x1876702148986624:12345-0@lo:104: 00000100:00100000:0.0:1789762708.505431:0:11312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789762708.505434:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dded expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762708.505463:0:11312:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17af6d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789762708.505480:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148986752 00000100:00100000:1.0:1789762708.505487:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148986752 00010000:00010000:2.0:1789762708.505487:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789762708.505489:0:11312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11312:1876702148986496:0@lo:104: 00010000:00010000:3.0:1789762708.505495:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789762708.505497:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:11312:x1876702148986496:12345-0@lo:104: Request processed in 105us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762708.505506:0:11312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11312:1876702148986624:0@lo:104: 00000100:00100000:3.0:1789762708.505506:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+5:11312:x1876702148986624:12345-0@lo:104: Request processed in 91us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762708.505510:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789762708.505525:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789762708.505534:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789762708.505541:0:6671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789762708.505548:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:11312:x1876702148986752:12345-0@lo:104: 00010000:00010000:2.0:1789762708.505549:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762708.505550:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56ddfb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762708.505557:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dded expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762708.505565:0:6669:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dddf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505573:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9000 already unused, calling callback (ffffffffc1a96c20) 00010000:00010000:2.0:1789762708.505579:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fe000 already unused, calling callback (ffffffffc1a96c20) 10000000:00010000:0.0:1789762708.505581:0:6671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56ddfb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762708.505584:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56dded expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505608:0:6671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56ddfb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762708.505608:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56dded expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762708.505627:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56dded expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789762708.505630:0:6671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56ddfb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762708.505635:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789762708.505637:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:0.0:1789762708.505647:0:6671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789762708.505651:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+3:11312:x1876702148986752:12345-0@lo:104: Request processed in 105us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762708.505662:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789762708.505666:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dded expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762708.505672:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789762708.505673:0:6671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56ddfb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505683:0:6671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789762708.505685:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762708.505690:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dded expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762708.505693:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd08452c77c56dddf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762708.505702:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d1747fe000/0xd08452c77c56dde6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dded expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505704:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56ddfb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762708.505712:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fec00 already unused, calling callback (ffffffffc1a96c20) 10000000:00010000:1.0:1789762708.505721:0:6670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd08452c77c56dddf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505725:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d1583a9000/0xd08452c77c56ddf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56ddfb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762708.505728:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762708.505731:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762708.505735:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762708.505740:0:6670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd08452c77c56dddf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505749:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762708.505749:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148986880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789762708.505750:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702148987008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789762708.505753:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762708.505758:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789762708.505760:0:6670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd08452c77c56dddf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762708.505782:0:6670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789762708.505785:0:11312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11312:1876702148986752:0@lo:104: 00000100:00100000:3.0:1789762708.505802:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789762708.505816:0:6670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dddf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762708.505825:0:6670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789762708.505850:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762708.505873:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148986880 00000100:00100000:0.0:1789762708.505880:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148986880 00010000:00010000:1.0:1789762708.505880:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dddf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762708.505890:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148987008 00010000:00010000:1.0:1789762708.505892:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff95d1747fec00/0xd08452c77c56ddd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd08452c77c56dddf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762708.505902:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148987008 00010000:00010000:0.0:1789762708.505906:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d1821f9200/0xd08452c77c56dded lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dde6 expref: 19 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762708.505915:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762708.505920:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762708.505923:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d1821f9600/0xd08452c77c56ddfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56ddf4 expref: 20 pid: 5808 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762708.505925:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762708.505936:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789762708.505943:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148987136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789762708.505949:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+20:3276:x1876702148986880:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789762708.505961:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789762708.505964:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762708.505974:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d1821f9200/0xd08452c77c56dded lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56dde6 expref: 20 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762708.505974:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a04b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+20:3277:x1876702148987008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789762708.505986:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789762708.505991:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789762708.505997:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d1821f9600/0xd08452c77c56ddfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56ddf4 expref: 20 pid: 5808 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.505998:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d1821f9200/0xd08452c77c56dded lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56dde6 expref: 20 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762708.506019:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d1821f9600/0xd08452c77c56ddfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56ddf4 expref: 20 pid: 5808 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762708.506036:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1821f9200/0xd08452c77c56dded lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56dde6 expref: 20 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762708.506039:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148987136 00010000:00010000:2.0:1789762708.506041:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1821f9600/0xd08452c77c56ddfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56ddf4 expref: 20 pid: 5808 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762708.506046:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148987136 00010000:00010000:0.0:1789762708.506063:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762708.506064:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762708.506070:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d1821f8c00/0xd08452c77c56dddf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56ddd8 expref: 19 pid: 5808 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762708.506119:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789762708.506132:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702148986880:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762708.506133:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702148987136:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789762708.506146:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a04b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702148987008:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (300us total) trans 0 rc 0/0 00010000:00010000:1.0:1789762708.506151:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789762708.506156:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148986880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789762708.506162:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d1821f8c00/0xd08452c77c56dddf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd08452c77c56ddd8 expref: 19 pid: 5808 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762708.506166:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789762708.506182:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789762708.506183:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d1821f8c00/0xd08452c77c56dddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd08452c77c56ddd8 expref: 18 pid: 5808 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762708.506199:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702148987008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789762708.506211:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1821f8c00/0xd08452c77c56dddf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd08452c77c56ddd8 expref: 17 pid: 5808 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762708.506224:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762708.506269:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:3278:x1876702148987136:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762708.506278:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789762708.506290:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702148987136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789762708.506457:0:11312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11312:1876702148986240:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789762708.506463:0:11312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11312:1876702148986368:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789762708.506479:0:11312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762708.506684:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762708.506714:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140574080 00000100:00100000:3.0:1789762708.506718:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140574080 00010000:00010000:3.0:1789762708.506733:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d1588cd000/0xd08452c77c56de17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e423 expref: 13 pid: 5807 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762708.506742:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762708.506759:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140574208 00000100:00100000:3.0:1789762708.506765:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140574208 00000100:00100000:1.0:1789762708.506792:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:1.0:1789762708.506804:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+14:2344:x1876702140574080:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762708.506815:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762708.506823:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d1588cd000/0xd08452c77c56de17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e423 expref: 14 pid: 5807 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762708.506825:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d1583a9800/0xd08452c77c56de02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3eb expref: 14 pid: 5807 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762708.506871:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d1588cd000/0xd08452c77c56de17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e423 expref: 14 pid: 5807 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762708.506901:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1588cd000/0xd08452c77c56de17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e423 expref: 14 pid: 5807 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762708.506919:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00010000:00010000:1.0:1789762708.506921:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762708.506932:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140574208:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762708.506944:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762708.506955:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d1583a9800/0xd08452c77c56de02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3eb expref: 13 pid: 5807 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762708.506962:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140574080:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 158us (275us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762708.506975:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d1583a9800/0xd08452c77c56de02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3eb expref: 13 pid: 5807 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762708.506977:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00010000:00010000:3.0:1789762708.506995:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1583a9800/0xd08452c77c56de02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3eb expref: 12 pid: 5807 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762708.507004:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762708.507011:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762708.507020:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762708.507065:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762708.507070:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762708.507075:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762708.507078:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747ff000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762708.507081:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762708.507086:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762708.507116:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762708.507124:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762708.507139:0:11312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762708.507150:0:11312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762708.507151:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+11:2342:x1876702140574208:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 223us (410us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762708.507168:0:11312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d1747ff000/0xd08452c77c56de33 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762708.507171:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00010000:00010000:1.0:1789762708.518931:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762709.543001:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789762709.612120:0:11506:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1789762709.734884:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789762709.734890:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d17fb80000 from 7 10000000:01000000:2.0:1789762709.734893:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789762709.734934:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d148e51800/0xd08452c77c56de3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762709.734943:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d148e51800/0xd08452c77c56de3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762709.734951:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d148e51800/0xd08452c77c56de3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762709.734970:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148987264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789762709.735023:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762709.735070:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762709.735097:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148987264 00000100:00100000:3.0:1789762709.735107:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148987264 00000100:00100000:3.0:1789762709.735151:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789762709.735159:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+16:5810:x1876702148987264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762709.735171:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762709.735183:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1583a9800/0xd08452c77c56de41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56de3a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762709.735202:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1583a9800/0xd08452c77c56de41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56de3a expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762709.735210:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1583a9800/0xd08452c77c56de41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56de3a expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762709.735217:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9800, rc 0) 00000100:00100000:3.0:1789762709.735254:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148987264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762709.735260:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789762709.735281:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148987264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762709.735296:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d148e51800/0xd08452c77c56de3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56de41 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762709.735306:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d148e51800/0xd08452c77c56de3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56de41 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762709.735368:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148987392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762709.735389:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762709.735403:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789762709.735429:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148987392 00000100:00100000:1.0:1789762709.735435:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148987392 00000100:00100000:1.0:1789762709.735463:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789762709.735470:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148987392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789762709.735688:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148987392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762709.735695:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789762709.735726:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148987392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762709.735749:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148987520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762709.735779:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762709.735793:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762709.735817:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148987520 00000100:00100000:3.0:1789762709.735822:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148987520 00000100:00100000:3.0:1789762709.735859:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789762709.735871:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148987520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762709.735988:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148987520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762709.735995:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789762709.736013:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148987520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789762709.736679:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789762709.736785:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789762709.736802:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789762709.736807:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d148e51800/0xd08452c77c56de3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56de41 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762709.736815:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d148e51800/0xd08452c77c56de3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56de41 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762709.736822:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789762709.736823:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d15277f800 from 7 10000000:01000000:3.0:1789762709.736824:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789762709.736860:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1583a8000/0xd08452c77c56de48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762709.736866:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d1583a8000/0xd08452c77c56de48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762709.736871:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d1583a8000/0xd08452c77c56de48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762709.736883:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148987648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789762709.736908:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762709.736934:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762709.736940:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148987648 00000100:00100000:1.0:1789762709.736944:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148987648 00000100:00100000:1.0:1789762709.736970:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789762709.736975:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+17:5810:x1876702148987648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789762709.736982:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762709.736988:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1588cd000/0xd08452c77c56de4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56de48 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762709.737000:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1588cd000/0xd08452c77c56de4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56de48 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762709.737007:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1588cd000/0xd08452c77c56de4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56de48 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762709.737012:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cd000, rc 0) 00000100:00100000:1.0:1789762709.737041:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148987648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762709.737046:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789762709.737075:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148987648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762709.737096:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d1583a8000/0xd08452c77c56de48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56de4f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762709.737109:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d1583a8000/0xd08452c77c56de48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56de4f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762709.737139:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148987776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762709.737158:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762709.737174:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789762709.737188:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148987776 00000100:00100000:2.0:1789762709.737192:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148987776 00000100:00100000:2.0:1789762709.737219:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789762709.737224:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148987776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762709.737355:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148987776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762709.737362:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789762709.737383:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148987776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762709.737403:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148987904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762709.737429:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762709.737443:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d150dd4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762709.737464:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148987904 00000100:00100000:1.0:1789762709.737469:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148987904 00000100:00100000:1.0:1789762709.737489:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789762709.737494:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148987904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789762709.737584:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148987904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762709.737598:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789762709.737612:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148987904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789762709.738204:0:11522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789762709.738253:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789762709.738270:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789762709.738275:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d1583a8000/0xd08452c77c56de48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56de4f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762709.738282:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d1583a8000/0xd08452c77c56de48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56de4f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762709.738288:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789762709.738296:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d1549a0000 from 7 10000000:01000000:2.0:1789762709.738299:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789762709.738313:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d148e50600/0xd08452c77c56de56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762709.738321:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff95d148e50600/0xd08452c77c56de56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762709.738330:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff95d148e50600/0xd08452c77c56de56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762709.738344:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148988032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789762709.738365:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762709.738386:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762709.738395:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148988032 00000100:00100000:3.0:1789762709.738399:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148988032 00000100:00100000:3.0:1789762709.738423:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789762709.738428:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+18:5810:x1876702148988032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762709.738434:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762709.738440:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1583a8c00/0xd08452c77c56de5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd08452c77c56de56 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762709.738452:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1583a8c00/0xd08452c77c56de5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd08452c77c56de56 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762709.738459:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1583a8c00/0xd08452c77c56de5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd08452c77c56de56 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762709.738473:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a8c00, rc 0) 00000100:00100000:3.0:1789762709.738502:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148988032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762709.738507:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789762709.738529:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148988032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762709.738542:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff95d148e50600/0xd08452c77c56de56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56de5d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762709.738551:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff95d148e50600/0xd08452c77c56de56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd08452c77c56de5d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762709.738588:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148988160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762709.738609:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762709.738623:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789762709.738661:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148988160 00000100:00100000:1.0:1789762709.738668:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148988160 00000100:00100000:1.0:1789762709.738697:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789762709.738703:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148988160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789762709.738819:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148988160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762709.738827:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789762709.738859:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148988160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762709.738893:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148988288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762709.738923:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762709.738946:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148988288 00000100:00100000:2.0:1789762709.738948:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762709.738951:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148988288 00000100:00100000:3.0:1789762709.738977:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789762709.738982:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148988288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762709.739066:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:5810:x1876702148988288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762709.739073:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789762709.739082:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:5810:1876702148988288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789762709.739673:0:11523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789762709.739715:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789762709.739732:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789762709.739736:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff95d148e50600/0xd08452c77c56de56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56de5d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762709.739743:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff95d148e50600/0xd08452c77c56de56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd08452c77c56de5d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762710.452281:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762710.452346:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140574336 00000100:00100000:1.0:1789762710.452357:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140574336 00000100:00100000:1.0:1789762710.452411:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:1.0:1789762710.452421:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+11:5574:x1876702140574336:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789762710.452437:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762710.452455:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1588cc000/0xd08452c77c56de64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e44d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.452483:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1588cc000/0xd08452c77c56de64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e44d expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.452494:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1588cc000/0xd08452c77c56de64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e44d expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.452504:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cc000, rc 0) 00000100:00100000:1.0:1789762710.452557:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+12:5574:x1876702140574336:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 137us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762710.452565:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:0.0:1789762710.453335:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762710.453378:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140574464 00000100:00100000:3.0:1789762710.453384:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140574464 00000100:00100000:3.0:1789762710.453413:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:3.0:1789762710.453422:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+12:5574:x1876702140574464:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762710.453652:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+12:5574:x1876702140574464:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 231us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762710.453660:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:2.0:1789762710.454302:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762710.454351:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140574592 00000100:00100000:1.0:1789762710.454363:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140574592 00000100:00100000:1.0:1789762710.454393:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:1.0:1789762710.454403:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+12:5574:x1876702140574592:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789762710.454543:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+12:5574:x1876702140574592:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 141us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762710.454553:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:2.0:1789762710.456126:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762710.456192:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140574720 00000100:00100000:3.0:1789762710.456198:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140574720 00000100:00100000:3.0:1789762710.456221:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:3.0:1789762710.456227:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+12:5574:x1876702140574720:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762710.456234:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762710.456242:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d1583a9a00/0xd08452c77c56de6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e454 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.456256:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d1583a9a00/0xd08452c77c56de6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e454 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.456263:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d1583a9a00/0xd08452c77c56de6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e454 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.456268:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9a00, rc 0) 00000100:00100000:3.0:1789762710.456292:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:5574:x1876702140574720:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 66us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762710.456297:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:0.0:1789762710.456904:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762710.456953:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140574848 00000100:00100000:1.0:1789762710.456959:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140574848 00000100:00100000:1.0:1789762710.456989:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:1.0:1789762710.456998:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:5574:x1876702140574848:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789762710.457150:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:5574:x1876702140574848:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 152us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762710.457158:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:2.0:1789762710.457743:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762710.457778:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140574976 00000100:00100000:3.0:1789762710.457783:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140574976 00000100:00100000:3.0:1789762710.457809:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:3.0:1789762710.457819:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:5574:x1876702140574976:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762710.457936:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:5574:x1876702140574976:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 119us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762710.457944:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 215 00010000:00010000:0.0:1789762710.566944:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789762710.747977:0:11608:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanityn: finish setup 16:18:29 (1789762709) === 00000100:00100000:1.0:1789762710.771502:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.771551:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140575104 00000100:00100000:0.0:1789762710.771562:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140575104 00000100:00080000:1.0:1789762710.771606:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762710.771637:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1789762710.771651:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+6:7617:x1876702140575104:12345-192.168.203.31@tcp:37:bash.0 00000100:00100000:1.0:1789762710.774104:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+6:7617:x1876702140575104:12345-192.168.203.31@tcp:37:bash.0 Request processed in 2455us (2605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762710.774113:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:3.0:1789762710.779206:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.779251:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140575232 00000100:00100000:0.0:1789762710.779260:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140575232 00000100:00100000:0.0:1789762710.779312:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:0.0:1789762710.779323:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+6:9991:x1876702140575232:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:0.0:1789762710.779340:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762710.779362:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56de72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e45b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779420:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56de79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779436:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56de79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779449:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56de79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779507:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56de80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779524:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56de80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779533:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56de80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779711:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56de79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779722:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56de79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779731:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56de79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779738:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fe600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.779743:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56de79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779752:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56de79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779766:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:0.0:1789762710.779770:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.779775:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56de79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779783:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56de79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779796:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56de80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779811:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56de80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779819:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56de80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779825:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fee00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.779829:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56de80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779858:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56de80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779870:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xceb91eaa (ffff95d151e90c00) 00010000:00010000:0.0:1789762710.779873:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.779877:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56de80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779884:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56de80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779918:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56de72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e45b expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779930:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:0.0:1789762710.779933:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.779937:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56de72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e45b expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.779949:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747ff800, rc 0) 00000100:00100000:0.0:1789762710.780004:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+6:9991:x1876702140575232:12345-192.168.203.31@tcp:101:rm.0 Request processed in 683us (801us total) trans 0 rc 301/301 00000100:00100000:0.0:1789762710.780013:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:3.0:1789762710.780940:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.780987:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140575360 00000100:00100000:0.0:1789762710.780993:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140575360 00000100:00100000:0.0:1789762710.781034:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1789762710.781043:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+6:9991:x1876702140575360:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:0.0:1789762710.781054:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762710.781064:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fec00/0xd08452c77c56de87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e462 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781113:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56de8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781125:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56de8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781135:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56de8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781167:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56de95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781175:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56de95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781183:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56de95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781278:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56de8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781296:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56de8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781304:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56de8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781311:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747ff000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.781314:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56de8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781321:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56de8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781332:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:0.0:1789762710.781335:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.781338:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56de8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781346:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56de8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781357:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56de95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781364:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56de95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781371:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56de95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781378:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fe000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.781386:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56de95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781394:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56de95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781403:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x59b4378f (ffff95d151e90700) 00010000:00010000:0.0:1789762710.781405:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.781408:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56de95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781416:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56de95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781445:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fec00/0xd08452c77c56de87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e462 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781454:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:0.0:1789762710.781456:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.781461:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fec00/0xd08452c77c56de87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e462 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.781471:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747fec00, rc 0) 00000100:00100000:0.0:1789762710.781504:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+6:9991:x1876702140575360:12345-192.168.203.31@tcp:101:rm.0 Request processed in 462us (563us total) trans 0 rc 301/301 00000100:00100000:0.0:1789762710.781512:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:3.0:1789762710.782273:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.782317:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140575488 00000100:00100000:0.0:1789762710.782323:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140575488 00000100:00100000:0.0:1789762710.782369:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1789762710.782381:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+6:9991:x1876702140575488:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:0.0:1789762710.782399:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762710.782409:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56de9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e469 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782456:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56dea3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782466:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56dea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782475:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56dea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782489:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782497:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782504:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782603:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56dea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782612:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56dea3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782620:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56dea3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782627:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.782639:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56dea3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782648:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56dea3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782660:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:0.0:1789762710.782663:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.782667:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56dea3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782674:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56dea3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782686:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782694:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deaa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782700:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782707:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.782711:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782718:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deaa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782725:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5948ff0e (ffff95d151e90400) 00010000:00010000:0.0:1789762710.782728:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.782737:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deaa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782745:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782770:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56de9c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e469 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782780:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:0.0:1789762710.782783:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.782787:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56de9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e469 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.782798:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747ffa00, rc 0) 00000100:00100000:0.0:1789762710.782896:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+6:9991:x1876702140575488:12345-192.168.203.31@tcp:101:rm.0 Request processed in 455us (561us total) trans 0 rc 301/301 00000100:00100000:0.0:1789762710.782906:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1789762710.828181:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.828241:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140575616 00000100:00100000:0.0:1789762710.828252:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140575616 00000100:00100000:0.0:1789762710.828307:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1789762710.828320:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:77777931-b235-4c03-82d2-4b1d12553008+6:9996:x1876702140575616:12345-192.168.203.31@tcp:700:mkdir.0 00000100:00100000:0.0:1789762710.828406:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:77777931-b235-4c03-82d2-4b1d12553008+6:9996:x1876702140575616:12345-192.168.203.31@tcp:700:mkdir.0 Request processed in 88us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762710.828416:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1789762710.829127:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.829169:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140575872 00000100:00100000:0.0:1789762710.829175:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140575872 00000100:00100000:0.0:1789762710.829212:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1789762710.829221:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+6:9996:x1876702140575872:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:0.0:1789762710.829272:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762710.829298:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588ccc00/0xd08452c77c56dce3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e3d6 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.829315:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:0.0:1789762710.829327:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762710.829510:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deb1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.829524:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deb1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.829535:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deb1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.829585:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56deb8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.829594:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56deb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.829602:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56deb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762710.830721:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789762710.830731:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deb1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.830741:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deb1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.830748:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deb1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.830762:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.830766:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deb1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.830775:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deb1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.830786:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90400) 00010000:00010000:0.0:1789762710.830789:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.830793:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deb1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.830800:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56deb1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762710.830814:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c7ed30a reply state 000000005cafb5fc transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56deb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762710.830823:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762710.830921:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+7:9996:x1876702140575872:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 1700us (1793us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789762710.830929:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00010000:00010000:0.0:1789762710.831495:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56deb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.831506:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56deb8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.831513:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56deb8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.831529:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.831533:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56deb8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.831540:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56deb8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.831550:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95d151e90700) 00010000:00010000:0.0:1789762710.831553:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.831557:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56deb8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.831563:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56deb8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762710.834237:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.834276:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140576000 00000100:00100000:0.0:1789762710.834281:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140576000 00000100:00100000:0.0:1789762710.834312:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1789762710.834320:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+6:9997:x1876702140576000:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:0.0:1789762710.834332:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762710.834344:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4e00/0xd08452c77c56debf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e470 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.834386:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4600/0xd08452c77c56dec6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.834395:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4600/0xd08452c77c56dec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.834404:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4600/0xd08452c77c56dec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762710.834430:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789762710.834433:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762710.834460:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4600/0xd08452c77c56dec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.834481:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4e00/0xd08452c77c56debf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e470 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.834495:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4600/0xd08452c77c56dec6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e470 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.834503:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90c00) 00010000:00010000:0.0:1789762710.834506:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762710.834509:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f4600, rc 0) 00000100:00100000:0.0:1789762710.834542:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+7:9997:x1876702140576000:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 222us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762710.834550:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:3.0:1789762710.835439:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.835480:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140576256 00000100:00100000:0.0:1789762710.835487:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140576256 00000100:00100000:0.0:1789762710.835522:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1789762710.835532:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+7:9997:x1876702140576256:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:0.0:1789762710.835556:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762710.835569:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4600/0xd08452c77c56dec6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e470 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.835581:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90c00) 00010000:00010000:0.0:1789762710.835593:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762710.835607:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56decd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.835617:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56decd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.835625:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56decd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762710.835779:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006cb18ded reply state 00000000ab322752 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56decd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762710.835788:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789762710.835793:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789762710.835862:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+8:9997:x1876702140576256:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 332us (422us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789762710.835870:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00010000:00010000:1.0:1789762710.836399:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56decd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.836408:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56decd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.836412:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56decd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.836423:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762710.836426:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56decd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.836430:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56decd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.836437:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:1.0:1789762710.836439:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789762710.836442:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56decd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.836446:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56decd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762710.842892:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.842924:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140576384 00000100:00100000:0.0:1789762710.842930:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140576384 00000100:00100000:0.0:1789762710.842962:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1789762710.842971:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+7:9998:x1876702140576384:12345-192.168.203.31@tcp:101:chown.0 00010000:00010000:0.0:1789762710.842983:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762710.842995:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56ded4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e477 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.843029:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4c00/0xd08452c77c56dedb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.843039:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4c00/0xd08452c77c56dedb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.843055:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4c00/0xd08452c77c56dedb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762710.843073:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789762710.843089:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762710.843116:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4c00/0xd08452c77c56dedb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.843134:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56ded4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e477 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.843148:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4c00/0xd08452c77c56dedb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e477 expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.843157:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90800) 00010000:00010000:0.0:1789762710.843160:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762710.843164:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f4c00, rc 0) 00000100:00100000:0.0:1789762710.843196:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+8:9998:x1876702140576384:12345-192.168.203.31@tcp:101:chown.0 Request processed in 227us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762710.843203:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:3.0:1789762710.843925:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.843956:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140576512 00000100:00100000:0.0:1789762710.843961:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140576512 00000100:00100000:0.0:1789762710.843989:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1789762710.843998:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+8:9998:x1876702140576512:12345-192.168.203.31@tcp:101:chown.0 00010000:00010000:0.0:1789762710.844006:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762710.844014:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56dee2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e47e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844054:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56dee9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844064:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56dee9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844073:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56dee9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844097:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56def0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844106:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56def0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844114:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56def0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844162:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56def7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844171:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56def7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844178:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56def7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762710.844193:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789762710.844197:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762710.844205:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56def7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844227:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56dee9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844234:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56dee9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844241:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56dee9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844246:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.844251:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56dee9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844258:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56dee9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844268:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90800) 00010000:00010000:0.0:1789762710.844270:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.844273:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56dee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844280:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56dee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844291:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56def0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844298:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56def0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844305:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56def0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844315:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.844319:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56def0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844326:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56def0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844333:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95d151e90100) 00010000:00010000:0.0:1789762710.844336:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.844339:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56def0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844347:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56def0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844368:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56dee2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e47e expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844380:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56def7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e47e expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.844388:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d151e90a00) 00010000:00010000:0.0:1789762710.844391:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762710.844393:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f4200, rc 0) 00000100:00100000:0.0:1789762710.844422:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+9:9998:x1876702140576512:12345-192.168.203.31@tcp:101:chown.0 Request processed in 426us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762710.844430:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1789762710.845478:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.845513:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140576768 00000100:00100000:0.0:1789762710.845523:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140576768 00000100:00100000:0.0:1789762710.845554:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1789762710.845562:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+9:9998:x1876702140576768:12345-192.168.203.31@tcp:36:chown.0 00010000:00010000:0.0:1789762710.845584:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762710.845594:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56def7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e47e expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.845606:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d151e90a00) 00010000:00010000:0.0:1789762710.845612:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762710.845622:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56defe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.845631:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56defe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.845639:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56defe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762710.854133:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1789762710.854178:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9de5205 reply state 000000005a4bbe1c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56defe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762710.854188:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762710.854194:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1789762710.854239:0:5813:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789762710.854250:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+7:9998:x1876702140576768:12345-192.168.203.31@tcp:36:chown.0 Request processed in 8688us (8772us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789762710.854256:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00010000:00010000:0.0:1789762710.854269:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56defe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.854278:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56defe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.854284:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56defe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.854289:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.854292:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56defe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.854305:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56defe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.854314:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d151e90700) 00010000:00010000:0.0:1789762710.854317:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789762710.854319:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56defe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.854323:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56defe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762710.860240:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.860278:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140576896 00000100:00100000:0.0:1789762710.860284:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140576896 00000100:00100000:0.0:1789762710.860316:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:0.0:1789762710.860323:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+6:9999:x1876702140576896:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:0.0:1789762710.860337:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762710.860346:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56df05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e485 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789762710.860873:0:5814:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 494us 00010000:00010000:2.0:1789762710.865985:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56df0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.865998:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56df0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866008:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56df0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866019:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56df13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866025:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56df13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866039:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56df13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866291:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56df1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866298:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56df1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866303:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56df1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762710.866319:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762710.866321:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762710.866344:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56df1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866352:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56df0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866357:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56df0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866362:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56df0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866366:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762710.866369:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56df0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866374:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56df0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866389:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90800) 00010000:00010000:2.0:1789762710.866391:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762710.866394:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56df0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866399:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56df0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866409:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56df13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866413:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56df13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866417:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56df13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866421:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762710.866423:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56df13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866428:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56df13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866433:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95d143e3f900) 00010000:00010000:2.0:1789762710.866434:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762710.866436:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56df13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866440:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56df13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866473:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56df05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e485 expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866484:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56df1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e485 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.866490:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:2.0:1789762710.866492:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789762710.866494:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50400, rc 0) 00000100:00100000:2.0:1789762710.866532:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+7:9999:x1876702140576896:12345-192.168.203.31@tcp:101:touch.500 Request processed in 6209us (6294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762710.866538:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1789762710.867592:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.867625:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140577152 00000100:00100000:0.0:1789762710.867630:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140577152 00000100:00100000:0.0:1789762710.867659:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1789762710.867667:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+7:9999:x1876702140577152:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:0.0:1789762710.867675:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762710.867682:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56df21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e48c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.867787:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56df28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.867801:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56df28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.867810:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56df28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.867824:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56df2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.867859:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56df2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.867867:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56df2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789762710.868441:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789762710.868617:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56df36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.868625:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56df36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.868630:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56df36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.868651:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56df28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.868655:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56df28 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.868660:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56df28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.868668:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.868671:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56df28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.868675:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56df28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.868680:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:0.0:1789762710.868682:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.868685:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56df28 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.868688:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5600/0xd08452c77c56df28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762710.868695:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d77579c reply state 00000000e9899232 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56df2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762710.868700:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789762710.868716:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56df21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e48c expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.868723:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56df36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e48c expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.868728:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d151e90a00) 00010000:00010000:0.0:1789762710.868729:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762710.868731:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f4000, rc 0) 00000100:00100000:0.0:1789762710.868760:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+10:9999:x1876702140577152:12345-192.168.203.31@tcp:101:touch.500 Request processed in 1095us (1170us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789762710.868769:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00010000:00010000:3.0:1789762710.869294:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56df2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.869302:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56df2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.869307:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56df2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.869311:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762710.869313:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56df2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.869318:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56df2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.869328:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff95d151e90700) 00010000:00010000:3.0:1789762710.869330:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762710.869332:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56df2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.869341:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56df2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762710.869918:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762710.869947:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140577408 00000100:00100000:2.0:1789762710.869952:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140577408 00000100:00100000:2.0:1789762710.869980:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1789762710.869987:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+9:9999:x1876702140577408:12345-192.168.203.31@tcp:36:touch.500 00010000:00010000:2.0:1789762710.870010:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762710.870021:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56df36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e48c expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.870031:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d151e90a00) 00010000:00010000:2.0:1789762710.870037:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762710.870054:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56df44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.870060:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56df44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.870072:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56df44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762710.870134:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd5f4eb1 reply state 000000003d2f5eed transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56df44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762710.870140:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762710.870179:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+10:9999:x1876702140577408:12345-192.168.203.31@tcp:36:touch.500 Request processed in 192us (263us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789762710.870184:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00010000:00010000:1.0:1789762710.870729:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56df44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.870735:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56df44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.870739:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56df44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.870743:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762710.870745:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56df44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.870749:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56df44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.870764:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d143e3f000) 00010000:00010000:1.0:1789762710.870766:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762710.870769:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56df44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.870773:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56df44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762710.870909:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762710.870938:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140577536 00000100:00100000:2.0:1789762710.870944:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140577536 00000100:00100000:2.0:1789762710.870973:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:2.0:1789762710.870982:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+9:9999:x1876702140577536:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:2.0:1789762710.870993:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762710.871003:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56df4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e493 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.871041:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56df4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e493 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.871054:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56df4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e493 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.871070:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d143e3fb00) 00010000:00010000:2.0:1789762710.871074:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789762710.871087:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51e00, rc 0) 00000100:00100000:2.0:1789762710.871122:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+10:9999:x1876702140577536:12345-192.168.203.31@tcp:101:touch.500 Request processed in 141us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762710.871130:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1789762710.871926:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762710.871953:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140577664 00000100:00100000:1.0:1789762710.871958:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140577664 00000100:00100000:1.0:1789762710.871981:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1789762710.871985:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1876702140577664:12345-192.168.203.31@tcp:8:touch.500 00010000:00080000:1.0:1789762710.872002:0:6655:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp t0 exp 0000000000000000 cur 115 last 0 00000020:00000080:1.0:1789762710.872026:0:6655:0:(genops.c:1385:class_connect()) connect: client 77777931-b235-4c03-82d2-4b1d12553008, cookie 0xd08452c77c56df52 00002000:00100000:1.0:1789762710.872037:0:6655:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 77777931-b235-4c03-82d2-4b1d12553008/ffff95d16fdd9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789762710.872057:0:6655:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789762710.872182:0:6655:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789762710.872205:0:6655:0:(import.c:65:import_set_state_nolock()) ffff95d16fdd8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789762710.872236:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2341:x1876702140577664:12345-192.168.203.31@tcp:8:touch.500 Request processed in 250us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762710.872242:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:3.0:1789762710.872966:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.872993:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140577792 00000100:00100000:0.0:1789762710.872998:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140577792 00000100:00080000:1.0:1789762710.873033:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762710.873046:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1789762710.873056:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+6:0:x1876702140577792:12345-192.168.203.31@tcp:2:touch.500 00000100:00100000:3.0:1789762710.880626:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+7:0:x1876702140577792:12345-192.168.203.31@tcp:2:touch.500 Request processed in 7569us (7656us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789762710.880635:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000001:00080000:3.0:1789762710.880662:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1789762710.880674:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000100:00100000:3.0:1789762710.881342:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.881414:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140578048 00000100:00100000:0.0:1789762710.881419:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140578048 00000100:00100000:0.0:1789762710.881451:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1789762710.881457:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+10:9999:x1876702140578048:12345-192.168.203.31@tcp:35:touch.500 00000100:00100000:0.0:1789762710.881597:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+11:9999:x1876702140578048:12345-192.168.203.31@tcp:35:touch.500 Request processed in 139us (254us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789762710.881602:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1789762710.885616:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762710.885647:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140578176 00000100:00100000:3.0:1789762710.885652:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140578176 00000100:00100000:3.0:1789762710.885680:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:3.0:1789762710.885686:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+11:10000:x1876702140578176:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1789762710.885696:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762710.885705:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56df59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e49a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.885735:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56df60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.885743:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56df60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.885749:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56df60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762710.885771:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789762710.885773:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762710.885790:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56df60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.885806:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56df59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e49a expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.885817:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56df60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e49a expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762710.885822:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:3.0:1789762710.885824:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762710.885826:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9600, rc 0) 00000100:00100000:3.0:1789762710.885895:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+12:10000:x1876702140578176:12345-192.168.203.31@tcp:101:rm.0 Request processed in 207us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762710.885902:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:3.0:1789762710.886776:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762710.886812:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140578432 00000100:00100000:2.0:1789762710.886817:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140578432 00000100:00100000:2.0:1789762710.886867:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:2.0:1789762710.886876:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+12:10000:x1876702140578432:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789762710.886886:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762710.886894:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56df67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4a1 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762710.886931:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789762710.886977:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56df67 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4a1 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.886985:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90800) 00010000:00010000:2.0:1789762710.886987:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789762710.886990:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56df67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4a1 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.886997:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51000, rc 0) 00000100:00100000:2.0:1789762710.887022:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+13:10000:x1876702140578432:12345-192.168.203.31@tcp:101:rm.0 Request processed in 150us (247us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1789762710.887028:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:0.0:1789762710.888297:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762710.888342:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140578560 00000100:00100000:1.0:1789762710.888347:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140578560 00000100:00100000:1.0:1789762710.888381:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1789762710.888391:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1517c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+13:10000:x1876702140578560:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:1.0:1789762710.890088:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1517c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+13:10000:x1876702140578560:12345-192.168.203.31@tcp:37:rm.0 Request processed in 1688us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762710.890097:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1789762710.891264:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.891301:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140578816 00000100:00100000:0.0:1789762710.891307:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140578816 00000100:00100000:0.0:1789762710.891344:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1789762710.891354:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+13:10000:x1876702140578816:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:0.0:1789762710.891475:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+14:10000:x1876702140578816:12345-192.168.203.31@tcp:35:rm.0 Request processed in 122us (210us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789762710.891485:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1789762710.892373:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762710.892407:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140579072 00000100:00100000:2.0:1789762710.892414:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140579072 00000100:00100000:2.0:1789762710.892456:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:2.0:1789762710.892465:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+14:10000:x1876702140579072:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789762710.892480:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762710.892487:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56df75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.892521:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56df7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.892529:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56df7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.892535:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56df7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762710.892541:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789762710.892586:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56df75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4a8 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.892596:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56df7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4a8 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.892602:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:2.0:1789762710.892604:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789762710.892606:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51c00, rc 0) 00000100:00100000:2.0:1789762710.892632:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+16:10000:x1876702140579072:12345-192.168.203.31@tcp:101:rm.0 Request processed in 169us (260us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789762710.892637:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1789762710.893380:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.893427:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140579200 00000100:00100000:0.0:1789762710.893433:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140579200 00000100:00100000:0.0:1789762710.893468:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1789762710.893476:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+16:10000:x1876702140579200:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:0.0:1789762710.893507:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789762710.893547:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+16:10000:x1876702140579200:12345-192.168.203.31@tcp:41:rm.0 Request processed in 71us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762710.893555:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1789762710.894174:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762710.894210:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140579328 00000100:00100000:2.0:1789762710.894215:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140579328 00000100:00100000:2.0:1789762710.894244:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:2.0:1789762710.894262:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+16:10000:x1876702140579328:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789762710.894272:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762710.894282:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56df8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4af expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894314:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56df91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894324:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56df91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894332:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56df91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894345:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56df98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894354:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56df98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894363:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56df98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894418:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56df9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894427:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56df9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894435:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56df9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762710.894467:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789762710.894473:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762710.894484:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56df9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894495:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56df9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894503:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56df91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894511:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56df91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894518:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56df91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894525:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762710.894529:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56df91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894537:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56df91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894548:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:2.0:1789762710.894551:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762710.894555:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56df91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894562:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56df91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894584:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56df98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894589:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56df98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894593:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56df98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894597:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762710.894599:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56df98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894602:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56df98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894608:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff95d143e3f900) 00010000:00010000:2.0:1789762710.894609:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762710.894611:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56df98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894616:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56df98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894637:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56df8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4af expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894649:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56df9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4af expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.894669:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d143e3fb00) 00010000:00010000:2.0:1789762710.894672:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762710.894675:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51200, rc 0) 00000100:00100000:2.0:1789762710.894709:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+17:10000:x1876702140579328:12345-192.168.203.31@tcp:101:rm.0 Request processed in 449us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762710.894717:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:3.0:1789762710.895628:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762710.895664:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140579584 00000100:00100000:2.0:1789762710.895670:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140579584 00000100:00100000:2.0:1789762710.895700:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:2.0:1789762710.895708:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+17:10000:x1876702140579584:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762710.895727:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762710.895735:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56df9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4af expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.895746:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56df4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e493 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.895752:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d143e3fb00) 00010000:00010000:2.0:1789762710.895758:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56df60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e49a expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.895764:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:2.0:1789762710.895766:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762710.895772:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56dfa6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.895786:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56dfa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.895791:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56dfa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.895798:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56dfad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.895803:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56dfad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.895807:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56dfad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.895868:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56dfb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.895874:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56dfb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.895880:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56dfb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762710.896338:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789762710.896346:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 115369512103ns, next at 116369510691ns, rc = 0 00010000:00010000:2.0:1789762710.896378:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56dfbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896384:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56dfbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896399:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56dfbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896407:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56dfbb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896414:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56dfbb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896420:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56dfbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896439:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762710.896452:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56dfb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.896457:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762710.896459:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56dfb4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.896464:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56dfbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896466:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56dfb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.896482:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762710.896483:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762710.896488:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56dfbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896489:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56dfb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.896510:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56dfbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896510:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56dfb4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.896535:0:6670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d143e3f300) 00010000:00010000:1.0:1789762710.896539:0:6670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789762710.896543:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56dfbb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896546:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d143e3f300) 00010000:00010000:2.0:1789762710.896552:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762710.896555:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56dfbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896563:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56dfb4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896569:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56dfb4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.896572:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762710.896577:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762710.896580:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762710.896586:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56dfa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896591:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56dfa6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896596:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56dfa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896599:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762710.896601:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56dfa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896605:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56dfa6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896609:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:2.0:1789762710.896611:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762710.896612:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56dfa6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762710.896616:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56dfa6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762710.896621:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c63c48c2 reply state 00000000d79e3728 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56dfad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762710.896633:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762710.896664:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+16:10000:x1876702140579584:12345-192.168.203.31@tcp:36:rm.0 Request processed in 958us (1037us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789762710.896669:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00010000:00010000:0.0:1789762710.897338:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56dfad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.897349:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56dfad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.897358:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56dfad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.897365:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.897369:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56dfad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.897377:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56dfad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.897388:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff95d143e3fa00) 00010000:00010000:0.0:1789762710.897391:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.897394:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56dfad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.897402:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56dfad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762710.897676:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762710.897708:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140579840 00000100:00100000:1.0:1789762710.897712:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140579840 00000100:00100000:1.0:1789762710.897741:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:1.0:1789762710.897747:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+15:10000:x1876702140579840:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:1.0:1789762710.897851:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+16:10000:x1876702140579840:12345-192.168.203.31@tcp:35:rm.0 Request processed in 85us (158us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789762710.897864:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1789762710.898515:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762710.898554:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140580096 00000100:00100000:0.0:1789762710.898566:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140580096 00000100:00100000:0.0:1789762710.898599:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:0.0:1789762710.898608:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+16:10000:x1876702140580096:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:0.0:1789762710.898631:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789762710.898642:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56df7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4a8 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.898658:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56df1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e485 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.898668:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:0.0:1789762710.898679:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4c00/0xd08452c77c56dedb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e477 expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.898688:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90800) 00010000:00010000:0.0:1789762710.898694:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762710.898705:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56dfc2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.898714:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56dfc2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.898722:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56dfc2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.898733:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4800/0xd08452c77c56dfc9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.898741:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4800/0xd08452c77c56dfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.898759:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4800/0xd08452c77c56dfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.898951:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56dfd0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.898962:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56dfd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.898971:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56dfd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762710.899402:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789762710.899412:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56dfd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.899419:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56dfd0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.899427:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56dfd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.899434:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.899437:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56dfd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.899444:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56dfd0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.899452:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d151e90b00) 00010000:00010000:0.0:1789762710.899455:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789762710.899463:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56dfd0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.899470:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56dfd0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.899486:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56dfc2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.899493:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56dfc2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.899500:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56dfc2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.899506:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762710.899509:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56dfc2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.899517:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56dfc2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.899524:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90100) 00010000:00010000:0.0:1789762710.899526:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762710.899529:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56dfc2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762710.899536:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5000/0xd08452c77c56dfc2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762710.899548:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002883c61 reply state 000000003fb847fb transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4800/0xd08452c77c56dfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762710.899566:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762710.899608:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+15:10000:x1876702140580096:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1001us (1092us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789762710.899616:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00010000:00010000:1.0:1789762710.900160:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4800/0xd08452c77c56dfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.900170:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4800/0xd08452c77c56dfc9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.900177:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4800/0xd08452c77c56dfc9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.900183:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762710.900187:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4800/0xd08452c77c56dfc9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.900195:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4800/0xd08452c77c56dfc9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.900205:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95d151e90c00) 00010000:00010000:1.0:1789762710.900208:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762710.900212:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4800/0xd08452c77c56dfc9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762710.900218:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4800/0xd08452c77c56dfc9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762711.206995:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789762711.207015:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148988416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762711.207093:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17414d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148988928:0@lo:400:kworker.0 00000100:00100000:2.0:1789762711.207099:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762711.207147:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702148988672:0@lo:400:kworker.0 00000100:00100000:3.0:1789762711.207147:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762711.207161:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17414d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702148988800:0@lo:400:kworker.0 00000100:00100000:1.0:1789762711.207195:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762711.207211:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148988416 00000100:00100000:3.0:1789762711.207219:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148988416 00000100:00100000:1.0:1789762711.207232:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17414ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148989184:0@lo:400:kworker.0 00000100:00100000:1.0:1789762711.207265:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762711.207281:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789762711.207286:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148988928 00000100:00100000:2.0:1789762711.207291:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148988928 00000100:00100000:3.0:1789762711.207293:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148988416:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762711.207298:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789762711.207305:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702148988544:0@lo:400:kworker.0 00000100:00100000:2.0:1789762711.207323:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148989184 00000100:00100000:2.0:1789762711.207327:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148989184 00002000:00000024:3.0:1789762711.207328:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762711.207339:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762711.207351:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789762711.207359:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148988928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762711.207375:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702148988416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762711.207380:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17414d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702148989056:0@lo:400:kworker.0 00000100:00100000:3.0:1789762711.207385:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789762711.207402:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762711.207409:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762711.207414:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148988928:12345-0@lo:400:kworker.0 Request processed in 55us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762711.207422:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789762711.207429:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789762711.207433:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d17414d500 x1876702148988928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762711.207444:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789762711.207450:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17414d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148988928:0@lo:400:kworker.0 00000100:00100000:2.0:1789762711.207455:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148989184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762711.207475:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148988672 00000100:00100000:0.0:1789762711.207482:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148988672 00000100:00100000:2.0:1789762711.207492:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148989184:12345-0@lo:400:kworker.0 Request processed in 41us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762711.207498:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148988544 00000100:00100000:2.0:1789762711.207499:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789762711.207506:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148988544 00000100:00100000:0.0:1789762711.207522:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148989056 00000100:00100000:0.0:1789762711.207527:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148989056 00000100:00100000:2.0:1789762711.207542:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789762711.207553:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148988672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762711.207558:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789762711.207572:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702148988544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762711.207579:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789762711.207584:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148988672:12345-0@lo:400:kworker.0 Request processed in 34us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762711.207594:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702148989056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762711.207607:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789762711.207634:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702148988544:12345-0@lo:400:kworker.0 Request processed in 65us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762711.207650:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789762711.207656:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702148989056:12345-0@lo:400:kworker.0 Request processed in 63us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762711.207666:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789762711.207700:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762711.207711:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762711.207715:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702148988544:0@lo:400:kworker.0 00000100:00100000:0.0:1789762711.207741:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148988800 00000100:00100000:1.0:1789762711.207744:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17414d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702148989056:0@lo:400:kworker.0 00000100:00100000:0.0:1789762711.207747:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148988800 00010000:00080000:2.0:1789762711.207757:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d1742e8700 x1876702148988416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762711.207765:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702148988672:0@lo:400:kworker.0 00000100:00100000:2.0:1789762711.207777:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148988416:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789762711.207787:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d17414ca80 x1876702148989184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762711.207799:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789762711.207801:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17414ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148989184:0@lo:400:kworker.0 00000100:00100000:0.0:1789762711.207814:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702148988800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762711.207877:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762711.207898:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702148988800:12345-0@lo:400:kworker.0 Request processed in 87us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762711.207907:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789762711.207945:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17414d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702148988800:0@lo:400:kworker.0 00000100:00100000:3.0:1789762711.412392:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762711.412434:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762711.412451:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140580224 00000100:00100000:2.0:1789762711.412462:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140580224 00000100:00100000:3.0:1789762711.412469:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762711.412503:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140580352 00000100:00100000:0.0:1789762711.412511:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140580352 00000100:00100000:3.0:1789762711.412511:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762711.412516:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:2.0:1789762711.412533:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140580224:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762711.412543:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140580608 00000100:00100000:1.0:1789762711.412549:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140580608 00000100:00100000:3.0:1789762711.412556:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762711.412569:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:0.0:1789762711.412583:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+14:2342:x1876702140580352:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762711.412609:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:3.0:1789762711.412611:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762711.412619:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140580224:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762711.412627:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140580608:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762711.412633:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:0.0:1789762711.412645:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+14:2342:x1876702140580352:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 64us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762711.412655:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1789762711.412673:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140580608:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 53us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762711.412678:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140580480 00000100:00100000:2.0:1789762711.412685:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140580480 00000100:00100000:1.0:1789762711.412691:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:1.0:1789762711.412722:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140580864 00000100:00100000:1.0:1789762711.412726:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140580864 00000100:00100000:2.0:1789762711.412727:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140580736 00000100:00080000:0.0:1789762711.412732:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762711.412733:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140580736 00000100:00080000:0.0:1789762711.412740:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762711.412759:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00080000:0.0:1789762711.412769:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762711.412770:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140580480:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762711.412813:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140580480:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 48us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762711.412818:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1789762711.412830:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1789762711.412867:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140580864:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762711.412887:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1789762711.412894:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140580736:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762711.412908:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140580864:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 78us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762711.412919:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1789762711.412936:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140580736:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 45us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762711.412945:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00010000:00010000:1.0:1789762711.590932:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762711.718941:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148989312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762711.719004:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762711.719052:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148989312 00000100:00100000:1.0:1789762711.719061:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148989312 00000100:00100000:1.0:1789762711.719117:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789762711.719126:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148989312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762711.719147:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762711.719200:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148989312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762711.719206:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789762711.719222:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d174166a00 x1876702148989312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789762711.719237:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148989312:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789762711.812619:0:11659:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 16:18:30 (1789762710) 00000100:00100000:0.0:1789762712.206920:0:11707:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:0.0:1789762712.206929:0:11707:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d150d2d100 rate 10000 gen 0 00000100:00100000:0.0:1789762712.206959:0:11707:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:0.0:1789762712.206962:0:11707:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d150d2dc00 rate 10000 gen 0 00000100:00100000:0.0:1789762712.207085:0:11707:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X8, dynamic 0, field: uid, str: 500 00000100:00100000:0.0:1789762712.207093:0:11707:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:0.0:1789762712.207097:0:11707:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X8, dynamic 0, field: uid, str: 500 00000100:00100000:0.0:1789762712.207100:0:11707:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d143031300 rate 5 gen 0 00000100:00100000:0.0:1789762712.207102:0:11707:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:0.0:1789762712.207105:0:11707:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X8, dynamic 0, field: uid, str: 500 00000100:00100000:0.0:1789762712.207108:0:11707:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d173f25300 rate 5 gen 0 00000100:00100000:3.0:1789762712.216264:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762712.216306:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140580992 00000100:00100000:1.0:1789762712.216316:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140580992 00000100:00080000:2.0:1789762712.216370:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762712.216389:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1789762712.216400:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+14:10395:x1876702140580992:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:1.0:1789762712.216417:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762712.216434:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cdc00/0xd08452c77c56dfd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4b6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.216483:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56dfde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.216503:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56dfde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.216514:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56dfde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762712.216545:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789762712.216548:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762712.216566:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56dfde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.216587:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cdc00/0xd08452c77c56dfd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4b6 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.216600:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56dfde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4b6 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.216607:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2100) 00010000:00010000:1.0:1789762712.216610:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762712.216613:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cca00, rc 0) 00000100:00100000:1.0:1789762712.216663:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+15:10395:x1876702140580992:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 267us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762712.216671:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1789762712.217711:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.217738:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140581248 00000100:00100000:3.0:1789762712.217744:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140581248 00000100:00100000:3.0:1789762712.217783:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:3.0:1789762712.217790:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+15:10395:x1876702140581248:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:3.0:1789762712.217818:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762712.217903:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56dfde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4b6 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.217920:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2100) 00010000:00010000:3.0:1789762712.217931:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762712.217981:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56dfe5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.217992:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56dfe5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.218002:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56dfe5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.218017:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56dfec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.218026:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56dfec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.218035:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56dfec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762712.218671:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789762712.218679:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56dfe5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.218685:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56dfe5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.218690:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56dfe5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.218694:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762712.218697:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56dfe5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.218704:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56dfe5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.218711:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d100) 00010000:00010000:3.0:1789762712.218713:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762712.218716:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56dfe5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.218720:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56dfe5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762712.218731:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077502670 reply state 00000000efe30b1f transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56dfec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762712.218738:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762712.218783:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+16:10395:x1876702140581248:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 994us (1076us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789762712.218798:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00010000:00010000:0.0:1789762712.219296:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56dfec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.219305:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56dfec lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.219310:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56dfec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.219321:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762712.219324:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56dfec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.219329:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56dfec lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.219338:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d15055d300) 00010000:00010000:0.0:1789762712.219340:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762712.219342:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56dfec lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.219346:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56dfec lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762712.223749:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.223819:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140581376 00000100:00100000:3.0:1789762712.223825:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140581376 00000100:00100000:3.0:1789762712.223887:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:3.0:1789762712.223897:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+15:10396:x1876702140581376:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762712.223908:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762712.223918:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56dff3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.223948:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56dffa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.223956:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56dffa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.223963:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56dffa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762712.223978:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789762712.223981:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762712.224014:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56dffa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.224036:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56dff3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4bd expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.224052:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56dffa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4bd expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.224078:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d100) 00010000:00010000:3.0:1789762712.224080:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762712.224083:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a8200, rc 0) 00000100:00100000:3.0:1789762712.224117:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+16:10396:x1876702140581376:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 222us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762712.224123:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:3.0:1789762712.225116:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762712.225160:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140581632 00000100:00100000:1.0:1789762712.225179:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140581632 00000100:00100000:1.0:1789762712.225222:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:1.0:1789762712.225232:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+16:10396:x1876702140581632:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789762712.225241:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762712.225249:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789762712.225261:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56dffa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4bd expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225272:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d100) 00010000:00010000:1.0:1789762712.225279:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762712.225287:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc800/0xd08452c77c56e001 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4c4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225355:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e008 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225362:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e008 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225368:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e008 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225377:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e00f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225382:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e00f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225387:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e00f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225429:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e016 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225435:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225449:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762712.225455:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789762712.225464:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225469:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e016 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225474:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e016 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225477:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cd200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762712.225479:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e016 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225484:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e016 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225489:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d14abf2300) 00010000:00010000:1.0:1789762712.225491:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762712.225493:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e016 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225497:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e016 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225508:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e008 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225512:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e008 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225520:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e008 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225524:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762712.225526:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e008 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225530:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e008 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225535:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:1.0:1789762712.225537:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762712.225539:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225542:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225550:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e00f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225554:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e00f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225558:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e00f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225562:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cd600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762712.225563:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e00f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225576:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e00f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225583:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d14abf2b00) 00010000:00010000:1.0:1789762712.225585:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762712.225586:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e00f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225590:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e00f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225606:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc800/0xd08452c77c56e001 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4c4 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225612:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:1.0:1789762712.225614:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762712.225616:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc800/0xd08452c77c56e001 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4c4 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.225624:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cc800, rc 0) 00000100:00100000:1.0:1789762712.225654:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+15:10396:x1876702140581632:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 426us (542us total) trans 0 rc 301/301 00000100:00100000:1.0:1789762712.225661:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:1.0:1789762712.226397:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.226432:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140581760 00000100:00100000:3.0:1789762712.226438:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140581760 00000100:00100000:3.0:1789762712.226485:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1789762712.226497:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+15:10396:x1876702140581760:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762712.226505:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762712.226514:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e01d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4cb expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.226542:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56e024 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.226553:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56e024 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.226563:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56e024 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762712.226590:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789762712.226594:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762712.226607:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56e024 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.226635:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e01d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4cb expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.226650:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56e024 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4cb expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.226659:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d800) 00010000:00010000:3.0:1789762712.226662:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762712.226665:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9c00, rc 0) 00000100:00100000:3.0:1789762712.226700:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+16:10396:x1876702140581760:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 207us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762712.226705:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:2.0:1789762712.227501:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.227535:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140582016 00000100:00100000:3.0:1789762712.227542:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140582016 00000100:00100000:3.0:1789762712.227580:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1789762712.227590:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+16:10396:x1876702140582016:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762712.227600:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762712.227610:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e02b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4d2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227642:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e032 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227652:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e032 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227662:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e032 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227681:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e039 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227690:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227699:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762712.227751:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789762712.227803:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e032 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227807:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e032 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227812:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e032 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227815:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762712.227818:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e032 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227823:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e032 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227830:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d800) 00010000:00010000:3.0:1789762712.227860:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762712.227863:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e032 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227877:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e032 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227887:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227892:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e039 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227896:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e039 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227899:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762712.227901:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e039 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227905:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e039 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227911:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d15055d000) 00010000:00010000:3.0:1789762712.227913:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762712.227915:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e039 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227918:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e039 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227941:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e02b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4d2 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227957:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d800) 00010000:00010000:3.0:1789762712.227959:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762712.227962:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e02b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4d2 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.227970:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9e00, rc 0) 00000100:00100000:3.0:1789762712.228002:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+17:10396:x1876702140582016:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 414us (504us total) trans 4294967310 rc 301/301 00000100:00100000:3.0:1789762712.228009:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:1.0:1789762712.228732:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.228810:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140582272 00000100:00100000:2.0:1789762712.228820:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140582272 00000100:00100000:2.0:1789762712.228908:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:2.0:1789762712.228920:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+17:10396:x1876702140582272:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:2.0:1789762712.228998:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e047 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.229011:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e047 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.229020:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e047 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762712.229218:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5f709e7 reply state 00000000a0e1771b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e047 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762712.229226:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762712.229233:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000100:00100000:2.0:1789762712.229306:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+19:10396:x1876702140582272:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 390us (575us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789762712.229312:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00010000:00010000:3.0:1789762712.229914:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e047 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.229926:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e047 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.229992:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e047 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.230001:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762712.230007:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e047 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.230016:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e047 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.230029:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f300) 00010000:00010000:3.0:1789762712.230036:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789762712.230040:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e047 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.230055:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e047 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762712.230062:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.230121:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140582528 00000100:00100000:2.0:1789762712.230126:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140582528 00000100:00100000:2.0:1789762712.230160:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1789762712.230167:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+18:10396:x1876702140582528:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1789762712.230282:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+19:10396:x1876702140582528:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 116us (226us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789762712.230288:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1789762712.233664:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.233698:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140582656 00000100:00100000:3.0:1789762712.233703:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140582656 00000100:00100000:3.0:1789762712.233736:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:3.0:1789762712.233744:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+19:10397:x1876702140582656:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:3.0:1789762712.233755:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762712.233764:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56e04e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4d9 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233792:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e055 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233800:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e055 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233806:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e055 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233814:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e05c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233819:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e05c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233824:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e05c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233891:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e063 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233902:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233907:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762712.233923:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789762712.233925:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762712.233937:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233943:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e055 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233948:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e055 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233952:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e055 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233956:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762712.233958:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e055 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233962:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e055 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233968:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d800) 00010000:00010000:3.0:1789762712.233970:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762712.233973:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e055 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233985:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e055 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.233998:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e05c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.234002:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e05c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.234007:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e05c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.234010:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762712.234013:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e05c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.234018:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e05c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.234024:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d15055d100) 00010000:00010000:3.0:1789762712.234026:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762712.234028:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e05c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.234032:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e05c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.234054:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56e04e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4d9 expref: 21 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.234061:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4d9 expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.234085:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d15055d300) 00010000:00010000:3.0:1789762712.234087:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762712.234089:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9600, rc 0) 00000100:00100000:3.0:1789762712.234123:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+20:10397:x1876702140582656:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 380us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762712.234129:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1789762712.235057:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.235098:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140582912 00000100:00100000:3.0:1789762712.235102:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140582912 00000100:00100000:3.0:1789762712.235133:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:3.0:1789762712.235144:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+20:10397:x1876702140582912:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:3.0:1789762712.235165:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762712.235175:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e063 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4d9 expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.235183:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d15055d300) 00010000:00010000:3.0:1789762712.235187:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762712.235202:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e06a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.235208:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e06a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.235215:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e06a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762712.235337:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ab9d1ce reply state 00000000847f2d62 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e06a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762712.235353:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762712.235357:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000100:00100000:3.0:1789762712.235400:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+21:10397:x1876702140582912:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 260us (345us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789762712.235405:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00010000:00010000:3.0:1789762712.235907:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e06a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.235914:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e06a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.235918:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e06a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.235921:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762712.235924:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e06a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.235929:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e06a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.235936:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d15055d200) 00010000:00010000:3.0:1789762712.235938:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789762712.235940:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e06a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.235945:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e06a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762712.248335:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.248380:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140583040 00000100:00100000:2.0:1789762712.248385:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140583040 00000100:00100000:2.0:1789762712.248435:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1789762712.248458:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+20:10401:x1876702140583040:12345-192.168.203.31@tcp:101:touch.0 00010000:00010000:2.0:1789762712.248474:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762712.248493:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4e0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248543:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e078 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248554:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e078 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248561:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e078 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248577:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e07f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248584:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e07f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248590:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e07f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248691:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e086 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248698:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248706:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762712.248739:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789762712.248742:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762712.248777:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248786:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e078 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248791:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e078 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248797:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e078 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248803:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762712.248807:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e078 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248813:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e078 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.248828:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d800) 00010000:00010000:2.0:1789762712.249202:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762712.249209:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e078 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.249214:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e078 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.249230:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e07f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.249243:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e07f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.249248:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e07f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.249253:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762712.249257:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e07f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.249263:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e07f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.249275:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d143e3f900) 00010000:00010000:2.0:1789762712.249277:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762712.249280:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e07f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.249285:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e07f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.249326:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4e0 expref: 22 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.249342:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e086 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4e0 expref: 21 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.249347:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:2.0:1789762712.249349:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789762712.249357:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50200, rc 0) 00000100:00100000:2.0:1789762712.249407:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+21:10401:x1876702140583040:12345-192.168.203.31@tcp:101:touch.0 Request processed in 954us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762712.249416:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:1.0:1789762712.250362:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762712.250399:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140583296 00000100:00100000:1.0:1789762712.250406:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140583296 00000100:00100000:1.0:1789762712.250448:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:1.0:1789762712.250458:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+21:10401:x1876702140583296:12345-192.168.203.31@tcp:101:touch.0 00010000:00010000:1.0:1789762712.250473:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762712.250484:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e08d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4e7 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.250558:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e094 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.250568:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e094 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.250575:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e094 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.250591:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e09b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.250598:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e09b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.250604:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e09b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789762712.251057:0:6681:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00000004:00080000:1.0:1789762712.251082:0:6681:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789762712.251258:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cda00/0xd08452c77c56e0a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.251275:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cda00/0xd08452c77c56e0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.251283:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cda00/0xd08452c77c56e0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.251308:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e094 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.251314:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e094 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.251319:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e094 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.251324:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cd200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762712.251326:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e094 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.251331:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e094 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.251343:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:1.0:1789762712.251346:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762712.251350:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e094 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.251356:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e094 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762712.251367:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b7283f5 reply state 00000000cffaabe5 transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e09b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762712.251381:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789762712.251412:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e08d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4e7 expref: 24 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.251426:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cda00/0xd08452c77c56e0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4e7 expref: 23 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.251432:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d14abf2b00) 00010000:00010000:1.0:1789762712.251434:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762712.251436:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cda00, rc 0) 00000100:00100000:1.0:1789762712.251477:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+24:10401:x1876702140583296:12345-192.168.203.31@tcp:101:touch.0 Request processed in 1023us (1119us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789762712.251482:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00010000:00010000:1.0:1789762712.252044:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e09b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.252051:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e09b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.252056:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e09b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.252060:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cce00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762712.252063:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e09b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.252085:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e09b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.252109:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf4d4877e (ffff95d14abf2e00) 00010000:00010000:1.0:1789762712.252113:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762712.252117:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e09b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.252124:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e09b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762712.252585:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.252618:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140583552 00000100:00100000:3.0:1789762712.252630:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140583552 00000100:00100000:3.0:1789762712.252662:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:3.0:1789762712.252708:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+23:10401:x1876702140583552:12345-192.168.203.31@tcp:36:touch.0 00010000:00010000:3.0:1789762712.252738:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762712.252754:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cda00/0xd08452c77c56e0a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4e7 expref: 23 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.252768:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d14abf2b00) 00010000:00010000:3.0:1789762712.252775:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762712.252796:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.252806:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.252815:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762712.252907:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000240f50a4 reply state 0000000012595ed3 transno 4294967315 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762712.252915:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762712.252964:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+24:10401:x1876702140583552:12345-192.168.203.31@tcp:36:touch.0 Request processed in 295us (378us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789762712.252970:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00010000:00010000:3.0:1789762712.253565:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.253576:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762712.253597:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:3.0:1789762712.253600:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.253608:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762712.253612:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.253620:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762712.253631:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140583680 00000100:00100000:2.0:1789762712.253637:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140583680 00000100:00100000:2.0:1789762712.253672:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00010000:00010000:3.0:1789762712.253679:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d15055d200) 00000100:00100000:2.0:1789762712.253684:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+24:10401:x1876702140583680:12345-192.168.203.31@tcp:101:touch.0 00010000:00010000:3.0:1789762712.253690:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762712.253697:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.253698:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762712.253709:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e0b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4ee expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.253710:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.253758:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e0b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4ee expref: 24 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.253767:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e0b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4ee expref: 24 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.253779:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d15055d200) 00010000:00010000:2.0:1789762712.253781:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789762712.253783:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50800, rc 0) 00000100:00100000:2.0:1789762712.253817:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+24:10401:x1876702140583680:12345-192.168.203.31@tcp:101:touch.0 Request processed in 136us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762712.253826:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1789762712.254750:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.254794:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140583808 00000100:00100000:3.0:1789762712.254801:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140583808 00000100:00100000:3.0:1789762712.255001:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1789762712.255016:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140583808:12345-192.168.203.31@tcp:2:touch.0 00000100:00100000:3.0:1789762712.255528:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140583808:12345-192.168.203.31@tcp:2:touch.0 Request processed in 514us (776us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789762712.255544:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00080000:3.0:1789762712.255601:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762712.256049:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.256111:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140583936 00000100:00100000:3.0:1789762712.256118:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140583936 00000100:00100000:3.0:1789762712.256153:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1789762712.256168:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1876702140583936:12345-192.168.203.31@tcp:8:touch.0 00010000:00080000:3.0:1789762712.256194:0:8803:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp t0 exp 0000000000000000 cur 116 last 0 00000020:00000080:3.0:1789762712.256242:0:8803:0:(genops.c:1385:class_connect()) connect: client 77777931-b235-4c03-82d2-4b1d12553008, cookie 0xd08452c77c56e0be 00002000:00100000:3.0:1789762712.256253:0:8803:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 77777931-b235-4c03-82d2-4b1d12553008/ffff95d158869000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789762712.256266:0:8803:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789762712.256814:0:8803:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789762712.256880:0:8803:0:(import.c:65:import_set_state_nolock()) ffff95d15886a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789762712.256931:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2341:x1876702140583936:12345-192.168.203.31@tcp:8:touch.0 Request processed in 760us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762712.256946:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1789762712.257674:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762712.257722:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140584064 00000100:00100000:1.0:1789762712.257729:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140584064 00000100:00080000:3.0:1789762712.257765:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762712.257805:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:3.0:1789762712.257820:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+6:0:x1876702140584064:12345-192.168.203.31@tcp:2:touch.0 00000001:00080000:0.0:1789762712.267464:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1789762712.267475:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000100:00100000:3.0:1789762712.267510:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:0:x1876702140584064:12345-192.168.203.31@tcp:2:touch.0 Request processed in 9695us (9844us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789762712.267516:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1789762712.268408:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762712.268445:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140584320 00000100:00100000:0.0:1789762712.268452:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140584320 00000100:00100000:0.0:1789762712.268479:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1789762712.268486:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+24:10401:x1876702140584320:12345-192.168.203.31@tcp:35:touch.0 00000100:00100000:0.0:1789762712.268638:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+25:10401:x1876702140584320:12345-192.168.203.31@tcp:35:touch.0 Request processed in 152us (230us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789762712.268644:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:1.0:1789762712.283926:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.283972:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140584576 00000100:00100000:3.0:1789762712.283980:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140584576 00000100:00100000:3.0:1789762712.284014:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:3.0:1789762712.284022:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+25:10405:x1876702140584576:12345-192.168.203.31@tcp:101:touch.0 00010000:00010000:3.0:1789762712.284036:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762712.284050:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4f5 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284152:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284163:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284171:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284180:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56e0d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284184:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56e0d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284189:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56e0d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762712.284507:0:6681:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00000004:00080000:3.0:1789762712.284513:0:6681:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789762712.284610:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e0da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284617:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e0da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284622:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e0da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284643:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284653:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284658:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284662:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762712.284665:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284670:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284678:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:3.0:1789762712.284680:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762712.284683:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284687:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762712.284695:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6620ae7 reply state 00000000f5e3f5a3 transno 4294967317 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56e0d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762712.284700:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789762712.284718:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4f5 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284727:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e0da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4f5 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.284741:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d15055d300) 00010000:00010000:3.0:1789762712.284742:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762712.284744:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a8a00, rc 0) 00000100:00100000:3.0:1789762712.284783:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+28:10405:x1876702140584576:12345-192.168.203.31@tcp:101:touch.0 Request processed in 763us (861us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789762712.284788:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00010000:00010000:1.0:1789762712.285315:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56e0d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.285324:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56e0d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.285329:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56e0d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.285332:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762712.285335:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56e0d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.285339:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56e0d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.285353:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x636661f9 (ffff95d15055d700) 00010000:00010000:1.0:1789762712.285355:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762712.285357:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56e0d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762712.285362:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56e0d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762712.285816:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.285907:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140584832 00000100:00100000:2.0:1789762712.285912:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140584832 00000100:00100000:2.0:1789762712.285942:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:2.0:1789762712.285949:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+27:10405:x1876702140584832:12345-192.168.203.31@tcp:36:touch.0 00010000:00010000:2.0:1789762712.285979:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762712.285991:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56e0da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4f5 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.286003:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d15055d300) 00010000:00010000:2.0:1789762712.286010:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762712.286031:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e0e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.286043:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.286052:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762712.286118:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047ffbd23 reply state 0000000074a3a374 transno 4294967318 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762712.286124:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762712.286166:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+28:10405:x1876702140584832:12345-192.168.203.31@tcp:36:touch.0 Request processed in 218us (351us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789762712.286172:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00010000:00010000:0.0:1789762712.286587:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.286594:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e0e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.286604:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e0e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.286608:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762712.286610:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e0e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.286614:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e0e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.286621:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d143e3f100) 00010000:00010000:0.0:1789762712.286623:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762712.286625:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e0e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.286628:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e0e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762712.286776:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.286813:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140584960 00000100:00100000:2.0:1789762712.286819:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140584960 00000100:00100000:2.0:1789762712.286873:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1789762712.286883:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+27:10405:x1876702140584960:12345-192.168.203.31@tcp:101:touch.0 00010000:00010000:2.0:1789762712.286892:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762712.286900:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e0ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e4fc expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.286933:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e0ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4fc expref: 28 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.286940:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e0ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4fc expref: 28 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.286951:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d143e3f900) 00010000:00010000:2.0:1789762712.286953:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789762712.286954:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51600, rc 0) 00000100:00100000:2.0:1789762712.286980:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+28:10405:x1876702140584960:12345-192.168.203.31@tcp:101:touch.0 Request processed in 101us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762712.286984:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:3.0:1789762712.287722:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.287756:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.287759:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140585088 00000100:00100000:2.0:1789762712.287764:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140585088 00000100:00100000:2.0:1789762712.287793:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140585216 00000100:00100000:2.0:1789762712.287796:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140585216 00000100:00100000:1.0:1789762712.287800:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1789762712.287813:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140585088:12345-192.168.203.31@tcp:2:touch.0 00000100:00100000:3.0:1789762712.287815:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:3.0:1789762712.287829:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140585216:12345-192.168.203.31@tcp:2:touch.0 00000100:00100000:3.0:1789762712.288033:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140585216:12345-192.168.203.31@tcp:2:touch.0 Request processed in 207us (277us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789762712.288040:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1789762712.288103:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140585088:12345-192.168.203.31@tcp:2:touch.0 Request processed in 293us (379us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789762712.288109:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1789762712.288848:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.288875:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140585472 00000100:00100000:2.0:1789762712.288879:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140585472 00000100:00100000:2.0:1789762712.288905:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1789762712.288910:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+28:10405:x1876702140585472:12345-192.168.203.31@tcp:35:touch.0 00000100:00100000:2.0:1789762712.289033:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+29:10405:x1876702140585472:12345-192.168.203.31@tcp:35:touch.0 Request processed in 121us (201us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789762712.289039:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1789762712.301041:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.301089:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140585728 00000100:00100000:3.0:1789762712.301095:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140585728 00000100:00100000:3.0:1789762712.301124:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:3.0:1789762712.301130:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+29:10409:x1876702140585728:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1789762712.301142:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762712.301151:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e503 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.301193:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.301201:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.301215:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762712.301223:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789762712.301277:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e0f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e503 expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.301288:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e503 expref: 31 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.301294:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:3.0:1789762712.301296:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789762712.301298:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9600, rc 0) 00000100:00100000:3.0:1789762712.301328:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+31:10409:x1876702140585728:12345-192.168.203.31@tcp:101:bash.0 Request processed in 199us (289us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789762712.301333:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:3.0:1789762712.302174:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.302202:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140585856 00000100:00100000:2.0:1789762712.302207:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140585856 00000100:00100000:2.0:1789762712.302241:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1789762712.302247:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+31:10409:x1876702140585856:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1789762712.302256:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762712.302264:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e10b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e50a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.302294:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56e112 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.302301:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56e112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.302307:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56e112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762712.302321:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789762712.302324:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762712.302333:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56e112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.302346:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e10b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e50a expref: 33 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.302355:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56e112 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e50a expref: 32 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.302361:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:2.0:1789762712.302363:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762712.302364:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50000, rc 0) 00000100:00100000:2.0:1789762712.302392:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+32:10409:x1876702140585856:12345-192.168.203.31@tcp:101:bash.0 Request processed in 146us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762712.302403:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:1.0:1789762712.303577:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762712.303619:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140585984 00000100:00100000:0.0:1789762712.303625:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140585984 00000100:00100000:0.0:1789762712.303652:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1789762712.303658:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1517c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+32:10409:x1876702140585984:12345-192.168.203.31@tcp:37:bash.0 00000100:00100000:0.0:1789762712.305294:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1517c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+32:10409:x1876702140585984:12345-192.168.203.31@tcp:37:bash.0 Request processed in 1636us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762712.305300:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1789762712.309627:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.309671:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140586112 00000100:00100000:2.0:1789762712.309677:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140586112 00000100:00100000:2.0:1789762712.309709:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:2.0:1789762712.309716:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+32:10409:x1876702140586112:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:2.0:1789762712.309725:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762712.309734:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56e119 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e511 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309765:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e120 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309773:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e120 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309779:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e120 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309788:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e127 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309793:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309797:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309898:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e12e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309914:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e12e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309920:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e12e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762712.309940:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00000004:00200000:2.0:1789762712.309942:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762712.309962:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e12e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309970:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e12e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309976:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e120 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309980:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e120 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309985:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e120 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309989:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762712.309992:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e120 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.309997:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e120 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.310005:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:2.0:1789762712.310008:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762712.310019:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e120 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.310026:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e120 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.310038:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.310047:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e127 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.310054:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.310059:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762712.310062:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.310077:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e127 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.310085:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf4d4877e (ffff95d143e3f700) 00010000:00010000:2.0:1789762712.310086:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762712.310089:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e127 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.310093:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e127 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.310113:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56e119 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e511 expref: 34 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.310131:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e12e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e511 expref: 33 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.310136:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d15055d200) 00010000:00010000:2.0:1789762712.310138:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762712.310140:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51c00, rc 0) 00000100:00100000:2.0:1789762712.310170:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+33:10409:x1876702140586112:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 455us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762712.310174:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:1.0:1789762712.311216:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.311289:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140586240 00000100:00100000:3.0:1789762712.311294:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140586240 00000100:00100000:3.0:1789762712.311326:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1789762712.311334:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.311339:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140586240:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:3.0:1789762712.311348:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789762712.311358:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140586368 00010000:00010000:3.0:1789762712.311361:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c56e135 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e518 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762712.311364:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140586368 00002000:00010000:3.0:1789762712.311381:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x6aad9c97, atime: 0x6aad9c97, ctime: 0x6aad9c97, blocks: 0x1 00000100:00100000:2.0:1789762712.311403:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1789762712.311411:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140586368:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:2.0:1789762712.311419:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762712.311430:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051cc8bcb/0xd08452c77c56e13c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e51f expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762712.311451:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aad9c97, atime: 0x6aad9c97, ctime: 0x6aad9c97, blocks: 0x1 00010000:00010000:3.0:1789762712.311454:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=116s v=(0 0) 00010000:00010000:2.0:1789762712.311461:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=116s v=(0 0) 00010000:00010000:3.0:1789762712.311462:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762712.311470:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762712.311481:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c56e135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e518 expref: 8 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.311482:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051cc8bcb/0xd08452c77c56e13c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e51f expref: 7 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.311515:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051cc8bcb/0xd08452c77c56e13c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e51f expref: 7 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.311522:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c56e135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e518 expref: 8 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.311532:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9000, rc 0) 00010000:00010000:2.0:1789762712.311546:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50c00, rc 0) 00000100:00100000:3.0:1789762712.311563:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140586240:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 230us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762712.311569:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1789762712.311581:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+7:2345:x1876702140586368:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 161us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762712.311588:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1789762712.312694:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.312728:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140586624 00000100:00100000:3.0:1789762712.312733:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140586624 00000100:00100000:3.0:1789762712.312758:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1789762712.312763:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+33:10409:x1876702140586624:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:3.0:1789762712.312787:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762712.312798:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e12e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e511 expref: 33 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.312809:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d15055d200) 00010000:00010000:3.0:1789762712.312811:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762712.312823:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e143 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.312860:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e143 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.312878:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e143 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762712.313026:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c7a4635 reply state 00000000efb5c037 transno 4294967321 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e143 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762712.313032:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762712.313091:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+34:10409:x1876702140586624:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 327us (397us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789762712.313097:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00010000:00010000:3.0:1789762712.313628:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e143 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.313637:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e143 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.313645:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e143 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.313651:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762712.313655:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e143 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.313662:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e143 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.313673:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d15055d200) 00010000:00010000:3.0:1789762712.313676:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789762712.313680:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e143 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.313759:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e143 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762712.313793:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762712.313943:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.313962:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140586752 00000100:00100000:3.0:1789762712.313969:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140586752 00000100:00100000:2.0:1789762712.313984:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140586880 00000100:00100000:2.0:1789762712.313991:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140586880 00000100:00100000:3.0:1789762712.314003:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1789762712.314014:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140586752:12345-192.168.203.31@tcp:2:chmod.0 00000100:00100000:2.0:1789762712.314031:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1789762712.314044:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16fbff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+7:2345:x1876702140586880:12345-192.168.203.31@tcp:2:chmod.0 00002000:00010000:3.0:1789762712.314155:0:8803:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789762712.314159:0:8803:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789762711 -> 1789762711 00002000:00010000:3.0:1789762712.314161:0:8803:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789762711 -> 1789762711 00002000:00010000:3.0:1789762712.314163:0:8803:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789762711 -> 1789762711 00002000:00010000:3.0:1789762712.314165:0:8803:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1789762712.314184:0:6655:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789762712.314187:0:6655:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 1789762711 -> 1789762711 00002000:00010000:2.0:1789762712.314189:0:6655:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 1789762711 -> 1789762711 00002000:00010000:2.0:1789762712.314191:0:6655:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 1789762711 -> 1789762711 00002000:00010000:2.0:1789762712.314194:0:6655:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789762712.314200:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140586752:12345-192.168.203.31@tcp:2:chmod.0 Request processed in 187us (405us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789762712.314212:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1789762712.314225:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16fbff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140586880:12345-192.168.203.31@tcp:2:chmod.0 Request processed in 183us (280us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789762712.314234:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1789762712.315140:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.315172:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140587008 00000100:00100000:2.0:1789762712.315177:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140587008 00000100:00100000:2.0:1789762712.315205:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1789762712.315213:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+33:10409:x1876702140587008:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:2.0:1789762712.315224:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762712.315234:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e14a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e526 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315290:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e151 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315298:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315304:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315312:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e158 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315318:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315322:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315356:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e15f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315362:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e15f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315366:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e15f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762712.315381:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 0 00000004:00200000:2.0:1789762712.315383:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762712.315390:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e15f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315405:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e15f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315410:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315415:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e151 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315418:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e151 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315422:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762712.315424:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e151 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315428:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e151 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315434:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:2.0:1789762712.315436:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762712.315438:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e151 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315443:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e151 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315449:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315453:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e158 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315463:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315469:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762712.315473:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315480:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e158 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315489:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x636661f9 (ffff95d143e3fb00) 00010000:00010000:2.0:1789762712.315491:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762712.315495:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e158 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315502:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e158 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315525:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e14a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e526 expref: 35 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315534:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e15f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e526 expref: 34 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.315546:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d143e3f900) 00010000:00010000:2.0:1789762712.315548:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762712.315550:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50e00, rc 0) 00000100:00100000:2.0:1789762712.315577:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+34:10409:x1876702140587008:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 364us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762712.315594:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:1.0:1789762712.316592:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.316642:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140587136 00000100:00100000:1.0:1789762712.316647:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.316649:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140587136 00000100:00100000:2.0:1789762712.316678:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140587264 00000100:00100000:2.0:1789762712.316681:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140587264 00000100:00100000:2.0:1789762712.316702:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1789762712.316711:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2342:x1876702140587136:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:2.0:1789762712.316719:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789762712.316721:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00010000:00010000:2.0:1789762712.316731:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dfac489/0xd08452c77c56e166 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e52d expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762712.316740:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+9:2343:x1876702140587264:12345-192.168.203.31@tcp:101:chmod.0 00002000:00010000:2.0:1789762712.316749:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x6aad9c97, atime: 0x6aad9c97, ctime: 0x6aad9c97, blocks: 0x1 00010000:00010000:0.0:1789762712.316751:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762712.316759:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=116s v=(0 0) 00010000:00010000:2.0:1789762712.316763:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762712.316769:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dfac489/0xd08452c77c56e166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e52d expref: 9 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.316774:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e16d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e534 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.316780:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004dfac489/0xd08452c77c56e166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e52d expref: 9 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.316799:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f8c00, rc 0) 00002000:00010000:0.0:1789762712.316806:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x6aad9c97, atime: 0x6aad9c97, ctime: 0x6aad9c97, blocks: 0x1 00010000:00010000:0.0:1789762712.316820:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=116s v=(0 0) 00010000:00010000:0.0:1789762712.316824:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762712.316860:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e16d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e534 expref: 10 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762712.316867:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+9:2342:x1876702140587136:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 124us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762712.316881:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00010000:00010000:0.0:1789762712.316889:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e16d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e534 expref: 10 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.316901:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f5e00, rc 0) 00000100:00100000:0.0:1789762712.316936:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+10:2343:x1876702140587264:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 204us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762712.316946:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:1.0:1789762712.317866:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.317901:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140587520 00000100:00100000:2.0:1789762712.317906:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140587520 00000100:00100000:2.0:1789762712.317936:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:2.0:1789762712.317943:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+34:10409:x1876702140587520:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:2.0:1789762712.317961:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762712.317970:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e15f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e526 expref: 34 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.317986:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d143e3f900) 00010000:00010000:2.0:1789762712.317989:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762712.317999:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e174 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.318006:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.318011:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762712.318121:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5fea1e2 reply state 00000000ab951cc9 transno 4294967322 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762712.318128:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762712.318166:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+35:10409:x1876702140587520:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 224us (302us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789762712.318171:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00010000:00010000:0.0:1789762712.318662:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.318669:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e174 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.318673:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e174 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.318677:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762712.318679:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e174 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.318691:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e174 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.318698:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d143e3f900) 00010000:00010000:0.0:1789762712.318700:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789762712.318702:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e174 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.318706:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e174 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762712.318861:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.318883:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140587648 00000100:00100000:2.0:1789762712.318888:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140587648 00000100:00100000:1.0:1789762712.318908:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.318921:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140587776 00000100:00100000:2.0:1789762712.318924:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140587776 00000100:00100000:3.0:1789762712.318933:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:3.0:1789762712.318945:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140587648:12345-192.168.203.31@tcp:2:chmod.0 00000100:00100000:2.0:1789762712.318956:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:2.0:1789762712.318966:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+10:2344:x1876702140587776:12345-192.168.203.31@tcp:2:chmod.0 00002000:00010000:3.0:1789762712.319028:0:10283:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789762712.319032:0:10283:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789762711 -> 1789762711 00002000:00010000:3.0:1789762712.319034:0:10283:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789762711 -> 1789762711 00002000:00010000:3.0:1789762712.319036:0:10283:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789762711 -> 1789762711 00002000:00010000:3.0:1789762712.319038:0:10283:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1789762712.319081:0:6655:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789762712.319087:0:6655:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762711 -> 1789762711 00000100:00100000:3.0:1789762712.319087:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+10:2344:x1876702140587648:12345-192.168.203.31@tcp:2:chmod.0 Request processed in 144us (226us total) trans 4294967302 rc 0/0 00002000:00010000:2.0:1789762712.319094:0:6655:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1789762711 -> 1789762711 00002000:00010000:2.0:1789762712.319098:0:6655:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762711 -> 1789762711 00002000:00010000:2.0:1789762712.319102:0:6655:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789762712.319102:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:2.0:1789762712.319127:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+11:2344:x1876702140587776:12345-192.168.203.31@tcp:2:chmod.0 Request processed in 163us (219us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789762712.319134:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:1.0:1789762712.335706:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.335749:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140588032 00000100:00100000:3.0:1789762712.335757:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140588032 00000100:00100000:3.0:1789762712.335795:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:3.0:1789762712.335804:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+34:10413:x1876702140588032:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:3.0:1789762712.335820:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762712.335823:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789762712.335859:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56e112 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e50a expref: 34 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.335871:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:3.0:1789762712.335874:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762712.335894:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e17b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e53b expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336012:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e182 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336024:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e182 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336031:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e182 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336041:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e189 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336045:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336050:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336131:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e190 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336138:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336143:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762712.336149:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00010000:00010000:3.0:1789762712.336213:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e182 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336218:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e182 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336223:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e182 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336227:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762712.336229:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e182 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336234:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e182 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336240:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:3.0:1789762712.336242:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762712.336245:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e182 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336256:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e182 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336263:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336267:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e189 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336271:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336274:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762712.336276:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336280:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e189 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336284:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf4d4877e (ffff95d15055d400) 00010000:00010000:3.0:1789762712.336286:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762712.336288:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e189 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336291:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e189 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336328:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e17b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e53b expref: 36 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336337:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e53b expref: 35 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.336346:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d15055d200) 00010000:00010000:3.0:1789762712.336347:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762712.336349:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9400, rc 0) 00000100:00100000:3.0:1789762712.336393:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+35:10413:x1876702140588032:12345-192.168.203.31@tcp:101:dd.500 Request processed in 591us (692us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789762712.336401:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1789762712.337467:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762712.337520:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140588288 00000100:00100000:2.0:1789762712.337526:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140588288 00000100:00100000:2.0:1789762712.337555:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1789762712.337562:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+35:10413:x1876702140588288:12345-192.168.203.31@tcp:36:dd.500 00010000:00010000:2.0:1789762712.337587:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762712.337600:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56e190 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e53b expref: 35 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.337614:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d15055d200) 00010000:00010000:2.0:1789762712.337618:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762712.337724:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e19e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.337732:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e19e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762712.337738:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e19e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762712.337771:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000004:00010000:2.0:1789762712.337804:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ccfeee7 reply state 00000000ff3f322d transno 4294967325 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e19e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762712.337810:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762712.337880:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+37:10413:x1876702140588288:12345-192.168.203.31@tcp:36:dd.500 Request processed in 318us (412us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789762712.337885:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000020:00080000:2.0:1789762712.337889:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789762712.338385:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e19e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.338392:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e19e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.338396:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e19e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.338400:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762712.338402:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e19e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.338407:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e19e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.338413:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d15055d200) 00010000:00010000:3.0:1789762712.338415:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762712.338417:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e19e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.338421:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e19e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762712.338619:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762712.338666:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140588416 00000100:00100000:0.0:1789762712.338673:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140588416 00000100:00100000:0.0:1789762712.338718:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1789762712.338729:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+11:10413:x1876702140588416:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762712.338739:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762712.338751:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e1a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e542 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.338773:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c56e135 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e518 expref: 12 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.338782:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762712.338786:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762712.338792:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e1a5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e542 expref: 12 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.338821:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c56e135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e518 expref: 12 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.338864:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c56e135 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e518 expref: 12 pid: 6656 timeout: 216 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762712.338880:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1876702148989440:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789762712.338941:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d160108d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789762712.339633:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1876702148989440:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762712.339656:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e1a5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e542 expref: 12 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.339671:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f5c00, rc 0) 00000100:00100000:0.0:1789762712.339709:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+12:10413:x1876702140588416:12345-192.168.203.31@tcp:101:dd.500 Request processed in 982us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762712.339718:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1789762712.339914:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762712.339944:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140588544 00000100:00100000:3.0:1789762712.339950:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140588544 00010000:00010000:3.0:1789762712.339972:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c56e135 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e518 expref: 12 pid: 6656 timeout: 216 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762712.340003:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1789762712.340012:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140588544:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762712.340022:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762712.340029:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c56e135 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e518 expref: 12 pid: 6656 timeout: 216 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.340041:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c56e135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e518 expref: 12 pid: 6656 timeout: 216 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.340058:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c56e135 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e518 expref: 12 pid: 6656 timeout: 216 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.340087:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762712.340092:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762712.340099:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e1a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e542 expref: 11 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.340108:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e1a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e542 expref: 11 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762712.340146:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e1a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e542 expref: 11 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762712.340156:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17414fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702148989568:192.168.203.31@tcp:105: 00000100:00100000:3.0:1789762712.340199:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17af6d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762712.340896:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17414fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702148989568:192.168.203.31@tcp:105: 00010000:00010000:3.0:1789762712.340905:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762712.340935:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+11:2345:x1876702140588544:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 925us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762712.340941:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1789762712.341051:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762712.341096:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140588672 00000100:00100000:0.0:1789762712.341101:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140588672 00000100:00100000:0.0:1789762712.341128:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1789762712.341135:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+10:10413:x1876702140588672:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762712.341144:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762712.341156:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0160d67/0xd08452c77c56e1ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e549 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.341178:0:6654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051cc8bcb/0xd08452c77c56e13c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e51f expref: 11 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.341202:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762712.341206:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762712.341212:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0160d67/0xd08452c77c56e1ac lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e549 expref: 11 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.341235:0:6654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051cc8bcb/0xd08452c77c56e13c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e51f expref: 11 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.341249:0:6654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051cc8bcb/0xd08452c77c56e13c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e51f expref: 11 pid: 6654 timeout: 216 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762712.341262:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6654:1876702148989696:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789762712.341303:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d160108d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789762712.342008:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6654:1876702148989696:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762712.342025:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0160d67/0xd08452c77c56e1ac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e549 expref: 11 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.342038:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f4c00, rc 0) 00000100:00100000:0.0:1789762712.342083:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+11:10413:x1876702140588672:12345-192.168.203.31@tcp:101:dd.500 Request processed in 947us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762712.342092:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:1.0:1789762712.342163:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762712.342204:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140588800 00000100:00100000:0.0:1789762712.342209:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140588800 00010000:00010000:0.0:1789762712.342235:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051cc8bcb/0xd08452c77c56e13c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e51f expref: 11 pid: 6654 timeout: 216 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762712.342265:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1789762712.342275:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+11:2344:x1876702140588800:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762712.342285:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762712.342291:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051cc8bcb/0xd08452c77c56e13c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e51f expref: 11 pid: 6654 timeout: 216 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.342304:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051cc8bcb/0xd08452c77c56e13c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e51f expref: 11 pid: 6654 timeout: 216 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.342320:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051cc8bcb/0xd08452c77c56e13c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e51f expref: 11 pid: 6654 timeout: 216 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.342332:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762712.342336:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762712.342342:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0160d67/0xd08452c77c56e1ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e549 expref: 10 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.342352:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0160d67/0xd08452c77c56e1ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e549 expref: 10 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762712.342376:0:5844:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f0160d67/0xd08452c77c56e1ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e549 expref: 10 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762712.342402:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:5844:1876702148989824:192.168.203.31@tcp:105: 00000100:00100000:0.0:1789762712.342442:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d160108d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789762712.343242:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:5844:1876702148989824:192.168.203.31@tcp:105: 00010000:00010000:0.0:1789762712.343252:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762712.343278:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+10:2344:x1876702140588800:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1006us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762712.343286:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1789762712.343402:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762712.343437:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140588928 00000100:00100000:0.0:1789762712.343441:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140588928 00002000:00010000:0.0:1789762712.343462:0:6659:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789762712.343466:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414fb80 with x1876702140588928 ext(0->18446744073709551615) 00002000:00010000:0.0:1789762712.343472:0:6659:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17414fb80. 00000100:00100000:3.0:1789762712.343487:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762712.343488:0:6659:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 3 deadline 0 time 116816649464 state 0x0 ref 1 00000100:00100000:0.0:1789762712.343498:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 3 deadline 117016649464 time 116816649464 state 0x1 ref 1 00000100:00100000:0.0:1789762712.343517:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140589056 00000100:00100000:0.0:1789762712.343522:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140589056 00002000:00010000:0.0:1789762712.343539:0:6659:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2 (0->18446744073709551615) 00000100:00100000:2.0:1789762712.343539:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 2 deadline 117016649464 time 116816700180 state 0x0 ref 1 00002000:00100000:0.0:1789762712.343547:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414df80 with x1876702140589056 ext(0->18446744073709551615) 00000100:00100000:1.0:1789762712.343551:0:6661:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00002000:00010000:0.0:1789762712.343556:0:6659:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17414df80. 00000100:00100000:2.0:1789762712.343557:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+11:2344:x1876702140588928:12345-192.168.203.31@tcp:10:dd.500 00000100:00100000:1.0:1789762712.343563:0:6661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789762712.343570:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 2 deadline 117016700180 time 116816700180 state 0x1 ref 2 00002000:00010000:2.0:1789762712.343826:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789762712.343829:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789762711 -> 1789762711 00002000:00010000:2.0:1789762712.343849:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789762711 -> 1789762711 00002000:00010000:2.0:1789762712.343852:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789762711 -> 1789762711 00002000:00010000:2.0:1789762712.343854:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789762712.343880:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+12:2344:x1876702140588928:12345-192.168.203.31@tcp:10:dd.500 Request processed in 328us (479us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789762712.343886:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 0 00002000:00010000:2.0:1789762712.343890:0:6660:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1789762712.343893:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414fb80 with x1876702140588928 ext(0->18446744073709551615) 00002000:00010000:2.0:1789762712.343897:0:6660:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17414fb80. 00000100:00100000:2.0:1789762712.343912:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 1 deadline 117016700180 time 116817077162 state 0x0 ref 1 00000100:00100000:2.0:1789762712.343921:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+10:2344:x1876702140589056:12345-192.168.203.31@tcp:10:dd.500 00002000:00010000:2.0:1789762712.344129:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789762712.344132:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 1789762711 -> 1789762711 00002000:00010000:2.0:1789762712.344139:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 1789762711 -> 1789762711 00002000:00010000:2.0:1789762712.344141:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 1789762711 -> 1789762711 00002000:00010000:2.0:1789762712.344143:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789762712.344169:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+11:2344:x1876702140589056:12345-192.168.203.31@tcp:10:dd.500 Request processed in 249us (684us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789762712.344174:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:2.0:1789762712.344177:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 1 deadline 117016700180 time 116817077162 state 0x2 ref 0 00002000:00010000:2.0:1789762712.344181:0:6660:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2 (0->18446744073709551615) 00002000:00100000:2.0:1789762712.344184:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414df80 with x1876702140589056 ext(0->18446744073709551615) 00002000:00010000:2.0:1789762712.344187:0:6660:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17414df80. 00000100:00100000:3.0:1789762712.353048:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762712.353089:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140589184 00000100:00100000:0.0:1789762712.353096:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140589184 00002000:00100000:0.0:1789762712.353122:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->1048575) req@ffff95d17414c000 x1876702140589184/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1789762723 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762712.353137:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414c000 with x1876702140589184 ext(0->1048575) 00002000:00010000:0.0:1789762712.353141:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17414c000 00000100:00100000:0.0:1789762712.353147:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 1 deadline 117016700180 time 116817077162 state 0x0 ref 1 00000100:00100000:0.0:1789762712.353154:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 1 deadline 117017077162 time 116817077162 state 0x1 ref 1 00000100:00100000:0.0:1789762712.353173:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117017077162 time 116826337594 state 0x0 ref 1 00000100:00100000:0.0:1789762712.353180:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140589184:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762712.359199:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+14:2345:x1876702140589184:12345-192.168.203.31@tcp:4:dd.500 Request processed in 6015us (6148us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789762712.359207:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1789762712.359212:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117017077162 time 116826337594 state 0x2 ref 0 00002000:00100000:0.0:1789762712.359222:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->1048575) req@ffff95d17414c000 x1876702140589184/t4294967305(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:493/0 lens 488/448 e 0 to 0 dl 1789762723 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762712.359230:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414c000 with x1876702140589184 ext(0->1048575) 00002000:00010000:0.0:1789762712.359234:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17414c000 00000100:00100000:3.0:1789762712.362268:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762712.362315:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140589312 00000100:00100000:0.0:1789762712.362322:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140589312 00002000:00100000:0.0:1789762712.362348:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3:0x0] (1048576->2097151) req@ffff95d17414f800 x1876702140589312/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1789762723 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762712.362360:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414f800 with x1876702140589312 ext(1048576->2097151) 00002000:00010000:0.0:1789762712.362364:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17414f800 00000100:00100000:0.0:1789762712.362374:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117017077162 time 116826337594 state 0x0 ref 1 00000100:00100000:0.0:1789762712.362392:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117026337594 time 116826337594 state 0x1 ref 1 00000100:00100000:1.0:1789762712.368716:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762712.368800:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140589440 00000100:00100000:0.0:1789762712.368806:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140589440 00002000:00100000:0.0:1789762712.368829:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (2097152->3145727) req@ffff95d1526dca80 x1876702140589440/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1789762723 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762712.368853:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dca80 with x1876702140589440 ext(2097152->3145727) 00002000:00010000:0.0:1789762712.368856:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526dca80 00000100:00100000:0.0:1789762712.368864:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117026337594 time 116826337594 state 0x1 ref 2 00000100:00100000:1.0:1789762712.375020:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762712.375081:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140589568 00000100:00100000:0.0:1789762712.375087:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140589568 00002000:00100000:0.0:1789762712.375110:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3:0x0] (3145728->4194303) req@ffff95d1526dc000 x1876702140589568/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1789762723 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762712.375118:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dc000 with x1876702140589568 ext(3145728->4194303) 00002000:00010000:0.0:1789762712.375121:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526dc000 00000100:00100000:0.0:1789762712.375128:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117026337594 time 116826337594 state 0x1 ref 3 00000100:00100000:3.0:1789762712.381546:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762712.381602:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140589696 00000100:00100000:0.0:1789762712.381608:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140589696 00002000:00100000:0.0:1789762712.381632:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->1048575) req@ffff95d17414dc00 x1876702140589696/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1789762723 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762712.381643:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414dc00 with x1876702140589696 ext(0->1048575) 00002000:00010000:0.0:1789762712.381648:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17414dc00 00000100:00100000:0.0:1789762712.381657:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117026337594 time 116826337594 state 0x1 ref 4 00000100:00100000:1.0:1789762712.388156:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762712.388215:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140589824 00000100:00100000:0.0:1789762712.388231:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140589824 00002000:00100000:0.0:1789762712.388259:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2:0x0] (1048576->2097151) req@ffff95d1526df800 x1876702140589824/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1789762723 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762712.388271:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526df800 with x1876702140589824 ext(1048576->2097151) 00002000:00010000:0.0:1789762712.388275:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526df800 00000100:00100000:0.0:1789762712.388284:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117026337594 time 116826337594 state 0x1 ref 5 00000100:00100000:0.0:1789762712.553248:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117226402339 time 117026402339 state 0x1 ref 5 00000100:00100000:0.0:1789762712.553281:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+16:2344:x1876702140589312:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762712.556793:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+18:2344:x1876702140589312:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3525us (194524us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789762712.556800:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 3 00002000:00100000:0.0:1789762712.556811:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (1048576->2097151) req@ffff95d17414f800 x1876702140589312/t4294967306(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:493/0 lens 488/448 e 0 to 0 dl 1789762723 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762712.556819:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414f800 with x1876702140589312 ext(1048576->2097151) 00002000:00010000:0.0:1789762712.556824:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17414f800 00010000:00010000:2.0:1789762712.614953:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762712.753361:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117426516888 time 117226516888 state 0x1 ref 4 00000100:00100000:2.0:1789762712.753391:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+17:2344:x1876702140589440:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762712.756981:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+19:2344:x1876702140589440:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3603us (388265us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789762712.756989:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 4 00002000:00100000:0.0:1789762712.756999:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (2097152->3145727) req@ffff95d1526dca80 x1876702140589440/t4294967307(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:493/0 lens 488/448 e 0 to 0 dl 1789762723 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762712.757007:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dca80 with x1876702140589440 ext(2097152->3145727) 00002000:00010000:0.0:1789762712.757013:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526dca80 00000100:00100000:0.0:1789762712.953421:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117626577049 time 117426577049 state 0x1 ref 3 00000100:00100000:0.0:1789762712.953462:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+18:2344:x1876702140589568:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762712.956697:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+20:2344:x1876702140589568:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3244us (581678us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789762712.956707:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 5 00002000:00100000:0.0:1789762712.956717:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3:0x0] (3145728->4194303) req@ffff95d1526dc000 x1876702140589568/t4294967308(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:493/0 lens 488/448 e 0 to 0 dl 1789762723 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762712.956725:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dc000 with x1876702140589568 ext(3145728->4194303) 00002000:00010000:0.0:1789762712.956730:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526dc000 00000100:00100000:2.0:1789762713.153519:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117826674984 time 117626674984 state 0x1 ref 2 00000100:00100000:2.0:1789762713.153544:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140589696:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762713.158228:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+14:2345:x1876702140589696:12345-192.168.203.31@tcp:4:dd.500 Request processed in 4693us (776684us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789762713.158236:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 6 00002000:00100000:2.0:1789762713.158247:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->1048575) req@ffff95d17414dc00 x1876702140589696/t4294967304(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:493/0 lens 488/448 e 0 to 0 dl 1789762723 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762713.158255:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414dc00 with x1876702140589696 ext(0->1048575) 00002000:00010000:2.0:1789762713.158260:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17414dc00 00000100:00100000:3.0:1789762713.160289:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762713.160339:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140589952 00000100:00100000:0.0:1789762713.160346:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140589952 00002000:00100000:0.0:1789762713.160372:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (2097152->3145727) req@ffff95d17414e680 x1876702140589952/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762713.160379:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414e680 with x1876702140589952 ext(2097152->3145727) 00002000:00010000:0.0:1789762713.160382:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17414e680 00000100:00100000:0.0:1789762713.160392:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117826674984 time 117626674984 state 0x1 ref 2 00000100:00100000:1.0:1789762713.167307:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762713.167352:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140590080 00000100:00100000:0.0:1789762713.167358:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140590080 00002000:00100000:0.0:1789762713.167382:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2:0x0] (3145728->4194303) req@ffff95d1526ddc00 x1876702140590080/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762713.167390:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526ddc00 with x1876702140590080 ext(3145728->4194303) 00002000:00010000:0.0:1789762713.167393:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526ddc00 00000100:00100000:0.0:1789762713.167399:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117826674984 time 117626674984 state 0x1 ref 3 00000100:00100000:1.0:1789762713.173943:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762713.174019:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140590208 00000100:00100000:0.0:1789762713.174033:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140590208 00002000:00100000:0.0:1789762713.174053:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (4194304->5242879) req@ffff95d1526de680 x1876702140590208/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762713.174079:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526de680 with x1876702140590208 ext(4194304->5242879) 00002000:00010000:0.0:1789762713.174084:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526de680 00000100:00100000:0.0:1789762713.174092:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117826674984 time 117626674984 state 0x1 ref 4 00000100:00100000:3.0:1789762713.180941:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762713.181017:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140590336 00000100:00100000:0.0:1789762713.181023:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140590336 00002000:00100000:0.0:1789762713.181045:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3:0x0] (5242880->6291455) req@ffff95d17414c380 x1876702140590336/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762713.181052:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414c380 with x1876702140590336 ext(5242880->6291455) 00002000:00010000:0.0:1789762713.181055:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17414c380 00000100:00100000:0.0:1789762713.181077:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117826674984 time 117626674984 state 0x1 ref 5 00000100:00100000:1.0:1789762713.187288:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762713.187343:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140590464 00000100:00100000:0.0:1789762713.187349:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140590464 00002000:00100000:0.0:1789762713.187370:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (6291456->7340031) req@ffff95d1526dc700 x1876702140590464/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762713.187378:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dc700 with x1876702140590464 ext(6291456->7340031) 00002000:00010000:0.0:1789762713.187381:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526dc700 00000100:00100000:0.0:1789762713.187388:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117826674984 time 117626674984 state 0x1 ref 6 00000100:00100000:1.0:1789762713.193934:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762713.193979:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140590592 00000100:00100000:0.0:1789762713.193985:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140590592 00002000:00100000:0.0:1789762713.194007:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3:0x0] (7340032->8388607) req@ffff95d1526df480 x1876702140590592/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762713.194027:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526df480 with x1876702140590592 ext(7340032->8388607) 00002000:00010000:0.0:1789762713.194030:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526df480 00000100:00100000:0.0:1789762713.194037:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 117826674984 time 117626674984 state 0x1 ref 7 00000100:00100000:0.0:1789762713.353603:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 118026758514 time 117826758514 state 0x1 ref 7 00000100:00100000:0.0:1789762713.353628:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+15:2344:x1876702140589824:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762713.356614:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+17:2344:x1876702140589824:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2995us (968458us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789762713.356622:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 7 00002000:00100000:0.0:1789762713.356632:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (1048576->2097151) req@ffff95d1526df800 x1876702140589824/t4294967305(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:493/0 lens 488/448 e 0 to 0 dl 1789762723 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762713.356639:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526df800 with x1876702140589824 ext(1048576->2097151) 00002000:00010000:0.0:1789762713.356644:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526df800 00000100:00100000:3.0:1789762713.358698:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762713.358748:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140590720 00000100:00100000:2.0:1789762713.358758:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140590720 00002000:00100000:2.0:1789762713.358791:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (4194304->5242879) req@ffff95d17414ea00 x1876702140590720/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762713.358803:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414ea00 with x1876702140590720 ext(4194304->5242879) 00002000:00010000:2.0:1789762713.358808:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17414ea00 00000100:00100000:2.0:1789762713.358820:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 118026758514 time 117826758514 state 0x1 ref 7 00000100:00100000:1.0:1789762713.366855:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762713.366906:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140590848 00000100:00100000:2.0:1789762713.366913:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140590848 00002000:00100000:2.0:1789762713.366939:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (5242880->6291455) req@ffff95d1526de300 x1876702140590848/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762713.366950:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526de300 with x1876702140590848 ext(5242880->6291455) 00002000:00010000:2.0:1789762713.366955:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526de300 00000100:00100000:2.0:1789762713.366964:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 118026758514 time 117826758514 state 0x1 ref 8 00000100:00100000:0.0:1789762713.553649:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 118226806388 time 118026806388 state 0x1 ref 8 00000100:00100000:0.0:1789762713.553670:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+18:2345:x1876702140589952:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762713.560949:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+20:2345:x1876702140589952:12345-192.168.203.31@tcp:4:dd.500 Request processed in 7283us (400700us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789762713.560959:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 8 00002000:00100000:0.0:1789762713.560971:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2:0x0] (2097152->3145727) req@ffff95d17414e680 x1876702140589952/t4294967306(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762713.560982:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414e680 with x1876702140589952 ext(2097152->3145727) 00002000:00010000:0.0:1789762713.560996:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17414e680 00000100:00100000:3.0:1789762713.562926:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762713.562976:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140590976 00000100:00100000:2.0:1789762713.562984:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140590976 00002000:00100000:2.0:1789762713.563018:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (6291456->7340031) req@ffff95d17414ce00 x1876702140590976/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762713.563029:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414ce00 with x1876702140590976 ext(6291456->7340031) 00002000:00010000:2.0:1789762713.563032:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17414ce00 00000100:00100000:2.0:1789762713.563042:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 118226806388 time 118026806388 state 0x1 ref 8 00000100:00100000:1.0:1789762713.571857:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762713.571893:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762713.571915:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140591104 00000100:00100000:0.0:1789762713.571924:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140591104 00000100:00100000:2.0:1789762713.571944:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140591360 00000100:00100000:2.0:1789762713.571952:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140591360 00002000:00100000:0.0:1789762713.571962:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (7340032->8388607) req@ffff95d1526dc380 x1876702140591104/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762713.571972:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dc380 with x1876702140591104 ext(7340032->8388607) 00002000:00010000:0.0:1789762713.571977:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526dc380 00000100:00100000:0.0:1789762713.571987:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 118226806388 time 118026806388 state 0x1 ref 9 00000100:00100000:2.0:1789762713.572001:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1789762713.572014:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+36:10413:x1876702140591360:12345-192.168.203.31@tcp:35:dd.500 00000001:00080000:2.0:1789762713.572269:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00000100:00100000:2.0:1789762713.572365:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+38:10413:x1876702140591360:12345-192.168.203.31@tcp:35:dd.500 Request processed in 354us (470us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789762713.572374:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000020:00080000:2.0:1789762713.572380:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789762713.600268:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762713.600322:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140591616 00000100:00100000:2.0:1789762713.600331:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140591616 00000100:00100000:2.0:1789762713.600381:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:2.0:1789762713.600392:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+38:10425:x1876702140591616:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762713.600412:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762713.600431:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e1b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e550 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600558:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e1ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600573:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e1ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600588:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e1ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600603:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e1c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600611:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600619:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600697:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56e1c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600707:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56e1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600716:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56e1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762713.600726:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 0 00010000:00010000:2.0:1789762713.600801:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e1ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600810:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e1ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600817:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e1ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600824:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762713.600829:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e1ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600858:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e1ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600874:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:2.0:1789762713.600878:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762713.600884:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e1ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600901:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e1ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600914:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600922:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e1c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600928:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600934:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762713.600938:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600945:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e1c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600954:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x636661f9 (ffff95d143e3fb00) 00010000:00010000:2.0:1789762713.600957:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762713.600960:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e1c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.600968:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e1c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.601024:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e1b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e550 expref: 41 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.601039:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56e1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e550 expref: 40 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.601052:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d143e3f900) 00010000:00010000:2.0:1789762713.601068:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762713.601072:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50000, rc 0) 00000100:00100000:2.0:1789762713.601119:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+40:10425:x1876702140591616:12345-192.168.203.31@tcp:101:dd.0 Request processed in 729us (855us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789762713.601127:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1789762713.606403:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762713.606431:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762713.606455:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140591872 00000100:00100000:2.0:1789762713.606462:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140591872 00000100:00100000:0.0:1789762713.606477:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140591744 00000100:00100000:0.0:1789762713.606485:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140591744 00000100:00100000:2.0:1789762713.606510:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:2.0:1789762713.606523:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+23:10426:x1876702140591872:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762713.606535:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789762713.606540:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00010000:00010000:2.0:1789762713.606549:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56e1d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e55e expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762713.606556:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+23:10425:x1876702140591744:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762713.606582:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762713.606585:0:6655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004dfac489/0xd08452c77c56e166 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e52d expref: 24 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762713.606596:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2743bfd/0xd08452c77c56e1dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e557 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.606597:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00000100:00100000:3.0:1789762713.606599:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:2.0:1789762713.606609:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762713.606619:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56e1d6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e55e expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762713.606633:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762713.606638:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1789762713.606643:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140592000 00010000:00010000:0.0:1789762713.606644:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2743bfd/0xd08452c77c56e1dd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e557 expref: 25 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762713.606649:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140592000 00010000:00010000:0.0:1789762713.606661:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2743bfd/0xd08452c77c56e1dd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e557 expref: 26 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762713.606671:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f4a00, rc 0) 00010000:00010000:2.0:1789762713.606681:0:6655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004dfac489/0xd08452c77c56e166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e52d expref: 26 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762713.606686:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:1.0:1789762713.606700:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+26:10424:x1876702140592000:12345-192.168.203.31@tcp:101:dd.0 00000100:00100000:0.0:1789762713.606711:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+26:10425:x1876702140591744:12345-192.168.203.31@tcp:101:dd.0 Request processed in 160us (275us total) trans 0 rc 0/0 00010000:00010000:1.0:1789762713.606713:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762713.606725:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085f9302c/0xd08452c77c56e1e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e565 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762713.606728:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00010000:00010000:2.0:1789762713.606729:0:6655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004dfac489/0xd08452c77c56e166 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e52d expref: 26 pid: 6654 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.606761:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1789762713.606762:0:6655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6655:1876702148989952:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789762713.606769:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762713.606776:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085f9302c/0xd08452c77c56e1e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e565 expref: 26 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.606785:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085f9302c/0xd08452c77c56e1e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e565 expref: 26 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.606794:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cde00, rc 0) 00000100:00100000:1.0:1789762713.606818:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+26:10424:x1876702140592000:12345-192.168.203.31@tcp:101:dd.0 Request processed in 123us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762713.606824:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1789762713.606887:0:6655:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789762713.607786:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762713.607812:0:6655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6655:1876702148989952:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789762713.607851:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56e1d6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e55e expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762713.607865:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140592128 00010000:00010000:2.0:1789762713.607865:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50e00, rc 0) 00000100:00100000:1.0:1789762713.607872:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140592128 00010000:00010000:1.0:1789762713.607894:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004dfac489/0xd08452c77c56e166 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e52d expref: 26 pid: 6654 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762713.607903:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+26:10426:x1876702140591872:12345-192.168.203.31@tcp:101:dd.0 Request processed in 1382us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762713.607913:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1789762713.607930:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1789762713.607941:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+25:2343:x1876702140592128:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762713.607950:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762713.607966:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004dfac489/0xd08452c77c56e166 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e52d expref: 25 pid: 6654 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.607979:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004dfac489/0xd08452c77c56e166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e52d expref: 25 pid: 6654 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.608001:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dfac489/0xd08452c77c56e166 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e52d expref: 25 pid: 6654 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.608011:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762713.608014:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762713.608019:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56e1d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e55e expref: 24 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.608025:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56e1d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e55e expref: 24 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.608031:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762713.608033:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762713.608036:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2743bfd/0xd08452c77c56e1dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e557 expref: 24 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.608041:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2743bfd/0xd08452c77c56e1dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e557 expref: 24 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.608045:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762713.608047:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762713.608051:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085f9302c/0xd08452c77c56e1e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e565 expref: 24 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.608073:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085f9302c/0xd08452c77c56e1e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e565 expref: 24 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.608099:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000085f9302c/0xd08452c77c56e1e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e565 expref: 24 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762713.608107:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702148990080:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762713.608149:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c2743bfd/0xd08452c77c56e1dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e557 expref: 24 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762713.608157:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702148990208:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762713.608193:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56e1d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e55e expref: 24 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762713.608203:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043210a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702148990336:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762713.608225:0:5799:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d158864d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762713.612829:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762713.612895:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702148990080:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762713.612907:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140592256 00000100:00100000:1.0:1789762713.612912:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702148990208:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762713.612914:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140592256 00000100:00100000:1.0:1789762713.612922:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043210a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702148990336:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762713.612942:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762713.612951:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1789762713.612962:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+24:10430:x1876702140592256:12345-192.168.203.31@tcp:101:dd.0 00000100:00100000:1.0:1789762713.612970:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+24:2343:x1876702140592128:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 5031us (5185us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762713.612972:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789762713.612981:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00010000:00010000:2.0:1789762713.612987:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e1eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e56c expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.613008:0:10283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e16d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e534 expref: 25 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.613030:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789762713.613035:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762713.613040:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e1eb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e56c expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.613076:0:10283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e16d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e534 expref: 25 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.613091:0:10283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e16d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e534 expref: 25 pid: 6656 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762713.613103:0:10283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10283:1876702148990464:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789762713.613143:0:10283:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a8a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789762713.614641:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762713.614671:0:10283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10283:1876702148990464:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789762713.614685:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140592384 00000100:00100000:1.0:1789762713.614692:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140592384 00010000:00010000:2.0:1789762713.614693:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e1eb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e56c expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762713.614709:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50c00, rc 0) 00010000:00010000:1.0:1789762713.614719:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e16d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e534 expref: 26 pid: 6656 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762713.614742:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+26:10430:x1876702140592256:12345-192.168.203.31@tcp:101:dd.0 Request processed in 1781us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762713.614752:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:2.0:1789762713.614753:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1789762713.614763:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a04b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+26:2342:x1876702140592384:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762713.614773:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762713.614787:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e16d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e534 expref: 25 pid: 6656 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.614797:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e16d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e534 expref: 25 pid: 6656 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.614811:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e16d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e534 expref: 25 pid: 6656 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.614823:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762713.614826:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762713.614847:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e1eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e56c expref: 24 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.614855:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e1eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e56c expref: 24 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762713.614872:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e1eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e56c expref: 24 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762713.614891:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043210a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702148990592:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762713.614926:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d158864d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762713.615577:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043210a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702148990592:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762713.615585:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762713.615608:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a04b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+24:2342:x1876702140592384:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 850us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762713.615615:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00010000:00010000:0.0:1789762713.639005:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762713.693355:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762713.693423:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140592512 00000100:00100000:2.0:1789762713.693433:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140592512 00002000:00100000:2.0:1789762713.693514:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (2097152->3145727) req@ffff95d1463cd180 x1876702140592512/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762713.693527:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1463cd180 with x1876702140592512 ext(2097152->3145727) 00002000:00010000:2.0:1789762713.693533:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1463cd180 00000100:00100000:2.0:1789762713.693553:0:6659:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 3 deadline 0 time 118166713989 state 0x0 ref 1 00000100:00100000:2.0:1789762713.693572:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 3 deadline 118166813989 time 118166713989 state 0x1 ref 1 00000100:00100000:0.0:1789762713.693703:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118166813989 time 118166864731 state 0x0 ref 1 00000100:00100000:0.0:1789762713.693716:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+24:2345:x1876702140592512:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762713.695921:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762713.696008:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140592640 00000100:00100000:1.0:1789762713.696014:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140592640 00002000:00100000:1.0:1789762713.696035:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x4:0x0] (1048576->2097151) req@ffff95d1463cd500 x1876702140592640/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762713.696043:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1463cd500 with x1876702140592640 ext(1048576->2097151) 00002000:00010000:1.0:1789762713.696047:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1463cd500 00000100:00100000:1.0:1789762713.696054:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118166964731 time 118166864731 state 0x1 ref 2 00000100:00100000:1.0:1789762713.696091:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118166964731 time 118169255932 state 0x0 ref 2 00000100:00100000:1.0:1789762713.696102:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+26:2343:x1876702140592640:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762713.699922:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+28:2345:x1876702140592512:12345-192.168.203.31@tcp:4:dd.0 Request processed in 6207us (6574us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789762713.699930:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 18 00002000:00100000:1.0:1789762713.699937:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (2097152->3145727) req@ffff95d1463cd180 x1876702140592512/t4294967309(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762713.699955:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1463cd180 with x1876702140592512 ext(2097152->3145727) 00002000:00010000:1.0:1789762713.699958:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1463cd180 00000100:00100000:2.0:1789762713.702332:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+28:2343:x1876702140592640:12345-192.168.203.31@tcp:4:dd.0 Request processed in 6230us (6409us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789762713.702342:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:2.0:1789762713.702348:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118166964731 time 118169255932 state 0x2 ref 0 00002000:00100000:2.0:1789762713.702360:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x4:0x0] (1048576->2097151) req@ffff95d1463cd500 x1876702140592640/t4294967310(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762713.702371:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1463cd500 with x1876702140592640 ext(1048576->2097151) 00002000:00010000:2.0:1789762713.702376:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1463cd500 00000100:00100000:3.0:1789762713.702880:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762713.702919:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140592768 00000100:00100000:0.0:1789762713.702925:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140592768 00002000:00100000:0.0:1789762713.702957:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (3145728->4194303) req@ffff95d04320ea00 x1876702140592768/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762713.702965:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d04320ea00 with x1876702140592768 ext(3145728->4194303) 00002000:00010000:0.0:1789762713.702968:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d04320ea00 00000100:00100000:0.0:1789762713.702974:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118166964731 time 118169255932 state 0x0 ref 1 00000100:00100000:0.0:1789762713.703000:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118169355932 time 118169255932 state 0x1 ref 1 00000100:00100000:0.0:1789762713.703015:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118169355932 time 118176179947 state 0x0 ref 1 00000100:00100000:0.0:1789762713.703025:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+28:2342:x1876702140592768:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762713.704278:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762713.704327:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140592896 00000100:00100000:2.0:1789762713.704333:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140592896 00002000:00100000:2.0:1789762713.704355:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x4:0x0] (6291456->7340031) req@ffff95d1463cc000 x1876702140592896/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762713.704366:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1463cc000 with x1876702140592896 ext(6291456->7340031) 00002000:00010000:2.0:1789762713.704370:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1463cc000 00000100:00100000:2.0:1789762713.704403:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118176279947 time 118176179947 state 0x1 ref 2 00000100:00100000:2.0:1789762713.704424:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118176279947 time 118177587660 state 0x0 ref 2 00000100:00100000:0.0:1789762713.704443:0:6661:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789762713.704450:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+30:2342:x1876702140592896:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762713.704454:0:6661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1789762713.705471:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762713.705540:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140593024 00000100:00100000:1.0:1789762713.705546:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140593024 00002000:00100000:1.0:1789762713.705573:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (7340032->8388607) req@ffff95d1463cc700 x1876702140593024/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762713.705584:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1463cc700 with x1876702140593024 ext(7340032->8388607) 00002000:00010000:1.0:1789762713.705589:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1463cc700 00000100:00100000:1.0:1789762713.705621:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118177687660 time 118177587660 state 0x1 ref 3 00000100:00100000:1.0:1789762713.705641:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118177687660 time 118178804816 state 0x0 ref 3 00000100:00100000:1.0:1789762713.705654:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+32:2344:x1876702140593024:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762713.706159:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+34:2342:x1876702140592768:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3135us (3279us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789762713.706178:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 20 00002000:00100000:0.0:1789762713.706188:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (3145728->4194303) req@ffff95d04320ea00 x1876702140592768/t4294967311(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762713.706198:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d04320ea00 with x1876702140592768 ext(3145728->4194303) 00002000:00010000:0.0:1789762713.706203:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d04320ea00 00000100:00100000:2.0:1789762713.706751:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762713.706794:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140593152 00000100:00100000:0.0:1789762713.706799:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140593152 00002000:00100000:0.0:1789762713.706817:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x4:0x0] (4194304->5242879) req@ffff95d1747f2680 x1876702140593152/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762713.706823:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1747f2680 with x1876702140593152 ext(4194304->5242879) 00002000:00010000:0.0:1789762713.706826:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1747f2680 00000100:00100000:0.0:1789762713.706869:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118178904816 time 118178804816 state 0x1 ref 3 00000100:00100000:0.0:1789762713.706885:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118178904816 time 118180050205 state 0x0 ref 3 00000100:00100000:0.0:1789762713.706896:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+34:2345:x1876702140593152:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762713.707888:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+36:2342:x1876702140592896:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3441us (3607us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789762713.707899:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 21 00002000:00100000:1.0:1789762713.707908:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x4:0x0] (6291456->7340031) req@ffff95d1463cc000 x1876702140592896/t4294967312(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762713.707923:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1463cc000 with x1876702140592896 ext(6291456->7340031) 00002000:00010000:1.0:1789762713.707928:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1463cc000 00000100:00100000:1.0:1789762713.709349:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+36:2344:x1876702140593024:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3696us (3875us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789762713.709360:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 22 00002000:00100000:1.0:1789762713.709369:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (7340032->8388607) req@ffff95d1463cc700 x1876702140593024/t4294967313(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762713.709387:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1463cc700 with x1876702140593024 ext(7340032->8388607) 00002000:00010000:1.0:1789762713.709392:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1463cc700 00000100:00100000:0.0:1789762713.709733:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762713.709770:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140593280 00000100:00100000:2.0:1789762713.709775:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140593280 00002000:00100000:2.0:1789762713.709801:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->1048575) req@ffff95d1463cf800 x1876702140593280/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762713.709811:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1463cf800 with x1876702140593280 ext(0->1048575) 00002000:00010000:2.0:1789762713.709815:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1463cf800 00000100:00100000:2.0:1789762713.709871:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118180150205 time 118180050205 state 0x1 ref 2 00000100:00100000:1.0:1789762713.709887:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118180150205 time 118183048501 state 0x0 ref 2 00000100:00100000:1.0:1789762713.709905:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+36:2343:x1876702140593280:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762713.711688:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762713.711726:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140593408 00000100:00100000:1.0:1789762713.711731:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140593408 00002000:00100000:1.0:1789762713.711747:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (5242880->6291455) req@ffff95d04320f100 x1876702140593408/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762713.711754:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d04320f100 with x1876702140593408 ext(5242880->6291455) 00002000:00010000:1.0:1789762713.711757:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d04320f100 00000100:00100000:1.0:1789762713.711780:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118183148501 time 118183048501 state 0x1 ref 3 00000100:00100000:1.0:1789762713.711796:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118183148501 time 118184960954 state 0x0 ref 3 00000100:00100000:1.0:1789762713.711805:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+38:2344:x1876702140593408:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762713.714245:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+40:2345:x1876702140593152:12345-192.168.203.31@tcp:4:dd.0 Request processed in 7350us (7494us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789762713.714253:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 23 00002000:00100000:0.0:1789762713.714261:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x4:0x0] (4194304->5242879) req@ffff95d1747f2680 x1876702140593152/t4294967314(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762713.714271:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1747f2680 with x1876702140593152 ext(4194304->5242879) 00002000:00010000:0.0:1789762713.714276:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1747f2680 00000100:00100000:1.0:1789762713.716709:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+40:2343:x1876702140593280:12345-192.168.203.31@tcp:4:dd.0 Request processed in 6806us (6973us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789762713.716721:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 24 00002000:00100000:1.0:1789762713.716731:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->1048575) req@ffff95d1463cf800 x1876702140593280/t4294967315(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762713.716742:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1463cf800 with x1876702140593280 ext(0->1048575) 00002000:00010000:1.0:1789762713.716746:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1463cf800 00000100:00100000:1.0:1789762713.717867:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+40:2344:x1876702140593408:12345-192.168.203.31@tcp:4:dd.0 Request processed in 6062us (6206us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789762713.717873:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:1.0:1789762713.717877:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118183148501 time 118184960954 state 0x2 ref 0 00002000:00100000:1.0:1789762713.717885:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (5242880->6291455) req@ffff95d04320f100 x1876702140593408/t4294967316(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762713.717892:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d04320f100 with x1876702140593408 ext(5242880->6291455) 00002000:00010000:1.0:1789762713.717896:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d04320f100 00000100:00100000:0.0:1789762713.753704:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 118426864636 time 118226864636 state 0x1 ref 9 00000100:00100000:0.0:1789762713.753721:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+23:2344:x1876702140590080:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762713.756375:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+25:2344:x1876702140590080:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2658us (589068us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789762713.756382:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 9 00002000:00100000:1.0:1789762713.756390:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (3145728->4194303) req@ffff95d1526ddc00 x1876702140590080/t4294967307(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762713.756398:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526ddc00 with x1876702140590080 ext(3145728->4194303) 00002000:00010000:1.0:1789762713.756402:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526ddc00 00000100:00100000:0.0:1789762713.761521:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762713.761575:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140593536 00000100:00100000:3.0:1789762713.761584:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140593536 00002000:00100000:3.0:1789762713.761613:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3:0x0] (0->1048575) req@ffff95d174167480 x1876702140593536/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762713.761625:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174167480 with x1876702140593536 ext(0->1048575) 00002000:00010000:3.0:1789762713.761630:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174167480 00000100:00100000:3.0:1789762713.761639:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118183148501 time 118184960954 state 0x0 ref 1 00000100:00100000:3.0:1789762713.761672:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118185060954 time 118184960954 state 0x1 ref 1 00000100:00100000:3.0:1789762713.761694:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118185060954 time 118234857843 state 0x0 ref 1 00000100:00100000:3.0:1789762713.761709:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+25:2342:x1876702140593536:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762713.762042:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762713.762091:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140593664 00000100:00100000:1.0:1789762713.762097:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140593664 00002000:00100000:1.0:1789762713.762123:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (2097152->3145727) req@ffff95d1747f0700 x1876702140593664/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762713.762131:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1747f0700 with x1876702140593664 ext(2097152->3145727) 00002000:00010000:1.0:1789762713.762134:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1747f0700 00000100:00100000:1.0:1789762713.762162:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118234957843 time 118234857843 state 0x1 ref 2 00000100:00100000:1.0:1789762713.762179:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118234957843 time 118235344063 state 0x0 ref 2 00000100:00100000:1.0:1789762713.762201:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+26:2342:x1876702140593664:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762713.774458:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+30:2342:x1876702140593664:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12255us (12412us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789762713.774470:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:3.0:1789762713.774480:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+30:2342:x1876702140593536:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12771us (12956us total) trans 4294967308 rc 0/0 00002000:00100000:2.0:1789762713.774481:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (2097152->3145727) req@ffff95d1747f0700 x1876702140593664/t4294967309(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1789762713.774498:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 26 00002000:00100000:2.0:1789762713.774502:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1747f0700 with x1876702140593664 ext(2097152->3145727) 00000100:00100000:3.0:1789762713.774508:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118234957843 time 118235344063 state 0x2 ref 0 00002000:00010000:2.0:1789762713.774510:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1747f0700 00002000:00100000:3.0:1789762713.774524:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3:0x0] (0->1048575) req@ffff95d174167480 x1876702140593536/t4294967308(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762713.774534:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174167480 with x1876702140593536 ext(0->1048575) 00002000:00010000:3.0:1789762713.774540:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174167480 00000100:00100000:0.0:1789762713.781787:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762713.781811:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762713.781826:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762713.781861:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140593792 00000100:00100000:2.0:1789762713.781867:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140594048 00000100:00100000:1.0:1789762713.781870:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140593792 00000100:00100000:0.0:1789762713.781876:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762713.781876:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140594048 00000100:00100000:3.0:1789762713.781882:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140593920 00000100:00100000:3.0:1789762713.781890:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140593920 00000100:00100000:0.0:1789762713.781902:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140594176 00002000:00100000:1.0:1789762713.781906:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (7340032->8388607) req@ffff95d174164380 x1876702140593792/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1789762713.781908:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140594176 00002000:00100000:2.0:1789762713.781910:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3:0x0] (6291456->7340031) req@ffff95d174166a00 x1876702140594048/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762713.781917:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (3145728->4194303) req@ffff95d174164700 x1876702140593920/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762713.781932:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (4194304->5242879) req@ffff95d174167b80 x1876702140594176/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762713.781936:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174164380 with x1876702140593792 ext(7340032->8388607) 00002000:00010000:1.0:1789762713.781944:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174164380 00002000:00100000:2.0:1789762713.781950:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174166a00 with x1876702140594048 ext(6291456->7340031) 00000100:00100000:1.0:1789762713.781957:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118234957843 time 118235344063 state 0x0 ref 1 00002000:00010000:2.0:1789762713.781960:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174166a00 00002000:00100000:3.0:1789762713.781968:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174164700 with x1876702140593920 ext(3145728->4194303) 00002000:00100000:0.0:1789762713.781971:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174167b80 with x1876702140594176 ext(4194304->5242879) 00002000:00010000:0.0:1789762713.781977:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174167b80 00002000:00010000:3.0:1789762713.781977:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174164700 00000100:00100000:1.0:1789762713.781996:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118235444063 time 118235344063 state 0x1 ref 4 00000100:00100000:2.0:1789762713.782007:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118235444063 time 118235344063 state 0x1 ref 4 00000100:00100000:1.0:1789762713.782027:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118255289448 time 118255189448 state 0x1 ref 4 00000100:00100000:0.0:1789762713.782037:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118255289448 time 118255189448 state 0x1 ref 4 00000100:00100000:1.0:1789762713.782045:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+32:2343:x1876702140593792:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762713.782047:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118255289448 time 118255189448 state 0x1 ref 4 00000100:00100000:2.0:1789762713.782077:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 1 deadline 118255338656 time 118255238656 state 0x1 ref 4 00000100:00100000:0.0:1789762713.782089:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 0 deadline 118255351756 time 118255251756 state 0x1 ref 4 00000100:00100000:2.0:1789762713.782096:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+32:2343:x1876702140594048:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762713.782104:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+32:2343:x1876702140594176:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762713.786034:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+36:2343:x1876702140594048:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3943us (4218us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789762713.786044:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 29 00002000:00100000:1.0:1789762713.786053:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3:0x0] (6291456->7340031) req@ffff95d174166a00 x1876702140594048/t4294967310(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762713.786079:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174166a00 with x1876702140594048 ext(6291456->7340031) 00002000:00010000:1.0:1789762713.786084:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174166a00 00000100:00100000:1.0:1789762713.786109:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118255351756 time 118259272008 state 0x0 ref 3 00000100:00100000:1.0:1789762713.786122:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+35:2343:x1876702140593920:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762713.787151:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+37:2343:x1876702140593792:12345-192.168.203.31@tcp:4:dd.0 Request processed in 5111us (5363us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789762713.787163:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 28 00002000:00100000:2.0:1789762713.787172:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (7340032->8388607) req@ffff95d174164380 x1876702140593792/t4294967311(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762713.787183:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174164380 with x1876702140593792 ext(7340032->8388607) 00002000:00010000:2.0:1789762713.787187:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174164380 00000100:00100000:3.0:1789762713.787553:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+37:2343:x1876702140594176:12345-192.168.203.31@tcp:4:dd.0 Request processed in 5450us (5675us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789762713.787564:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 30 00002000:00100000:3.0:1789762713.787573:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (4194304->5242879) req@ffff95d174167b80 x1876702140594176/t4294967312(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762713.787585:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174167b80 with x1876702140594176 ext(4194304->5242879) 00002000:00010000:3.0:1789762713.787589:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174167b80 00000100:00100000:2.0:1789762713.789753:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+37:2343:x1876702140593920:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3632us (7923us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789762713.789763:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:2.0:1789762713.789769:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118255351756 time 118259272008 state 0x2 ref 0 00002000:00100000:2.0:1789762713.789780:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3:0x0] (3145728->4194303) req@ffff95d174164700 x1876702140593920/t4294967313(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762713.789791:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174164700 with x1876702140593920 ext(3145728->4194303) 00002000:00010000:2.0:1789762713.789796:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174164700 00000100:00100000:1.0:1789762713.789883:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762713.789917:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140594560 00000100:00100000:0.0:1789762713.789924:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140594560 00000100:00100000:0.0:1789762713.789962:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1789762713.789971:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+40:10425:x1876702140594560:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:2.0:1789762713.790023:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762713.790115:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140594304 00000100:00100000:3.0:1789762713.790121:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140594304 00002000:00100000:3.0:1789762713.790145:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (5242880->6291455) req@ffff95d1747f2300 x1876702140594304/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000001:00080000:0.0:1789762713.790153:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967329 00002000:00100000:3.0:1789762713.790219:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1747f2300 with x1876702140594304 ext(5242880->6291455) 00002000:00010000:3.0:1789762713.790225:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1747f2300 00000100:00100000:3.0:1789762713.790233:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118255351756 time 118259272008 state 0x0 ref 1 00000100:00100000:0.0:1789762713.790237:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+42:10425:x1876702140594560:12345-192.168.203.31@tcp:35:dd.0 Request processed in 266us (354us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789762713.790256:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000020:00080000:0.0:1789762713.790260:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789762713.790267:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762713.790272:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118259372008 time 118259272008 state 0x1 ref 1 00000100:00100000:3.0:1789762713.790297:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140594688 00000100:00100000:3.0:1789762713.790301:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140594688 00000100:00100000:0.0:1789762713.790302:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118259372008 time 118263465336 state 0x0 ref 1 00000100:00100000:0.0:1789762713.790317:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+38:2344:x1876702140594304:12345-192.168.203.31@tcp:4:dd.0 00002000:00100000:3.0:1789762713.790328:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (1048576->2097151) req@ffff95d043210000 x1876702140594688/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1789762724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762713.790354:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d043210000 with x1876702140594688 ext(1048576->2097151) 00002000:00010000:3.0:1789762713.790400:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d043210000 00000100:00100000:3.0:1789762713.790430:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118263565336 time 118263465336 state 0x1 ref 2 00000100:00100000:1.0:1789762713.790469:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118263565336 time 118263629893 state 0x0 ref 2 00000100:00100000:1.0:1789762713.790486:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140594688:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762713.796678:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+41:2344:x1876702140594304:12345-192.168.203.31@tcp:4:dd.0 Request processed in 6362us (6654us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789762713.796686:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 32 00002000:00100000:0.0:1789762713.796693:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (5242880->6291455) req@ffff95d1747f2300 x1876702140594304/t4294967314(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762713.796701:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1747f2300 with x1876702140594304 ext(5242880->6291455) 00002000:00010000:0.0:1789762713.796705:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1747f2300 00000100:00100000:3.0:1789762713.799805:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+41:2344:x1876702140594688:12345-192.168.203.31@tcp:4:dd.0 Request processed in 9321us (9539us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789762713.799816:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:3.0:1789762713.799822:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118263565336 time 118263629893 state 0x2 ref 0 00002000:00100000:3.0:1789762713.799857:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3:0x0] (1048576->2097151) req@ffff95d043210000 x1876702140594688/t4294967315(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762713.799869:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d043210000 with x1876702140594688 ext(1048576->2097151) 00002000:00010000:3.0:1789762713.799874:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d043210000 00000100:00100000:2.0:1789762713.953786:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 118626940464 time 118426940464 state 0x1 ref 8 00000100:00100000:2.0:1789762713.953822:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140590208:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:3.0:1789762713.956751:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+41:2344:x1876702140590208:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2945us (782806us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789762713.956760:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 10 00002000:00100000:3.0:1789762713.956770:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (4194304->5242879) req@ffff95d1526de680 x1876702140590208/t4294967317(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762713.956778:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526de680 with x1876702140590208 ext(4194304->5242879) 00002000:00010000:3.0:1789762713.956785:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526de680 00000100:00100000:0.0:1789762714.153883:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 118827038919 time 118627038919 state 0x1 ref 7 00000100:00100000:0.0:1789762714.153920:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+40:2344:x1876702140590336:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:3.0:1789762714.153939:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762714.157016:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+42:2344:x1876702140590336:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3117us (976106us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789762714.157024:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 11 00002000:00100000:0.0:1789762714.157033:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3:0x0] (5242880->6291455) req@ffff95d17414c380 x1876702140590336/t4294967318(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762714.157041:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414c380 with x1876702140590336 ext(5242880->6291455) 00002000:00010000:0.0:1789762714.157047:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17414c380 00000100:00100000:2.0:1789762714.353957:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 119027112544 time 118827112544 state 0x1 ref 6 00000100:00100000:2.0:1789762714.353999:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+41:2344:x1876702140590464:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762714.356862:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+43:2344:x1876702140590464:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2872us (1169572us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789762714.356872:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 12 00002000:00100000:2.0:1789762714.356883:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (6291456->7340031) req@ffff95d1526dc700 x1876702140590464/t4294967319(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762714.356896:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dc700 with x1876702140590464 ext(6291456->7340031) 00002000:00010000:2.0:1789762714.356903:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526dc700 00000100:00100000:0.0:1789762714.554080:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 119227236883 time 119027236883 state 0x1 ref 5 00000100:00100000:0.0:1789762714.554121:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+42:2344:x1876702140590592:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762714.557072:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+44:2344:x1876702140590592:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2962us (1363137us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789762714.557080:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 13 00002000:00100000:0.0:1789762714.557090:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (7340032->8388607) req@ffff95d1526df480 x1876702140590592/t4294967320(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762714.557098:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526df480 with x1876702140590592 ext(7340032->8388607) 00002000:00010000:0.0:1789762714.557103:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526df480 00010000:00010000:1.0:1789762714.662972:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762714.754181:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 119427339636 time 119227339636 state 0x1 ref 4 00000100:00100000:3.0:1789762714.754226:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+40:2344:x1876702140590720:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:2.0:1789762714.754272:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762714.757183:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+42:2344:x1876702140590720:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2986us (1398486us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789762714.757191:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 14 00002000:00100000:3.0:1789762714.757202:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2:0x0] (4194304->5242879) req@ffff95d17414ea00 x1876702140590720/t4294967316(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762714.757210:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414ea00 with x1876702140590720 ext(4194304->5242879) 00002000:00010000:3.0:1789762714.757215:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17414ea00 00000100:00100000:3.0:1789762714.954245:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 119627402906 time 119427402906 state 0x1 ref 3 00000100:00100000:3.0:1789762714.954270:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+41:2344:x1876702140590848:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:3.0:1789762714.957013:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+43:2344:x1876702140590848:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2752us (1590158us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789762714.957022:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 15 00002000:00100000:3.0:1789762714.957033:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (5242880->6291455) req@ffff95d1526de300 x1876702140590848/t4294967317(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762714.957041:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526de300 with x1876702140590848 ext(5242880->6291455) 00002000:00010000:3.0:1789762714.957059:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526de300 00000100:00100000:0.0:1789762715.154319:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 119827476423 time 119627476423 state 0x1 ref 2 00000100:00100000:0.0:1789762715.154342:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+42:2344:x1876702140590976:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762715.164415:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+44:2344:x1876702140590976:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10075us (1601484us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789762715.164427:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 16 00002000:00100000:2.0:1789762715.164439:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2:0x0] (6291456->7340031) req@ffff95d17414ce00 x1876702140590976/t4294967318(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762715.164447:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17414ce00 with x1876702140590976 ext(6291456->7340031) 00002000:00010000:2.0:1789762715.164453:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17414ce00 00000100:00100000:2.0:1789762715.354408:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 119827476423 time 119827561739 state 0x0 ref 1 00000100:00100000:2.0:1789762715.354440:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+43:2344:x1876702140591104:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762715.357238:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+45:2344:x1876702140591104:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2810us (1785384us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789762715.357247:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1789762715.357255:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 119827476423 time 119827561739 state 0x2 ref 0 00002000:00100000:2.0:1789762715.357278:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (7340032->8388607) req@ffff95d1526dc380 x1876702140591104/t4294967319(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1789762724 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762715.357290:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dc380 with x1876702140591104 ext(7340032->8388607) 00002000:00010000:2.0:1789762715.357298:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526dc380 00000100:00100000:3.0:1789762715.393720:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.393783:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140594816 00000100:00100000:0.0:1789762715.393794:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140594816 00000100:00100000:0.0:1789762715.393887:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1789762715.393897:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+44:5571:x1876702140594816:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762715.393910:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:0.0:1789762715.393927:0:5844:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1789762715.393930:0:5844:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789762711 -> 1789762712 00002000:00010000:0.0:1789762715.393932:0:5844:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789762711 -> 1789762712 00010000:00010000:0.0:1789762715.393953:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e1a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e542 expref: 44 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762715.393980:0:5844:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1789762715.393982:0:5844:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762711 -> 1789762713 00002000:00010000:0.0:1789762715.393995:0:5844:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762711 -> 1789762713 00010000:00010000:0.0:1789762715.394002:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e1eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e56c expref: 43 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.394013:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762715.394074:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+42:5571:x1876702140594816:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 178us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762715.394081:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1789762715.394209:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762715.394249:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140594944 00000100:00100000:1.0:1789762715.394254:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140594944 00000100:00100000:1.0:1789762715.394284:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1789762715.394291:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+45:5572:x1876702140594944:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762715.394302:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00002000:00010000:1.0:1789762715.394315:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1789762715.394319:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 1789762711 -> 1789762713 00002000:00010000:1.0:1789762715.394321:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 1789762711 -> 1789762713 00010000:00010000:1.0:1789762715.394336:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0160d67/0xd08452c77c56e1ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e549 expref: 45 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762715.394363:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1789762715.394366:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789762711 -> 1789762713 00002000:00010000:1.0:1789762715.394368:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789762711 -> 1789762713 00010000:00010000:1.0:1789762715.394378:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2743bfd/0xd08452c77c56e1dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e557 expref: 44 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.394392:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56e1d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e55e expref: 43 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.394412:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085f9302c/0xd08452c77c56e1e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e565 expref: 42 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.394421:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762715.394457:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+41:5572:x1876702140594944:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 165us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762715.394466:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1789762715.423403:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762715.423451:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140595200 00000100:00100000:3.0:1789762715.423460:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140595200 00000100:00080000:2.0:1789762715.423510:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762715.423511:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1789762715.423523:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+42:10461:x1876702140595200:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762715.423541:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762715.423566:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e1f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e573 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423624:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e1f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423635:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e1f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423645:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e1f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423655:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e200 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423661:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423665:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423753:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e207 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423759:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423763:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762715.423771:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 16777216 00010000:00010000:3.0:1789762715.423862:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e1f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423877:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e1f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423882:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e1f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423887:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762715.423890:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e1f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423896:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e1f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423904:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:3.0:1789762715.423907:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762715.423910:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e1f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423915:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56e1f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423924:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423928:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e200 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423932:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e200 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423935:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762715.423941:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e200 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423945:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e200 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423950:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf4d4877e (ffff95d15055d400) 00010000:00010000:3.0:1789762715.423952:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762715.423953:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e200 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423957:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56e200 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423988:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56e1f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e573 expref: 45 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.423997:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e573 expref: 44 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.424001:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d15055d200) 00010000:00010000:3.0:1789762715.424002:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762715.424004:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9e00, rc 0) 00000100:00100000:3.0:1789762715.424058:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+44:10461:x1876702140595200:12345-192.168.203.31@tcp:101:dd.0 Request processed in 538us (662us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789762715.424064:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1789762715.425767:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762715.425788:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762715.425805:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.425823:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140595328 00000100:00100000:0.0:1789762715.425829:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140595328 00000100:00100000:1.0:1789762715.425867:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140595456 00000100:00100000:2.0:1789762715.425869:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140595584 00000100:00100000:1.0:1789762715.425874:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140595456 00000100:00100000:2.0:1789762715.425876:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140595584 00000100:00100000:0.0:1789762715.425891:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1789762715.425903:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+44:10462:x1876702140595328:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762715.425911:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762715.425923:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56e215 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e57a expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762715.425928:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:3.0:1789762715.425940:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:1.0:1789762715.425945:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+44:10463:x1876702140595456:12345-192.168.203.31@tcp:101:dd.0 00002000:00010000:0.0:1789762715.425946:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 8388608, mtime: 0x6aad9c98, atime: 0x6aad9c97, ctime: 0x6aad9c98, blocks: 0x1 00000100:00100000:3.0:1789762715.425962:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+45:10461:x1876702140595584:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762715.425965:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=119s v=(0 0) 00010000:00010000:1.0:1789762715.425969:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762715.425971:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762715.425973:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762715.425980:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56e215 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e57a expref: 45 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.425983:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c56e21c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e581 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.425984:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c56e223 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e588 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.425996:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56e215 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e57a expref: 45 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.426018:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762715.426022:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762715.426029:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c56e223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e588 expref: 47 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.426040:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c56e223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e588 expref: 47 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.426041:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762715.426062:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762715.426072:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c56e21c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e581 expref: 47 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.426085:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f5600, rc 0) 00010000:00010000:3.0:1789762715.426087:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a8600, rc 0) 00010000:00010000:1.0:1789762715.426088:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c56e21c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e581 expref: 47 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.426106:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cde00, rc 0) 00000100:00100000:3.0:1789762715.426124:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+47:10461:x1876702140595584:12345-192.168.203.31@tcp:101:dd.0 Request processed in 165us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762715.426129:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+47:10462:x1876702140595328:12345-192.168.203.31@tcp:101:dd.0 Request processed in 227us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762715.426136:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1789762715.426144:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:1.0:1789762715.426147:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+47:10463:x1876702140595456:12345-192.168.203.31@tcp:101:dd.0 Request processed in 205us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762715.426159:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:0.0:1789762715.430764:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.430815:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140595712 00000100:00100000:2.0:1789762715.430821:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140595712 00002000:00100000:2.0:1789762715.430861:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->1048575) req@ffff95d1522fc380 x1876702140595712/t0(0) o3->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1789762726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762715.430869:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fc380 with x1876702140595712 ext(0->1048575) 00002000:00010000:2.0:1789762715.430873:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fc380 00000100:00100000:2.0:1789762715.430882:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118263565336 time 118263629893 state 0x0 ref 1 00000100:00100000:2.0:1789762715.430890:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118263729893 time 118263629893 state 0x1 ref 1 00000100:00100000:2.0:1789762715.430907:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118263729893 time 119904071683 state 0x0 ref 1 00000100:00100000:2.0:1789762715.430915:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+45:2343:x1876702140595712:12345-192.168.203.31@tcp:3:dd.0 00000100:00100000:2.0:1789762715.435256:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+45:2343:x1876702140595712:12345-192.168.203.31@tcp:3:dd.0 Request processed in 4339us (4491us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762715.435265:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1789762715.435269:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118263729893 time 119904071683 state 0x2 ref 0 00002000:00100000:2.0:1789762715.435278:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->1048575) req@ffff95d1522fc380 x1876702140595712/t0(0) o3->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1789762726 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762715.435292:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fc380 with x1876702140595712 ext(0->1048575) 00002000:00010000:2.0:1789762715.435296:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fc380 00000100:00100000:2.0:1789762715.469210:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.469271:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140595968 00000100:00100000:0.0:1789762715.469280:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140595968 00000100:00100000:0.0:1789762715.469329:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1789762715.469338:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+44:10473:x1876702140595968:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:3.0:1789762715.469400:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.469440:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140596224 00000100:00100000:2.0:1789762715.469446:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140596224 00000100:00100000:2.0:1789762715.469480:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:2.0:1789762715.469489:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+46:10467:x1876702140596224:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762715.469502:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762715.469522:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e22a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e58f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762715.469528:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+46:10473:x1876702140595968:12345-192.168.203.31@tcp:35:dd.0 Request processed in 190us (324us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789762715.469543:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00010000:00010000:2.0:1789762715.469600:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e231 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.469611:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e231 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.469621:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e231 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762715.469628:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 16777216 00010000:00010000:2.0:1789762715.469691:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e22a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e58f expref: 48 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.469704:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e231 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e58f expref: 47 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.469711:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d15055d200) 00010000:00010000:2.0:1789762715.469722:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789762715.469725:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50400, rc 0) 00000100:00100000:2.0:1789762715.469754:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+47:10467:x1876702140596224:12345-192.168.203.31@tcp:101:dd.0 Request processed in 268us (356us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789762715.469759:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:3.0:1789762715.481600:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.481658:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140596352 00000100:00100000:2.0:1789762715.481665:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140596352 00000100:00100000:2.0:1789762715.481704:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:2.0:1789762715.481714:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+47:10477:x1876702140596352:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789762715.481729:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762715.481739:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e23f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e596 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.481773:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e246 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.481780:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.481786:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762715.481803:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789762715.481806:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762715.481815:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.481829:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e23f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e596 expref: 49 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.481869:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e596 expref: 48 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.481874:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:2.0:1789762715.481876:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762715.481878:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51400, rc 0) 00000100:00100000:2.0:1789762715.481906:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+48:10477:x1876702140596352:12345-192.168.203.31@tcp:101:rm.0 Request processed in 196us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762715.481911:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:1.0:1789762715.483324:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.483396:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140596480 00000100:00100000:0.0:1789762715.483402:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140596480 00000100:00100000:0.0:1789762715.483430:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:0.0:1789762715.483437:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+48:10477:x1876702140596480:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:0.0:1789762715.485259:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+48:10477:x1876702140596480:12345-192.168.203.31@tcp:37:rm.0 Request processed in 1821us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762715.485265:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:3.0:1789762715.486728:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762715.486777:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140596608 00000100:00100000:1.0:1789762715.486783:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140596608 00000100:00100000:1.0:1789762715.486816:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:1.0:1789762715.486826:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+48:10477:x1876702140596608:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:1.0:1789762715.486880:0:6681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789762715.486925:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+48:10477:x1876702140596608:12345-192.168.203.31@tcp:41:rm.0 Request processed in 100us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762715.486934:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:1.0:1789762715.487829:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.487869:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140596864 00000100:00100000:2.0:1789762715.487874:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140596864 00000100:00100000:2.0:1789762715.487903:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:2.0:1789762715.487911:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+48:10477:x1876702140596864:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762715.487933:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762715.487947:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56e1c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e550 expref: 48 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.487968:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56e0ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4fc expref: 47 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.487975:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d143e3f900) 00010000:00010000:2.0:1789762715.487982:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56e246 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e596 expref: 46 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.487988:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:2.0:1789762715.487995:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762715.488006:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56e24d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488013:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56e24d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488018:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56e24d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488027:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e254 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488031:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488036:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488100:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e25b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488106:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e25b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488112:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e25b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762715.488588:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789762715.488598:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 119961764024ns, next at 120961761852ns, rc = 0 00000040:00080000:2.0:1789762715.488619:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789762715.488623:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 119961789282ns, next at 120961788625ns, rc = 0 00010000:00010000:2.0:1789762715.488659:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e262 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488670:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488676:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488681:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e262 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488686:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e262 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488690:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e262 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488704:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762715.488713:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e25b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488717:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e25b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488722:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e25b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488726:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.488730:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e25b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.488734:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762715.488736:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e25b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.488744:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e262 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488758:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d143e3f700) 00010000:00010000:2.0:1789762715.488761:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762715.488764:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e25b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.488767:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762715.488771:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56e25b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.488774:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e262 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488783:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56e24d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.488786:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e262 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488791:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56e24d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488804:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56e24d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488808:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762715.488809:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d143e3f700) 00010000:00010000:2.0:1789762715.488811:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56e24d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.488817:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762715.488819:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56e24d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.488823:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e262 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488827:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:2.0:1789762715.488854:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762715.488857:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56e24d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.488868:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56e24d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.488883:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e262 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762715.488890:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3d5cbb7 reply state 000000009eeb48b1 transno 4294967334 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762715.488897:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789762715.488908:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762715.488913:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762715.488918:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762715.488936:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+47:10477:x1876702140596864:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1026us (1108us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789762715.488941:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00010000:00010000:3.0:1789762715.489542:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.489551:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e254 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.489556:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e254 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.489570:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762715.489573:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e254 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.489577:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e254 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.489585:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x636661f9 (ffff95d143e3fb00) 00010000:00010000:3.0:1789762715.489587:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762715.489589:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e254 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.489593:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e254 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762715.489920:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.489957:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140597120 00000100:00100000:0.0:1789762715.489964:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140597120 00000100:00100000:0.0:1789762715.489993:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1789762715.489999:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+46:10477:x1876702140597120:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:0.0:1789762715.490098:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+47:10477:x1876702140597120:12345-192.168.203.31@tcp:35:rm.0 Request processed in 99us (181us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789762715.490104:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1789762715.490827:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.490906:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140597376 00000100:00100000:2.0:1789762715.490912:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140597376 00000100:00100000:2.0:1789762715.490941:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1789762715.490948:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+47:10477:x1876702140597376:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762715.490967:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762715.490977:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9e00/0xd08452c77c56e207 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e573 expref: 47 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.490990:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e231 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e58f expref: 46 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.490999:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e0b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4ee expref: 45 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491005:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d15055d200) 00010000:00010000:2.0:1789762715.491010:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762715.491017:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e269 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491023:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e269 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491035:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e269 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491057:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e270 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491064:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491068:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491110:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e277 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491116:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e277 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491121:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e277 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762715.491359:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000040:00080000:2.0:1789762715.491380:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00010000:00010000:2.0:1789762715.491412:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e27e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491419:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e27e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491424:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e27e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491436:0:7603:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e27e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491441:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e27e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491444:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e27e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491458:0:7603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762715.491466:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e277 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491471:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e277 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.491475:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762715.491476:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e277 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.491483:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e27e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491484:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.491490:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e277 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.491493:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f8c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762715.491498:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e27e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491503:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e277 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.491507:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e27e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491534:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:2.0:1789762715.491539:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789762715.491543:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:2.0:1789762715.491544:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e277 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.491551:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789762715.491557:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e27e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491572:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e277 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.491574:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e27e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491588:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e269 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.491596:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762715.491599:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762715.491601:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762715.491601:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e269 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491609:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e269 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491613:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.491615:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e269 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491619:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e269 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491626:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:2.0:1789762715.491628:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762715.491630:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e269 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.491634:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e269 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762715.491640:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbeb0d6a reply state 00000000d76ec5bb transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762715.491645:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762715.491681:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+46:10477:x1876702140597376:12345-192.168.203.31@tcp:36:rm.0 Request processed in 734us (855us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789762715.491686:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00010000:00010000:1.0:1789762715.492242:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.492251:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e270 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.492255:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e270 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.492259:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762715.492261:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e270 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.492266:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e270 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.492273:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf4d4877e (ffff95d143e3f000) 00010000:00010000:1.0:1789762715.492274:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762715.492277:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e270 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.492281:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56e270 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762715.493603:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762715.493650:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140597632 00000100:00100000:1.0:1789762715.493656:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140597632 00000100:00100000:1.0:1789762715.493689:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:1.0:1789762715.493697:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1517c0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+45:10477:x1876702140597632:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:1.0:1789762715.493786:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1517c0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+46:10477:x1876702140597632:12345-192.168.203.31@tcp:35:rm.0 Request processed in 89us (184us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1789762715.493793:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1789762715.494646:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762715.494708:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140597888 00000100:00100000:1.0:1789762715.494714:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140597888 00000100:00100000:1.0:1789762715.494743:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:1.0:1789762715.494749:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+46:10477:x1876702140597888:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:1.0:1789762715.494769:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789762715.494779:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56e0fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e503 expref: 46 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.494791:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e086 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4e0 expref: 45 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.494799:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:1.0:1789762715.494806:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56e024 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e4cb expref: 44 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.494811:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d800) 00010000:00010000:1.0:1789762715.494815:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762715.494825:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e285 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.494864:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e285 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.494871:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e285 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.494882:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e28c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.494887:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e28c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.494892:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e28c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.494930:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e293 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.494935:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e293 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.494940:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e293 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762715.495198:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789762715.495206:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e293 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.495211:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e293 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.495216:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e293 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.495224:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cce00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762715.495227:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e293 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.495231:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e293 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.495237:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:1.0:1789762715.495239:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762715.495241:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e293 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.495245:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cce00/0xd08452c77c56e293 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.495256:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e285 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.495260:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e285 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.495264:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e285 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.495267:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762715.495269:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e285 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.495272:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e285 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.495284:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:1.0:1789762715.495285:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762715.495288:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e285 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.495291:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc200/0xd08452c77c56e285 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762715.495298:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dce3af99 reply state 000000003709ea8f transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e28c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762715.495302:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762715.495335:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+45:10477:x1876702140597888:12345-192.168.203.31@tcp:36:rm.0 Request processed in 586us (690us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789762715.495341:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00010000:00010000:0.0:1789762715.495894:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e28c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.495901:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e28c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.495906:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e28c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.495910:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cd200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762715.495917:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e28c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.495922:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e28c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.495929:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d14abf2300) 00010000:00010000:0.0:1789762715.495931:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762715.495933:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e28c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.495937:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd200/0xd08452c77c56e28c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.686941:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762715.767652:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.767712:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140598016 00000100:00100000:2.0:1789762715.767724:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140598016 00000100:00100000:2.0:1789762715.767791:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1789762715.767804:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+44:10488:x1876702140598016:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:2.0:1789762715.767826:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762715.767878:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e29a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e59d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.767933:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.767945:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.767956:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762715.767985:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762715.767987:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762715.768005:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.768024:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e29a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e59d expref: 46 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.768055:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e59d expref: 45 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.768073:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f100) 00010000:00010000:2.0:1789762715.768076:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762715.768085:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f8c00, rc 0) 00000100:00100000:2.0:1789762715.768137:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+45:10488:x1876702140598016:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 337us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762715.768143:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:3.0:1789762715.769131:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.769166:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140598272 00000100:00100000:0.0:1789762715.769172:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140598272 00000100:00100000:0.0:1789762715.769204:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1789762715.769212:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+45:10488:x1876702140598272:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:0.0:1789762715.769239:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762715.769252:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e59d expref: 45 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.769262:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f100) 00010000:00010000:0.0:1789762715.769268:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762715.769327:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e2a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.769339:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.769360:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.769376:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e2af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.769383:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e2af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.769388:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e2af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762715.769995:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00010000:00010000:0.0:1789762715.770005:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.770014:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e2a8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.770020:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e2a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.770025:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762715.770029:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e2a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.770034:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e2a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.770055:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90800) 00010000:00010000:0.0:1789762715.770058:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762715.770067:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e2a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.770072:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e2a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762715.770083:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020940c26 reply state 0000000053b023bc transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e2af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762715.770089:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762715.770133:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+46:10488:x1876702140598272:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 922us (1003us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1789762715.770140:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00010000:00010000:1.0:1789762715.770623:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e2af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.770632:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e2af lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.770637:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e2af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.770641:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762715.770644:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e2af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.770648:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e2af lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.770666:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d151e90400) 00010000:00010000:1.0:1789762715.770668:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762715.770671:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e2af lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.770675:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e2af lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762715.775256:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762715.775290:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140598400 00000100:00100000:1.0:1789762715.775295:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140598400 00000100:00100000:1.0:1789762715.775327:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:1.0:1789762715.775335:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+45:10489:x1876702140598400:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789762715.775345:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762715.775358:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc600/0xd08452c77c56e2b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5a4 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.775388:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588ccc00/0xd08452c77c56e2bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.775396:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588ccc00/0xd08452c77c56e2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.775402:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588ccc00/0xd08452c77c56e2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762715.775418:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789762715.775420:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762715.775432:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588ccc00/0xd08452c77c56e2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.775455:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc600/0xd08452c77c56e2b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5a4 expref: 47 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.775466:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588ccc00/0xd08452c77c56e2bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5a4 expref: 46 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.775471:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:1.0:1789762715.775474:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762715.775476:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588ccc00, rc 0) 00000100:00100000:1.0:1789762715.775511:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+46:10489:x1876702140598400:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 176us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762715.775519:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1789762715.776304:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.776336:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140598656 00000100:00100000:0.0:1789762715.776342:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140598656 00000100:00100000:0.0:1789762715.776374:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:0.0:1789762715.776381:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+46:10489:x1876702140598656:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789762715.776389:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762715.776392:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789762715.776401:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588ccc00/0xd08452c77c56e2bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5a4 expref: 46 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776412:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:0.0:1789762715.776418:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762715.776426:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56e2c4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5ab expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776486:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e2cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776501:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e2cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776507:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e2cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776516:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e2d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776521:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776526:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776590:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e2d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776599:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776607:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762715.776616:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00010000:00010000:0.0:1789762715.776628:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776635:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e2d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776643:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776657:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762715.776660:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776665:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776671:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d151e90700) 00010000:00010000:0.0:1789762715.776673:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762715.776676:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e2d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776680:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e2d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776693:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e2cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776697:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e2cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776701:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e2cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776705:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762715.776708:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e2cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776712:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e2cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776727:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90c00) 00010000:00010000:0.0:1789762715.776729:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762715.776731:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e2cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776735:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e2cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776742:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776745:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e2d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776749:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776753:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762715.776755:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776759:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e2d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776766:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d151e90a00) 00010000:00010000:0.0:1789762715.776767:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762715.776770:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e2d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776773:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e2d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776800:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56e2c4 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5ab expref: 46 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776807:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90c00) 00010000:00010000:0.0:1789762715.776808:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762715.776811:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56e2c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5ab expref: 46 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.776819:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f4200, rc 0) 00000100:00100000:0.0:1789762715.776862:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+45:10489:x1876702140598656:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 481us (558us total) trans 0 rc 301/301 00000100:00100000:0.0:1789762715.776868:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:3.0:1789762715.777692:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.777724:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140598784 00000100:00100000:0.0:1789762715.777729:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140598784 00000100:00100000:0.0:1789762715.777760:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:0.0:1789762715.777767:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+45:10489:x1876702140598784:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789762715.777774:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762715.777784:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5e00/0xd08452c77c56e2e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5b2 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.777807:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4c00/0xd08452c77c56e2e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.777813:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4c00/0xd08452c77c56e2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.777819:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4c00/0xd08452c77c56e2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762715.777920:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789762715.777923:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762715.777936:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4c00/0xd08452c77c56e2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.777951:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5e00/0xd08452c77c56e2e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5b2 expref: 47 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.777961:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4c00/0xd08452c77c56e2e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5b2 expref: 46 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.777966:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:0.0:1789762715.777968:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762715.777970:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f4c00, rc 0) 00000100:00100000:0.0:1789762715.778007:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+46:10489:x1876702140598784:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 237us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762715.778013:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:1.0:1789762715.779022:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.779064:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140599040 00000100:00100000:2.0:1789762715.779069:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140599040 00000100:00100000:2.0:1789762715.779099:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:2.0:1789762715.779105:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+46:10489:x1876702140599040:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762715.779113:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762715.779120:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e2ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5b9 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779147:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779155:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779161:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779168:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e2fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779174:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e2fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779188:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e2fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762715.779234:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00010000:00010000:2.0:1789762715.779275:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779280:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779285:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779289:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f8c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.779291:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779296:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779302:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:2.0:1789762715.779305:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762715.779307:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779311:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f8c00/0xd08452c77c56e2f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779318:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e2fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779331:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e2fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779335:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e2fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779338:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.779341:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e2fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779345:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e2fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779350:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d143e3fa00) 00010000:00010000:2.0:1789762715.779351:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762715.779353:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e2fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779357:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9600/0xd08452c77c56e2fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779376:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e2ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5b9 expref: 48 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779382:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:2.0:1789762715.779383:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789762715.779385:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1821f9200/0xd08452c77c56e2ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5b9 expref: 48 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.779390:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1821f9200, rc 0) 00000100:00100000:2.0:1789762715.779425:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+47:10489:x1876702140599040:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 320us (406us total) trans 4294967340 rc 301/301 00000100:00100000:2.0:1789762715.779430:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:1.0:1789762715.780217:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.780248:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140599296 00000100:00100000:0.0:1789762715.780253:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140599296 00000100:00100000:0.0:1789762715.780281:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1789762715.780289:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+47:10489:x1876702140599296:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:0.0:1789762715.780329:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56e30a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.780336:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56e30a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.780342:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56e30a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762715.780437:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e856102 reply state 000000001f0f99ba transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56e30a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762715.780443:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789762715.780447:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00000100:00100000:0.0:1789762715.780484:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+49:10489:x1876702140599296:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 198us (271us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789762715.780489:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00010000:00010000:0.0:1789762715.781015:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56e30a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.781022:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56e30a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.781027:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56e30a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.781032:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762715.781035:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56e30a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.781049:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56e30a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.781060:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d151e90800) 00010000:00010000:0.0:1789762715.781062:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789762715.781068:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56e30a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.781073:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56e30a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762715.781155:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.781185:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140599552 00000100:00100000:0.0:1789762715.781190:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140599552 00000100:00100000:0.0:1789762715.781217:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1789762715.781225:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+48:10489:x1876702140599552:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1789762715.781321:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+49:10489:x1876702140599552:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 97us (167us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1789762715.781327:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1789762715.785080:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.785110:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140599680 00000100:00100000:2.0:1789762715.785116:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140599680 00000100:00100000:2.0:1789762715.785146:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:2.0:1789762715.785152:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+49:10490:x1876702140599680:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:2.0:1789762715.785161:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762715.785169:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e311 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5c0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785196:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e318 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785203:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e318 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785209:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e318 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785218:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e31f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785223:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e31f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785227:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e31f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785257:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e326 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785269:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785274:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762715.785287:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00000004:00200000:2.0:1789762715.785289:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762715.785298:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785304:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e318 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785308:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e318 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785312:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e318 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785316:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.785318:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e318 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785322:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e318 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785328:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:2.0:1789762715.785330:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762715.785332:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e318 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785345:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56e318 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785352:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e31f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785356:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e31f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785360:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e31f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785363:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.785365:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e31f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785369:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e31f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785374:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d143e3f300) 00010000:00010000:2.0:1789762715.785375:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762715.785377:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e31f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785381:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e31f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785397:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e311 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5c0 expref: 51 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785404:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e326 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5c0 expref: 50 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.785415:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d143e3f100) 00010000:00010000:2.0:1789762715.785416:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762715.785418:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50800, rc 0) 00000100:00100000:2.0:1789762715.785446:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+50:10490:x1876702140599680:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 295us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762715.785451:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:1.0:1789762715.786308:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.786340:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140599936 00000100:00100000:2.0:1789762715.786345:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140599936 00000100:00100000:2.0:1789762715.786374:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:2.0:1789762715.786380:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+50:10490:x1876702140599936:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:2.0:1789762715.786398:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762715.786407:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e326 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5c0 expref: 50 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.786417:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d143e3f100) 00010000:00010000:2.0:1789762715.786421:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762715.786432:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e32d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.786438:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e32d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.786443:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e32d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762715.786530:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e5eabf7 reply state 00000000b9a16189 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e32d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762715.786547:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762715.786553:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00000100:00100000:2.0:1789762715.786601:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+51:10490:x1876702140599936:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 220us (294us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789762715.786606:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00010000:00010000:2.0:1789762715.787083:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e32d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.787089:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e32d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.787093:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e32d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.787096:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.787099:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e32d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.787103:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e32d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.787109:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d143e3fa00) 00010000:00010000:2.0:1789762715.787110:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789762715.787112:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e32d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.787116:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e32d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762715.791538:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762715.791584:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140600064 00000100:00100000:1.0:1789762715.791590:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140600064 00000100:00100000:1.0:1789762715.791635:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:1.0:1789762715.791649:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+50:10491:x1876702140600064:12345-192.168.203.31@tcp:101:touch.0 00010000:00010000:1.0:1789762715.791662:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762715.791676:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cdc00/0xd08452c77c56e334 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5c7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791711:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56e33b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791722:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56e33b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791739:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56e33b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791754:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e342 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791763:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e342 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791771:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e342 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791857:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc600/0xd08452c77c56e349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791868:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc600/0xd08452c77c56e349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791877:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc600/0xd08452c77c56e349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762715.791895:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00000004:00200000:1.0:1789762715.791898:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762715.791910:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc600/0xd08452c77c56e349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791920:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56e33b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791928:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56e33b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791946:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56e33b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791954:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cca00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762715.791959:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56e33b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791968:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56e33b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791978:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:1.0:1789762715.791981:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762715.791985:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56e33b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.791992:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cca00/0xd08452c77c56e33b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.792004:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e342 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.792012:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e342 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.792019:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e342 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.792025:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cd600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762715.792029:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e342 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.792062:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e342 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.792073:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d14abf2900) 00010000:00010000:1.0:1789762715.792076:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762715.792079:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e342 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.792087:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cd600/0xd08452c77c56e342 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.792114:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cdc00/0xd08452c77c56e334 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5c7 expref: 52 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.792132:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc600/0xd08452c77c56e349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5c7 expref: 51 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.792140:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:1.0:1789762715.792143:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789762715.792146:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cc600, rc 0) 00000100:00100000:1.0:1789762715.792183:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+51:10491:x1876702140600064:12345-192.168.203.31@tcp:101:touch.0 Request processed in 539us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762715.792191:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:1.0:1789762715.793392:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.793426:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140600320 00000100:00100000:2.0:1789762715.793431:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140600320 00000100:00100000:2.0:1789762715.793475:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:2.0:1789762715.793489:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+51:10491:x1876702140600320:12345-192.168.203.31@tcp:101:touch.0 00010000:00010000:2.0:1789762715.793499:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762715.793508:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e350 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5ce expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.793577:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e357 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.793589:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e357 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.793599:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e357 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.793614:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e35e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.793620:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e35e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.793626:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e35e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789762715.794059:0:7603:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789762715.794218:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e365 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.794226:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.794238:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.794262:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e357 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.794266:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e357 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.794271:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e357 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.794275:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.794277:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e357 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.794281:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e357 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.794287:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:2.0:1789762715.794290:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762715.794292:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e357 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.794296:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e357 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762715.794305:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb700635 reply state 00000000f8e44fbb transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e35e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762715.794310:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789762715.794333:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e350 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5ce expref: 54 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.794344:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5ce expref: 53 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.794354:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d143e3f100) 00010000:00010000:2.0:1789762715.794356:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762715.794359:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51e00, rc 0) 00000100:00100000:2.0:1789762715.794399:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+54:10491:x1876702140600320:12345-192.168.203.31@tcp:101:touch.0 Request processed in 914us (1009us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789762715.794407:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00010000:00010000:2.0:1789762715.795231:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e35e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.795238:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e35e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.795243:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e35e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.795247:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.795250:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e35e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.795255:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e35e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.795264:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff95d143e3fa00) 00010000:00010000:2.0:1789762715.795266:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762715.795275:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e35e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.795279:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e35e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762715.795780:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762715.795802:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140600576 00000100:00100000:3.0:1789762715.795865:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140600576 00000100:00100000:3.0:1789762715.795893:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:3.0:1789762715.795899:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+53:10491:x1876702140600576:12345-192.168.203.31@tcp:36:touch.0 00010000:00010000:3.0:1789762715.795919:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762715.795930:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56e365 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5ce expref: 53 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.795945:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d143e3f100) 00010000:00010000:3.0:1789762715.795950:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762715.795970:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e373 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.795977:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e373 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.795983:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e373 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762715.796054:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048feadb0 reply state 00000000f247a89b transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e373 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762715.796061:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762715.796103:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+54:10491:x1876702140600576:12345-192.168.203.31@tcp:36:touch.0 Request processed in 204us (325us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789762715.796108:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00010000:00010000:2.0:1789762715.796593:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e373 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.796599:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e373 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.796604:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e373 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.796607:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.796609:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e373 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.796613:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e373 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.796619:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d15055d400) 00010000:00010000:2.0:1789762715.796621:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762715.796623:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e373 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.796626:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e373 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762715.796820:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762715.796871:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140600704 00000100:00100000:1.0:1789762715.796877:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140600704 00000100:00100000:1.0:1789762715.796911:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:1.0:1789762715.796921:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+53:10491:x1876702140600704:12345-192.168.203.31@tcp:101:touch.0 00010000:00010000:1.0:1789762715.796941:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762715.796953:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc800/0xd08452c77c56e37a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5d5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.796985:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc800/0xd08452c77c56e37a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5d5 expref: 54 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.796998:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc800/0xd08452c77c56e37a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5d5 expref: 54 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762715.797017:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:1.0:1789762715.797021:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789762715.797024:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1588cc800, rc 0) 00000100:00100000:1.0:1789762715.797070:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+54:10491:x1876702140600704:12345-192.168.203.31@tcp:101:touch.0 Request processed in 150us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762715.797079:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:1.0:1789762715.797879:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.797899:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140600832 00000100:00100000:2.0:1789762715.797903:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140600832 00000100:00100000:2.0:1789762715.797932:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:2.0:1789762715.797944:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+45:2344:x1876702140600832:12345-192.168.203.31@tcp:2:touch.0 00000100:00100000:2.0:1789762715.798085:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+46:2344:x1876702140600832:12345-192.168.203.31@tcp:2:touch.0 Request processed in 141us (207us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789762715.798090:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:2.0:1789762715.798797:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762715.798942:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140601088 00000100:00100000:1.0:1789762715.798949:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140601088 00000100:00100000:1.0:1789762715.798993:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1789762715.799006:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+54:10491:x1876702140601088:12345-192.168.203.31@tcp:35:touch.0 00000100:00100000:1.0:1789762715.799181:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+55:10491:x1876702140601088:12345-192.168.203.31@tcp:35:touch.0 Request processed in 180us (383us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789762715.799188:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1789762715.803205:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.803265:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140601216 00000100:00100000:2.0:1789762715.803273:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140601216 00000100:00100000:2.0:1789762715.803322:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:2.0:1789762715.803334:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+55:10492:x1876702140601216:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:2.0:1789762715.803349:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762715.803363:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e381 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5dc expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803404:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e388 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803415:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e388 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803426:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e388 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803438:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e38f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803447:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e38f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803454:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e38f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803518:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e396 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803528:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803536:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762715.803559:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789762715.803563:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762715.803576:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803586:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803594:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e388 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803601:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e388 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803608:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e388 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803614:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.803618:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e388 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803625:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e388 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803643:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:2.0:1789762715.803646:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762715.803650:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e388 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803656:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56e388 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803667:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e38f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803674:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e38f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803680:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e38f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803686:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.803689:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e38f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803696:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e38f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803704:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff95d143e3fa00) 00010000:00010000:2.0:1789762715.803707:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762715.803710:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e38f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803716:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56e38f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803756:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56e381 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5dc expref: 57 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803769:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e396 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5dc expref: 56 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.803777:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:2.0:1789762715.803779:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762715.803782:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51000, rc 0) 00000100:00100000:2.0:1789762715.803821:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+56:10492:x1876702140601216:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 491us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762715.803829:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:2.0:1789762715.804795:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762715.804954:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140601344 00000100:00100000:3.0:1789762715.804960:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140601344 00000100:00100000:3.0:1789762715.804998:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1789762715.805008:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+46:2345:x1876702140601344:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:3.0:1789762715.805019:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762715.805032:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e39d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5e3 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762715.805069:0:10283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x6aad9c9b, atime: 0x6aad9c9b, ctime: 0x6aad9c9b, blocks: 0x1 00010000:00010000:3.0:1789762715.805091:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=120s v=(0 0) 00010000:00010000:3.0:1789762715.805097:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762715.805107:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e39d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5e3 expref: 47 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.805123:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e39d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5e3 expref: 47 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.805134:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030c00, rc 0) 00000100:00100000:3.0:1789762715.805170:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+47:2345:x1876702140601344:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 163us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762715.805178:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1789762715.806153:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.806211:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140601600 00000100:00100000:2.0:1789762715.806220:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140601600 00000100:00100000:2.0:1789762715.806287:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:2.0:1789762715.806296:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+56:10492:x1876702140601600:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:2.0:1789762715.806321:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762715.806335:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56e396 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5dc expref: 56 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.806347:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:2.0:1789762715.806351:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762715.806366:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e3a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.806375:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.806391:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762715.806502:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e7aa6be reply state 00000000aed0ead3 transno 4294967347 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762715.806510:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762715.806562:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+57:10492:x1876702140601600:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 265us (411us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789762715.806570:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00010000:00010000:2.0:1789762715.807121:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.807127:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e3a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.807131:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e3a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.807134:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.807137:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e3a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.807141:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e3a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.807148:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:2.0:1789762715.807149:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789762715.807151:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e3a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.807164:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56e3a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762715.807285:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762715.807342:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140601728 00000100:00100000:1.0:1789762715.807357:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140601728 00000100:00100000:1.0:1789762715.807389:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1789762715.807397:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+47:2344:x1876702140601728:12345-192.168.203.31@tcp:2:chmod.0 00002000:00010000:1.0:1789762715.807477:0:6654:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789762715.807480:0:6654:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762715 -> 1789762715 00002000:00010000:1.0:1789762715.807482:0:6654:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789762715 -> 1789762715 00002000:00010000:1.0:1789762715.807484:0:6654:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762715 -> 1789762715 00002000:00010000:1.0:1789762715.807487:0:6654:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789762715.807524:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+48:2344:x1876702140601728:12345-192.168.203.31@tcp:2:chmod.0 Request processed in 127us (238us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789762715.807533:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1789762715.828383:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.828429:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140601984 00000100:00100000:0.0:1789762715.828438:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140601984 00000100:00100000:0.0:1789762715.828477:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:0.0:1789762715.828483:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+56:10498:x1876702140601984:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762715.828498:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762715.828510:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5e00/0xd08452c77c56e3ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5ea expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828626:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56e3b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828637:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56e3b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828644:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56e3b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828653:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e3b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828668:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828673:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828718:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e3c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828724:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828729:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762715.828735:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789762715.828791:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56e3b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828797:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56e3b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828801:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56e3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828805:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762715.828807:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56e3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828812:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56e3b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828828:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:0.0:1789762715.828830:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762715.828851:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56e3b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828856:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4200/0xd08452c77c56e3b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828864:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828869:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e3b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828873:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e3b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828876:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762715.828878:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e3b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828881:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e3b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828886:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff95d151e90800) 00010000:00010000:0.0:1789762715.828887:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762715.828889:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e3b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828892:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5a00/0xd08452c77c56e3b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828928:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5e00/0xd08452c77c56e3ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5ea expref: 59 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828937:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5ea expref: 58 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.828943:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:0.0:1789762715.828944:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762715.828946:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f4400, rc 0) 00000100:00100000:0.0:1789762715.828982:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+58:10498:x1876702140601984:12345-192.168.203.31@tcp:101:dd.500 Request processed in 500us (604us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789762715.828987:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:2.0:1789762715.830112:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.830144:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140602240 00000100:00100000:0.0:1789762715.830149:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140602240 00000100:00100000:0.0:1789762715.830174:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:0.0:1789762715.830179:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+58:10498:x1876702140602240:12345-192.168.203.31@tcp:36:dd.500 00010000:00010000:0.0:1789762715.830199:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762715.830208:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4400/0xd08452c77c56e3c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5ea expref: 58 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.830217:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:0.0:1789762715.830219:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762715.830316:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e3ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.830323:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e3ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.830334:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e3ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762715.830381:0:7603:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967349 00000004:00010000:0.0:1789762715.830399:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008988c100 reply state 0000000096a47115 transno 4294967350 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e3ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762715.830405:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762715.830446:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+60:10498:x1876702140602240:12345-192.168.203.31@tcp:36:dd.500 Request processed in 267us (336us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789762715.830451:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00000020:00080000:0.0:1789762715.830455:0:7603:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789762715.830974:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e3ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.830985:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e3ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.830993:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e3ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.831000:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762715.831003:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e3ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.831010:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e3ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.831021:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:2.0:1789762715.831024:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762715.831027:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e3ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762715.831035:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e3ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762715.831133:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.831168:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140602368 00000100:00100000:0.0:1789762715.831173:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140602368 00000100:00100000:0.0:1789762715.831202:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1789762715.831208:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+48:10498:x1876702140602368:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762715.831215:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762715.831223:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e3d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5f1 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.831239:0:6655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e39d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5e3 expref: 49 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.831246:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762715.831249:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762715.831253:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e3d5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f1 expref: 49 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.831284:0:6655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e39d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5e3 expref: 49 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.831294:0:6655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e39d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5e3 expref: 49 pid: 10283 timeout: 220 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762715.831305:0:6655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6655:1876702148990720:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789762715.831363:0:6655:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d16a0c9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789762715.832130:0:6655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6655:1876702148990720:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762715.832147:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e3d5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f1 expref: 49 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.832156:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f5c00, rc 0) 00000100:00100000:0.0:1789762715.832181:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+49:10498:x1876702140602368:12345-192.168.203.31@tcp:101:dd.500 Request processed in 973us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762715.832186:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1789762715.832256:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762715.832356:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140602496 00000100:00100000:3.0:1789762715.832361:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140602496 00010000:00010000:3.0:1789762715.832380:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e39d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5e3 expref: 49 pid: 10283 timeout: 220 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762715.832404:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:3.0:1789762715.832411:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+49:2345:x1876702140602496:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762715.832419:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762715.832423:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e39d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5e3 expref: 49 pid: 10283 timeout: 220 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.832431:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e39d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5e3 expref: 49 pid: 10283 timeout: 220 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.832450:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e39d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5e3 expref: 49 pid: 10283 timeout: 220 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.832458:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762715.832461:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762715.832465:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e3d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f1 expref: 48 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.832472:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e3d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f1 expref: 48 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.832489:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e3d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f1 expref: 48 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762715.832496:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044cbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702148990848:192.168.203.31@tcp:105: 00000100:00100000:3.0:1789762715.832537:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17af6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1789762715.833343:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044cbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702148990848:192.168.203.31@tcp:105: 00010000:00010000:3.0:1789762715.833354:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762715.833377:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+48:2345:x1876702140602496:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 967us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762715.833382:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1789762715.833486:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762715.833516:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140602624 00000100:00100000:3.0:1789762715.833522:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140602624 00002000:00010000:3.0:1789762715.833542:0:6659:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1789762715.833552:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1462c1c00 with x1876702140602624 ext(0->18446744073709551615) 00002000:00010000:3.0:1789762715.833559:0:6659:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1462c1c00. 00000100:00100000:3.0:1789762715.833571:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 119827476423 time 119827561739 state 0x0 ref 1 00000100:00100000:3.0:1789762715.833582:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120027561739 time 119827561739 state 0x1 ref 1 00000100:00100000:3.0:1789762715.833600:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 1 deadline 120027561739 time 120306764826 state 0x0 ref 1 00000100:00100000:3.0:1789762715.833609:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+48:2344:x1876702140602624:12345-192.168.203.31@tcp:10:dd.500 00002000:00010000:3.0:1789762715.833783:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789762715.833786:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762715 -> 1789762715 00002000:00010000:3.0:1789762715.833788:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789762715 -> 1789762715 00002000:00010000:3.0:1789762715.833790:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762715 -> 1789762715 00002000:00010000:3.0:1789762715.833809:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789762715.833855:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+49:2344:x1876702140602624:12345-192.168.203.31@tcp:10:dd.500 Request processed in 246us (370us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789762715.833862:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:3.0:1789762715.833866:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 1 deadline 120027561739 time 120306764826 state 0x2 ref 0 00002000:00010000:3.0:1789762715.833870:0:6659:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1789762715.833872:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1462c1c00 with x1876702140602624 ext(0->18446744073709551615) 00002000:00010000:3.0:1789762715.833877:0:6659:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1462c1c00. 00000100:00100000:2.0:1789762715.836710:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.836745:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140602752 00000100:00100000:0.0:1789762715.836750:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140602752 00000100:00100000:0.0:1789762715.836768:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 1 deadline 120027561739 time 120306764826 state 0x0 ref 1 00000100:00100000:0.0:1789762715.836774:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 1 deadline 120506764826 time 120306764826 state 0x1 ref 1 00000100:00100000:0.0:1789762715.836792:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120506764826 time 120309956745 state 0x0 ref 1 00000100:00100000:0.0:1789762715.836800:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+49:2345:x1876702140602752:12345-192.168.203.31@tcp:4:dd.500 00010000:00010000:0.0:1789762715.836822:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.836855:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e3d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f1 expref: 49 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.836862:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762715.836865:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789762715.836868:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.836884:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e3d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f1 expref: 49 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.836910:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e3d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f1 expref: 49 pid: 6655 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762715.836919:0:6660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6660:1876702148990976:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789762715.836958:0:6660:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d16a0c9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789762715.837756:0:6660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6660:1876702148990976:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762715.837768:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762715.837947:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762715.837979:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140602880 00000100:00100000:0.0:1789762715.837984:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140602880 00010000:00010000:0.0:1789762715.838001:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e3d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f1 expref: 50 pid: 6655 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762715.838033:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:0.0:1789762715.838054:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+50:2345:x1876702140602880:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762715.838081:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762715.838090:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e3d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f1 expref: 50 pid: 6655 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.838098:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e3d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f1 expref: 50 pid: 6655 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.838108:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b073fd7a/0xd08452c77c56e3d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f1 expref: 50 pid: 6655 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.838115:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789762715.838118:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789762715.838121:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.838126:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762715.838142:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762715.838166:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+49:2345:x1876702140602880:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 126us (221us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762715.838169:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762715.838174:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00010000:00010000:2.0:1789762715.838188:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762715.872179:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1789762715.872184:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1789762715.872196:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.872217:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.872224:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.872229:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762715.872232:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.872238:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.872254:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762715.872259:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e3dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762715.872338:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+50:2345:x1876702140602752:12345-192.168.203.31@tcp:4:dd.500 Request processed in 35535us (35626us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789762715.872346:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:3.0:1789762715.872352:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120506764826 time 120309956745 state 0x2 ref 0 00000001:00080000:3.0:1789762715.872384:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:3.0:1789762715.872418:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1789762715.872452:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:3.0:1789762715.874729:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762715.874782:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140603008 00000100:00100000:2.0:1789762715.874791:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140603008 00000100:00100000:2.0:1789762715.874829:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120506764826 time 120309956745 state 0x0 ref 1 00000100:00100000:2.0:1789762715.874862:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120509956745 time 120309956745 state 0x1 ref 1 00000100:00100000:3.0:1789762716.036880:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120509956745 time 120510039232 state 0x0 ref 1 00000100:00100000:3.0:1789762716.036914:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2342:x1876702140603008:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:2.0:1789762716.036940:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762716.036956:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 1048576, mtime: 0x6aad9c9b, atime: 0x6aad9c9b, ctime: 0x6aad9c9b, blocks: 0x803 00010000:00010000:3.0:1789762716.036963:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e3e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.036977:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=120s v=(0 0) 00010000:00010000:3.0:1789762716.036981:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762716.036985:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e3e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.036996:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e3e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762716.049063:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00002000:00010000:3.0:1789762716.049105:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:3.0:1789762716.049109:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:3.0:1789762716.049118:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e3e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.049127:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e3e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.049134:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e3e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.049149:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762716.049153:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e3e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.049159:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e3e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.049172:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e3e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.049177:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e3e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762716.049232:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2342:x1876702140603008:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12337us (174502us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789762716.049240:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:3.0:1789762716.049245:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120509956745 time 120510039232 state 0x2 ref 0 00000100:00100000:1.0:1789762716.061310:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762716.061343:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140603136 00000100:00100000:3.0:1789762716.061351:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140603136 00000100:00100000:3.0:1789762716.061384:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120509956745 time 120510039232 state 0x0 ref 1 00000100:00100000:3.0:1789762716.061394:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120710039232 time 120510039232 state 0x1 ref 1 00000100:00100000:2.0:1789762716.236989:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120710039232 time 120710144859 state 0x0 ref 1 00000100:00100000:2.0:1789762716.237018:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140603136:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762716.237082:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 2097152, mtime: 0x6aad9c9b, atime: 0x6aad9c9b, ctime: 0x6aad9c9b, blocks: 0x1007 00010000:00010000:2.0:1789762716.237093:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e3ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.237110:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=120s v=(0 0) 00010000:00010000:2.0:1789762716.237115:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762716.237122:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e3ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.237140:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e3ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762716.248989:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 2097152 -> 3145728 00000001:00080000:0.0:1789762716.248994:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00002000:00010000:3.0:1789762716.248997:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1789762716.249011:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e3ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.249027:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e3ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.249034:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e3ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.249053:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762716.249057:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e3ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.249064:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e3ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.249079:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e3ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.249085:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e3ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762716.249143:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140603136:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12135us (187833us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789762716.249153:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1789762716.249159:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120710039232 time 120710144859 state 0x2 ref 0 00000100:00100000:3.0:1789762716.251231:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762716.251291:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140603264 00000100:00100000:0.0:1789762716.251300:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140603264 00000100:00100000:0.0:1789762716.251341:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120710039232 time 120710144859 state 0x0 ref 1 00000100:00100000:0.0:1789762716.251353:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120910144859 time 120710144859 state 0x1 ref 1 00000100:00100000:1.0:1789762716.326978:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789762716.326983:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789762716.326996:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148991232:0@lo:400:kworker.0 00000100:00100000:1.0:1789762716.326997:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148991104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762716.326998:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702148991360:0@lo:400:kworker.0 00000100:00100000:0.0:1789762716.327059:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702148991488:0@lo:400:kworker.0 00000100:00100000:1.0:1789762716.327091:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762716.327093:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762716.327095:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762716.327130:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148991104 00000100:00100000:0.0:1789762716.327137:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148991104 00000100:00100000:1.0:1789762716.327161:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148991872:0@lo:400:kworker.0 00000100:00100000:2.0:1789762716.327168:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702148991744:0@lo:400:kworker.0 00000100:00100000:3.0:1789762716.327171:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148991616:0@lo:400:kworker.0 00000100:00100000:0.0:1789762716.327193:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789762716.327194:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762716.327207:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148991104:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762716.327212:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762716.327224:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789762716.327231:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 102170624 pending 27262976 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762716.327237:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148991232 00000100:00100000:1.0:1789762716.327242:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148991232 00000100:00100000:2.0:1789762716.327258:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148991360 00000100:00100000:2.0:1789762716.327264:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148991360 00000100:00100000:3.0:1789762716.327274:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148991744 00000100:00100000:3.0:1789762716.327279:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148991744 00000100:00100000:1.0:1789762716.327285:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789762716.327290:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148991104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762716.327296:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702148991232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762716.327301:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789762716.327306:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789762716.327317:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702148991360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762716.327322:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789762716.327333:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702148991744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762716.327345:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702148991232:12345-0@lo:400:kworker.0 Request processed in 51us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762716.327354:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:0.0:1789762716.327359:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762716.327365:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762716.327374:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702148991360:12345-0@lo:400:kworker.0 Request processed in 60us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762716.327382:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789762716.327387:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702148991744:12345-0@lo:400:kworker.0 Request processed in 54us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762716.327391:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762716.327392:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148991872 00000100:00100000:3.0:1789762716.327398:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789762716.327402:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148991488 00000100:00100000:1.0:1789762716.327404:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148991872 00000100:00100000:2.0:1789762716.327407:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148991488 00000100:00100000:3.0:1789762716.327432:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148991616 00000100:00100000:3.0:1789762716.327436:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148991616 00000100:00080000:0.0:1789762716.327438:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762716.327446:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789762716.327451:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789762716.327458:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148991872:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789762716.327465:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762716.327466:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702148991488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762716.327487:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789762716.327498:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148991616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762716.327506:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148991872:12345-0@lo:400:kworker.0 Request processed in 51us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762716.327513:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789762716.327519:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148991872:0@lo:400:kworker.0 00000100:00100000:2.0:1789762716.327525:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702148991488:12345-0@lo:400:kworker.0 Request processed in 65us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762716.327532:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789762716.327547:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148991104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762716.327547:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148991616:12345-0@lo:400:kworker.0 Request processed in 49us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762716.327564:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789762716.327570:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702148991744:0@lo:400:kworker.0 00000100:00100000:2.0:1789762716.327587:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702148991360:0@lo:400:kworker.0 00000100:00100000:0.0:1789762716.327619:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702148991488:0@lo:400:kworker.0 00000100:00100000:3.0:1789762716.327632:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148991616:0@lo:400:kworker.0 00000100:00100000:3.0:1789762716.327641:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148991232:0@lo:400:kworker.0 00000001:00080000:3.0:1789762716.337747:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:3.0:1789762716.337797:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1789762716.337807:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:3.0:1789762716.337857:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789762716.337952:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148992000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789762716.337955:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148992128:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762716.337984:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148992256:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789762716.338007:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762716.338056:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762716.338069:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148992000 00000100:00100000:2.0:1789762716.338077:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148992000 00000100:00100000:3.0:1789762716.338090:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762716.338125:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148992256 00000100:00100000:2.0:1789762716.338128:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148992128 00000100:00100000:1.0:1789762716.338130:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148992256 00000100:00100000:0.0:1789762716.338135:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789762716.338143:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148992128 00000100:00100000:0.0:1789762716.338149:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148992000:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789762716.338161:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00002000:00080000:0.0:1789762716.338173:0:6654:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00000100:00100000:1.0:1789762716.338173:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702148992256:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789762716.338186:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00002000:00080000:1.0:1789762716.338190:0:10283:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00000100:00100000:2.0:1789762716.338201:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702148992128:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:0.0:1789762716.338202:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 8388608, mtime: 0x6aad9c99, atime: 0x6aad9c97, ctime: 0x6aad9c99, blocks: 0x1 00002000:00010000:1.0:1789762716.338211:0:10283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 8388608, mtime: 0x6aad9c99, atime: 0x6aad9c97, ctime: 0x6aad9c99, blocks: 0x4007 00010000:00010000:0.0:1789762716.338214:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b073fd7a/0xd08452c77c56e3f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762716.338219:0:10283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e3f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789762716.338222:0:6655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00010000:00010000:0.0:1789762716.338235:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=120s v=(0 0) 00010000:00010000:1.0:1789762716.338235:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=120s v=(0 0) 00010000:00010000:0.0:1789762716.338245:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762716.338246:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1789762716.338246:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aad9c96, atime: 0x6aad9c96, ctime: 0x6aad9c96, blocks: 0x1 00010000:00010000:0.0:1789762716.338262:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b073fd7a/0xd08452c77c56e3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762716.338263:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e3f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.338263:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e3ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.338293:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=120s v=(0 0) 00010000:00010000:1.0:1789762716.338294:0:10283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e3f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762716.338295:0:6654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b073fd7a/0xd08452c77c56e3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.338301:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762716.338313:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e3ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762716.338325:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b073fd7a/0xd08452c77c56e3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762716.338325:0:10283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e3f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.338331:0:6655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e3ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762716.338353:0:6654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b073fd7a/0xd08452c77c56e3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.338358:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e3ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762716.338379:0:10283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e3f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.338384:0:6655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e3ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762716.338392:0:6654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789762716.338398:0:10283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789762716.338406:0:6655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789762716.338415:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789762716.338422:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b073fd7a/0xd08452c77c56e3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338432:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762716.338436:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b073fd7a/0xd08452c77c56e3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338444:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b073fd7a/0xd08452c77c56e3f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338462:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b073fd7a/0xd08452c77c56e3f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338468:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b073fd7a/0xd08452c77c56e3f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338488:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789762716.338491:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e3f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338496:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762716.338498:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e3f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338503:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e3f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338520:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e3f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338525:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e3f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338533:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762716.338535:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e3ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338539:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762716.338541:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e3ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338546:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e3ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338553:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e3ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338558:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e3ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.338568:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762716.338569:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762716.338577:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762716.339245:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702148992000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1099us (1237us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789762716.339252:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1789762716.339274:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d043213b80/2, rc 0, transno 4294967320 00000100:00100000:3.0:1789762716.339288:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148992000:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789762716.339291:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3279:x1876702148992128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1091us (1198us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789762716.339292:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3276:x1876702148992256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1119us (1234us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1789762716.339306:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789762716.339314:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000004:00080000:3.0:1789762716.339318:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d1742e8380/2, rc 0, transno 4294967327 00010000:00010000:1.0:1789762716.339327:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762716.339336:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148992128:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789762716.339346:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789762716.339349:0:3276:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d1742eb100/2, rc 0, transno 4294967328 00000100:00100000:1.0:1789762716.339359:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148992256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789762716.437111:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120910144859 time 120910268562 state 0x0 ref 1 00000100:00100000:3.0:1789762716.437133:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140603264:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762716.437167:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 3145728, mtime: 0x6aad9c9b, atime: 0x6aad9c9b, ctime: 0x6aad9c9b, blocks: 0x1807 00010000:00010000:3.0:1789762716.437174:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e406 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.437184:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=120s v=(0 0) 00010000:00010000:3.0:1789762716.437187:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762716.437191:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e406 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.437200:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e406 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762716.449553:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967329 is committed 00000001:00080000:0.0:1789762716.449565:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967328 is committed 00002000:00010000:3.0:1789762716.449567:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1789762716.449572:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1789762716.449584:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e406 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.449594:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e406 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.449609:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e406 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.449618:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762716.449622:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e406 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.449632:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e406 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.449651:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e406 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.449660:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e406 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762716.449720:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140603264:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12593us (198489us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789762716.449728:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1789762716.449734:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120910144859 time 120910268562 state 0x2 ref 0 00000100:00100000:2.0:1789762716.451662:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762716.451696:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140603392 00000100:00100000:3.0:1789762716.451703:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140603392 00000100:00100000:3.0:1789762716.451734:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 120910144859 time 120910268562 state 0x0 ref 1 00000100:00100000:3.0:1789762716.451742:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121110268562 time 120910268562 state 0x1 ref 1 00000100:00100000:3.0:1789762716.532166:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762716.532223:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140603520 00000100:00100000:3.0:1789762716.532224:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762716.532233:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140603520 00000100:00100000:3.0:1789762716.532251:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762716.532272:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140603648 00000100:00100000:0.0:1789762716.532278:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140603648 00000100:00100000:3.0:1789762716.532283:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762716.532289:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:1.0:1789762716.532306:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140603904 00000100:00100000:2.0:1789762716.532306:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140603520:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762716.532313:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140603904 00000100:00100000:3.0:1789762716.532318:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762716.532325:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:0.0:1789762716.532336:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140603648:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762716.532361:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762716.532366:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:2.0:1789762716.532373:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140603520:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762716.532384:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140603648:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 45us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762716.532384:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140603904:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762716.532389:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:0.0:1789762716.532400:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:0.0:1789762716.532431:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140603776 00000100:00100000:1.0:1789762716.532431:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140603904:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 54us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762716.532435:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140603776 00000100:00100000:1.0:1789762716.532441:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:2.0:1789762716.532465:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140604160 00000100:00100000:2.0:1789762716.532472:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140604160 00000100:00100000:0.0:1789762716.532480:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140604032 00000100:00100000:0.0:1789762716.532485:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140604032 00000100:00100000:1.0:1789762716.532485:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:1.0:1789762716.532496:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+41:2345:x1876702140603776:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762716.532515:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1789762716.532528:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:1.0:1789762716.532534:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+41:2345:x1876702140603776:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 35us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762716.532535:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140604160:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:3.0:1789762716.532539:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762716.532546:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140604032:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:3.0:1789762716.532546:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762716.532552:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762716.532553:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1789762716.532591:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140604160:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 65us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762716.532600:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1789762716.532605:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140604032:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 63us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762716.532612:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1789762716.637195:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121110268562 time 121110352385 state 0x0 ref 1 00000100:00100000:0.0:1789762716.637220:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140603392:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762716.637266:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 4194304, mtime: 0x6aad9c9b, atime: 0x6aad9c9b, ctime: 0x6aad9c9b, blocks: 0x2007 00010000:00010000:0.0:1789762716.637273:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56e40d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762716.637287:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=121s v=(0 0) 00010000:00010000:0.0:1789762716.637290:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762716.637295:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56e40d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762716.637321:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56e40d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762716.652989:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967330 is committed 00002000:00010000:3.0:1789762716.653011:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1789762716.653016:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1789762716.653027:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56e40d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.653050:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56e40d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.653057:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56e40d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.653062:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762716.653066:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56e40d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.653072:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56e40d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.653086:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56e40d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.653099:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56e40d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762716.653170:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140603392:12345-192.168.203.31@tcp:4:dd.500 Request processed in 15958us (201508us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789762716.653178:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:3.0:1789762716.653185:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121110268562 time 121110352385 state 0x2 ref 0 00000100:00100000:3.0:1789762716.655373:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762716.655453:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140604288 00000100:00100000:2.0:1789762716.655462:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140604288 00000100:00100000:2.0:1789762716.655498:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121110268562 time 121110352385 state 0x0 ref 1 00000100:00100000:2.0:1789762716.655508:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121310352385 time 121110352385 state 0x1 ref 1 00010000:00010000:0.0:1789762716.711022:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762716.837285:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121310352385 time 121310441674 state 0x0 ref 1 00000100:00100000:3.0:1789762716.837313:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140604288:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762716.837363:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 5242880, mtime: 0x6aad9c9b, atime: 0x6aad9c9b, ctime: 0x6aad9c9b, blocks: 0x2807 00010000:00010000:3.0:1789762716.837370:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56e414 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.837384:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=121s v=(0 0) 00010000:00010000:3.0:1789762716.837387:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762716.837391:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56e414 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762716.837402:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56e414 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789762716.839129:0:7131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 121312293859ns, next at 122312290868ns, rc = 0 00000100:00100000:1.0:1789762716.839130:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762716.839149:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148992384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762716.839201:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762716.839229:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148992384 00000100:00100000:2.0:1789762716.839238:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148992384 00000100:00100000:2.0:1789762716.839286:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789762716.839298:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148992384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762716.839314:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86835200 pending 1703936 free 3847225344 avail 3844079616 00000100:00100000:2.0:1789762716.839366:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148992384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762716.839384:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789762716.839399:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967328 gen 2 00000004:00080000:1.0:1789762716.839404:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d1742e8380, transno 4294967327 00000004:00080000:1.0:1789762716.839415:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d1742eb100, transno 4294967328 00000100:00100000:1.0:1789762716.839425:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148992384:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789762716.848638:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967331 is committed 00002000:00010000:2.0:1789762716.848652:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1789762716.848657:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762715 -> 1789762716 00002000:00010000:2.0:1789762716.848660:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762715 -> 1789762716 00002000:00010000:2.0:1789762716.848662:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1789762716.848672:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56e414 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.848681:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56e414 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.848689:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56e414 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.848694:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762716.848697:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56e414 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.848704:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56e414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.848717:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56e414 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762716.848723:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56e414 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762716.848778:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140604288:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11478us (193405us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789762716.848787:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1789762716.848793:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121310352385 time 121310441674 state 0x2 ref 0 00000100:00100000:3.0:1789762716.851092:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762716.851148:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140604416 00000100:00100000:0.0:1789762716.851153:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140604416 00000100:00100000:0.0:1789762716.851183:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121310352385 time 121310441674 state 0x0 ref 1 00000100:00100000:0.0:1789762716.851191:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121510441674 time 121310441674 state 0x1 ref 1 00000100:00100000:2.0:1789762717.037402:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121510441674 time 121510557904 state 0x0 ref 1 00000100:00100000:2.0:1789762717.037425:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140604416:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762717.037472:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 6291456, mtime: 0x6aad9c9c, atime: 0x6aad9c9b, ctime: 0x6aad9c9c, blocks: 0x3007 00010000:00010000:2.0:1789762717.037479:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e41b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.037493:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=121s v=(0 0) 00010000:00010000:2.0:1789762717.037497:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762717.037501:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e41b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.037513:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e41b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762717.048861:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967332 is committed 00002000:00010000:2.0:1789762717.048878:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:2.0:1789762717.048882:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1789762717.048894:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e41b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.048922:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e41b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.048932:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e41b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.048941:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762717.048947:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e41b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.048957:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e41b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.048974:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e41b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.048982:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e41b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762717.049053:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140604416:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11635us (197960us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789762717.049061:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:2.0:1789762717.049066:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121510441674 time 121510557904 state 0x2 ref 0 00000100:00100000:3.0:1789762717.051364:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762717.051416:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140604544 00000100:00100000:1.0:1789762717.051424:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140604544 00000100:00100000:1.0:1789762717.051462:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121510441674 time 121510557904 state 0x0 ref 1 00000100:00100000:1.0:1789762717.051474:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121710557904 time 121510557904 state 0x1 ref 1 00000100:00100000:0.0:1789762717.237521:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121710557904 time 121710672649 state 0x0 ref 1 00000100:00100000:0.0:1789762717.237560:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140604544:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762717.237627:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 7340032, mtime: 0x6aad9c9c, atime: 0x6aad9c9b, ctime: 0x6aad9c9c, blocks: 0x3807 00010000:00010000:0.0:1789762717.237638:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000605169a8/0xd08452c77c56e422 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762717.237657:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=121s v=(0 0) 00010000:00010000:0.0:1789762717.237662:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762717.237669:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000605169a8/0xd08452c77c56e422 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762717.237686:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000605169a8/0xd08452c77c56e422 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762717.259413:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:3.0:1789762717.259427:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1789762717.259451:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000605169a8/0xd08452c77c56e422 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.259474:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000605169a8/0xd08452c77c56e422 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.259493:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000605169a8/0xd08452c77c56e422 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.259524:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762717.259533:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000605169a8/0xd08452c77c56e422 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.259550:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000605169a8/0xd08452c77c56e422 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.259580:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000605169a8/0xd08452c77c56e422 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.259592:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000605169a8/0xd08452c77c56e422 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762717.259708:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+10:2344:x1876702140604544:12345-192.168.203.31@tcp:4:dd.500 Request processed in 22158us (208336us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789762717.259745:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1789762717.259759:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121710557904 time 121710672649 state 0x2 ref 0 00000001:00080000:3.0:1789762717.259813:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967333 is committed 00000100:00100000:2.0:1789762717.263676:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762717.263787:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140604672 00000100:00100000:3.0:1789762717.263800:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140604672 00000100:00100000:3.0:1789762717.263875:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121710557904 time 121710672649 state 0x0 ref 1 00000100:00100000:3.0:1789762717.263891:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121910672649 time 121710672649 state 0x1 ref 1 00000001:00080000:2.0:1789762717.370458:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:2.0:1789762717.370478:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1789762717.370503:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000100:00100000:1.0:1789762717.437627:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121910672649 time 121910779432 state 0x0 ref 1 00000100:00100000:1.0:1789762717.437670:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140604672:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762717.437731:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 8388608, mtime: 0x6aad9c9c, atime: 0x6aad9c9b, ctime: 0x6aad9c9c, blocks: 0x4007 00010000:00010000:1.0:1789762717.437741:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e429 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762717.437759:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=121s v=(0 0) 00010000:00010000:1.0:1789762717.437764:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762717.437770:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e429 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762717.437785:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e429 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762717.459444:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967334 is committed 00002000:00010000:2.0:1789762717.459535:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:2.0:1789762717.459546:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:2.0:1789762717.459565:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e429 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.459586:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e429 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.459603:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e429 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.459616:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cd600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762717.459624:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e429 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.459640:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e429 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.459668:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e429 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.459682:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e429 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762717.459787:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140604672:12345-192.168.203.31@tcp:4:dd.500 Request processed in 22130us (196114us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789762717.459839:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:2.0:1789762717.459921:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121910672649 time 121910779432 state 0x2 ref 0 00000100:00100000:3.0:1789762717.463775:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762717.463868:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140604800 00000100:00100000:2.0:1789762717.463882:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140604800 00000100:00100000:2.0:1789762717.463933:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 121910672649 time 121910779432 state 0x0 ref 1 00000100:00100000:2.0:1789762717.463949:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122110779432 time 121910779432 state 0x1 ref 1 00000100:00100000:3.0:1789762717.637755:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122110779432 time 122110906151 state 0x0 ref 1 00000100:00100000:3.0:1789762717.637793:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140604800:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762717.637892:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9437184, mtime: 0x6aad9c9c, atime: 0x6aad9c9b, ctime: 0x6aad9c9c, blocks: 0x4807 00010000:00010000:3.0:1789762717.637904:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e430 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.637924:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=122s v=(0 0) 00010000:00010000:3.0:1789762717.637930:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762717.637938:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e430 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.637957:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e430 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762717.660769:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967335 is committed 00002000:00010000:3.0:1789762717.660869:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:3.0:1789762717.660875:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:3.0:1789762717.660887:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e430 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.660899:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e430 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.660907:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e430 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.660913:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762717.660918:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e430 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.660926:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e430 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.660943:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e430 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762717.660950:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e430 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762717.661040:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140604800:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23246us (197303us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789762717.661063:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:3.0:1789762717.661089:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122110779432 time 122110906151 state 0x2 ref 0 00000100:00100000:1.0:1789762717.664432:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762717.664534:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140604928 00000100:00100000:2.0:1789762717.664543:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140604928 00000100:00100000:2.0:1789762717.664583:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122110779432 time 122110906151 state 0x0 ref 1 00000100:00100000:2.0:1789762717.664601:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122310906151 time 122110906151 state 0x1 ref 1 00010000:00010000:3.0:1789762717.735024:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762717.837813:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122310906151 time 122310967322 state 0x0 ref 1 00000100:00100000:2.0:1789762717.837865:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140604928:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762717.837924:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 10485760, mtime: 0x6aad9c9c, atime: 0x6aad9c9b, ctime: 0x6aad9c9c, blocks: 0x5007 00010000:00010000:2.0:1789762717.837934:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b8e7f5/0xd08452c77c56e437 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.837951:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=122s v=(0 0) 00010000:00010000:2.0:1789762717.837956:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762717.837963:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b8e7f5/0xd08452c77c56e437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762717.837999:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b8e7f5/0xd08452c77c56e437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762717.850478:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:0.0:1789762717.850484:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762716 -> 1789762717 00002000:00010000:0.0:1789762717.850486:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762716 -> 1789762717 00002000:00010000:0.0:1789762717.850488:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 20487 -> 22535 00010000:00010000:0.0:1789762717.850499:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b8e7f5/0xd08452c77c56e437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762717.850513:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b8e7f5/0xd08452c77c56e437 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762717.850518:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967336 is committed 00010000:00010000:0.0:1789762717.850527:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4b8e7f5/0xd08452c77c56e437 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762717.850537:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762717.850543:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b8e7f5/0xd08452c77c56e437 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762717.850555:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b8e7f5/0xd08452c77c56e437 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762717.850575:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4b8e7f5/0xd08452c77c56e437 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762717.850581:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b8e7f5/0xd08452c77c56e437 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762717.850662:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140604928:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12828us (186229us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789762717.850670:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:0.0:1789762717.850678:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122310906151 time 122310967322 state 0x2 ref 0 00000100:00100000:3.0:1789762717.853401:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762717.853436:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140605056 00000100:00100000:0.0:1789762717.853444:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140605056 00000100:00100000:0.0:1789762717.853478:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122310906151 time 122310967322 state 0x0 ref 1 00000100:00100000:0.0:1789762717.853487:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122510967322 time 122310967322 state 0x1 ref 1 00000100:00100000:2.0:1789762718.037927:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122510967322 time 122511083922 state 0x0 ref 1 00000100:00100000:2.0:1789762718.037963:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140605056:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:3.0:1789762718.038011:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789762718.038015:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 11534336, mtime: 0x6aad9c9d, atime: 0x6aad9c9b, ctime: 0x6aad9c9d, blocks: 0x5807 00010000:00010000:2.0:1789762718.038039:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e43e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762718.038093:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=122s v=(0 0) 00010000:00010000:2.0:1789762718.038098:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762718.038104:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e43e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762718.038117:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e43e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762718.051450:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967337 is committed 00002000:00010000:2.0:1789762718.051469:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:2.0:1789762718.051477:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 22535 -> 24583 00010000:00010000:2.0:1789762718.051494:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e43e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762718.051523:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e43e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762718.051548:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e43e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762718.051554:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762718.051558:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e43e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762718.051564:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e43e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762718.051579:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e43e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762718.051588:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e43e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762718.051652:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140605056:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13709us (198279us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1789762718.051660:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1789762718.051667:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122510967322 time 122511083922 state 0x2 ref 0 00000100:00100000:3.0:1789762718.054259:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762718.054362:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140605184 00000100:00100000:0.0:1789762718.054372:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140605184 00000100:00100000:0.0:1789762718.054409:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122510967322 time 122511083922 state 0x0 ref 1 00000100:00100000:0.0:1789762718.054420:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122711083922 time 122511083922 state 0x1 ref 1 00000100:00100000:0.0:1789762718.238110:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122711083922 time 122711260504 state 0x0 ref 1 00000100:00100000:0.0:1789762718.238154:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140605184:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762718.238229:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 12582912, mtime: 0x6aad9c9d, atime: 0x6aad9c9b, ctime: 0x6aad9c9d, blocks: 0x6007 00010000:00010000:0.0:1789762718.238243:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095a03b0a/0xd08452c77c56e445 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762718.238264:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=122s v=(0 0) 00010000:00010000:0.0:1789762718.238271:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762718.238279:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095a03b0a/0xd08452c77c56e445 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762718.238322:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095a03b0a/0xd08452c77c56e445 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762718.259975:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967338 is committed 00002000:00010000:3.0:1789762718.259986:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:3.0:1789762718.259996:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 24583 -> 26631 00010000:00010000:3.0:1789762718.260016:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095a03b0a/0xd08452c77c56e445 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.260062:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095a03b0a/0xd08452c77c56e445 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.260076:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095a03b0a/0xd08452c77c56e445 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.260086:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762718.260092:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095a03b0a/0xd08452c77c56e445 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.260104:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095a03b0a/0xd08452c77c56e445 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.260148:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095a03b0a/0xd08452c77c56e445 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.260159:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095a03b0a/0xd08452c77c56e445 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762718.260259:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140605184:12345-192.168.203.31@tcp:4:dd.500 Request processed in 22121us (205998us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789762718.260272:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:3.0:1789762718.260283:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122711083922 time 122711260504 state 0x2 ref 0 00000100:00100000:3.0:1789762718.264188:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762718.264263:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140605312 00000100:00100000:0.0:1789762718.264280:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140605312 00000100:00100000:0.0:1789762718.264340:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122711083922 time 122711260504 state 0x0 ref 1 00000100:00100000:0.0:1789762718.264361:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122911260504 time 122711260504 state 0x1 ref 1 00000100:00100000:0.0:1789762718.438215:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122911260504 time 122911365950 state 0x0 ref 1 00000100:00100000:0.0:1789762718.438254:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140605312:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762718.438329:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 13631488, mtime: 0x6aad9c9d, atime: 0x6aad9c9b, ctime: 0x6aad9c9d, blocks: 0x6807 00010000:00010000:0.0:1789762718.438341:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56e44c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762718.438364:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=122s v=(0 0) 00010000:00010000:0.0:1789762718.438370:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762718.438379:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56e44c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762718.438398:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56e44c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762718.463311:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967339 is committed 00002000:00010000:3.0:1789762718.463347:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:3.0:1789762718.463361:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 26631 -> 28679 00010000:00010000:3.0:1789762718.463386:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56e44c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.463406:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56e44c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.463419:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56e44c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.463429:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762718.463436:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56e44c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.463462:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56e44c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.463488:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56e44c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.463498:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56e44c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762718.463617:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140605312:12345-192.168.203.31@tcp:4:dd.500 Request processed in 25372us (199423us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1789762718.463638:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:3.0:1789762718.463651:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122911260504 time 122911365950 state 0x2 ref 0 00000100:00100000:1.0:1789762718.467828:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762718.467957:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140605440 00000100:00100000:2.0:1789762718.467972:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140605440 00000100:00100000:2.0:1789762718.468053:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 122911260504 time 122911365950 state 0x0 ref 1 00000100:00100000:2.0:1789762718.468084:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123111365950 time 122911365950 state 0x1 ref 1 00000100:00100000:0.0:1789762718.638375:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123111365950 time 123111526794 state 0x0 ref 1 00000100:00100000:0.0:1789762718.638433:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140605440:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762718.638518:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 14680064, mtime: 0x6aad9c9d, atime: 0x6aad9c9b, ctime: 0x6aad9c9d, blocks: 0x7007 00010000:00010000:0.0:1789762718.638536:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e453 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762718.638565:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=123s v=(0 0) 00010000:00010000:0.0:1789762718.638574:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762718.638587:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e453 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762718.638616:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e453 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762718.660530:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967340 is committed 00002000:00010000:0.0:1789762718.660537:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:0.0:1789762718.660550:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 28679 -> 30727 00010000:00010000:0.0:1789762718.660574:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e453 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762718.660601:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e453 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762718.660621:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e453 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762718.660638:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762718.660649:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e453 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762718.660676:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e453 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762718.660702:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e453 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762718.660714:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e453 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762718.660826:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140605440:12345-192.168.203.31@tcp:4:dd.500 Request processed in 22400us (192998us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789762718.660892:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:0.0:1789762718.660901:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123111365950 time 123111526794 state 0x2 ref 0 00000100:00100000:1.0:1789762718.665679:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762718.665816:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140605568 00000100:00100000:2.0:1789762718.665871:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140605568 00000100:00100000:2.0:1789762718.665935:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123111365950 time 123111526794 state 0x0 ref 1 00000100:00100000:2.0:1789762718.665952:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123311526794 time 123111526794 state 0x1 ref 1 00010000:00010000:1.0:1789762718.758964:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762718.838453:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123311526794 time 123311608150 state 0x0 ref 1 00000100:00100000:2.0:1789762718.838490:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140605568:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762718.838555:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 15728640, mtime: 0x6aad9c9d, atime: 0x6aad9c9b, ctime: 0x6aad9c9d, blocks: 0x7807 00010000:00010000:2.0:1789762718.838565:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e45a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762718.838583:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=123s v=(0 0) 00010000:00010000:2.0:1789762718.838588:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762718.838595:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e45a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762718.838609:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e45a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762718.857182:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967341 is committed 00002000:00010000:3.0:1789762718.857248:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:3.0:1789762718.857255:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762717 -> 1789762718 00002000:00010000:3.0:1789762718.857258:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762717 -> 1789762718 00002000:00010000:3.0:1789762718.857261:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 30727 -> 32775 00010000:00010000:3.0:1789762718.857275:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e45a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.857288:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e45a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.857299:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e45a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.857316:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762718.857321:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e45a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.857330:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e45a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.857349:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e45a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762718.857357:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e45a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762718.857446:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140605568:12345-192.168.203.31@tcp:4:dd.500 Request processed in 18970us (191769us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789762718.857457:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:3.0:1789762718.857466:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123311526794 time 123311608150 state 0x2 ref 0 00000100:00100000:3.0:1789762718.860662:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762718.860737:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140605696 00000100:00100000:0.0:1789762718.860749:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140605696 00000100:00100000:0.0:1789762718.860793:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123311526794 time 123311608150 state 0x0 ref 1 00000100:00100000:0.0:1789762718.860806:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123511608150 time 123311608150 state 0x1 ref 1 00000100:00100000:2.0:1789762719.038721:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123511608150 time 123511872514 state 0x0 ref 1 00000100:00100000:2.0:1789762719.038759:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140605696:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762719.038907:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 16777216, mtime: 0x6aad9c9e, atime: 0x6aad9c9b, ctime: 0x6aad9c9e, blocks: 0x8007 00010000:00010000:2.0:1789762719.038920:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e461 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762719.038942:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=123s v=(0 0) 00010000:00010000:2.0:1789762719.038948:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762719.038956:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e461 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762719.038974:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e461 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762719.062680:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967342 is committed 00002000:00010000:3.0:1789762719.062831:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:3.0:1789762719.062877:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 32775 -> 34823 00010000:00010000:3.0:1789762719.062896:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e461 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.062914:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e461 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.062940:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e461 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.062950:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762719.062956:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e461 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.062969:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e461 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.062994:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e461 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.063004:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e461 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762719.063146:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140605696:12345-192.168.203.31@tcp:4:dd.500 Request processed in 24397us (202480us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1789762719.063161:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1789762719.063171:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123511608150 time 123511872514 state 0x2 ref 0 00000100:00100000:3.0:1789762719.066515:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762719.066566:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140605824 00000100:00100000:0.0:1789762719.066576:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140605824 00000100:00100000:0.0:1789762719.066615:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123511608150 time 123511872514 state 0x0 ref 1 00000100:00100000:0.0:1789762719.066625:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123711872514 time 123511872514 state 0x1 ref 1 00000100:00100000:0.0:1789762719.238773:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123711872514 time 123711929670 state 0x0 ref 1 00000100:00100000:0.0:1789762719.238813:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140605824:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762719.238930:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 17825792, mtime: 0x6aad9c9e, atime: 0x6aad9c9b, ctime: 0x6aad9c9e, blocks: 0x8807 00010000:00010000:0.0:1789762719.238947:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e468 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762719.238994:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=123s v=(0 0) 00010000:00010000:0.0:1789762719.239003:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762719.239036:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e468 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762719.239077:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e468 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762719.258231:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967343 is committed 00002000:00010000:3.0:1789762719.258336:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:3.0:1789762719.258345:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 34823 -> 36871 00010000:00010000:3.0:1789762719.258361:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e468 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.258389:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e468 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.258402:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e468 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.258411:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762719.258417:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e468 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.258429:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e468 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.258452:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e468 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.258462:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005a74a05/0xd08452c77c56e468 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762719.258563:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140605824:12345-192.168.203.31@tcp:4:dd.500 Request processed in 19749us (192040us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789762719.258583:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1789762719.258597:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123711872514 time 123711929670 state 0x2 ref 0 00000100:00100000:3.0:1789762719.262250:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762719.262394:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140605952 00000100:00100000:2.0:1789762719.262409:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140605952 00000100:00100000:2.0:1789762719.262463:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123711872514 time 123711929670 state 0x0 ref 1 00000100:00100000:2.0:1789762719.262479:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123911929670 time 123711929670 state 0x1 ref 1 00000100:00100000:0.0:1789762719.438940:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123911929670 time 123912093144 state 0x0 ref 1 00000100:00100000:0.0:1789762719.438977:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140605952:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762719.439071:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 18874368, mtime: 0x6aad9c9e, atime: 0x6aad9c9b, ctime: 0x6aad9c9e, blocks: 0x9007 00010000:00010000:0.0:1789762719.439084:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a81897e/0xd08452c77c56e46f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762719.439106:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=123s v=(0 0) 00010000:00010000:0.0:1789762719.439112:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762719.439121:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a81897e/0xd08452c77c56e46f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762719.439163:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a81897e/0xd08452c77c56e46f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762719.461622:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967344 is committed 00002000:00010000:3.0:1789762719.461712:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:3.0:1789762719.461721:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 36871 -> 38919 00010000:00010000:3.0:1789762719.461739:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a81897e/0xd08452c77c56e46f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.461757:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a81897e/0xd08452c77c56e46f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.461769:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a81897e/0xd08452c77c56e46f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.461778:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762719.461785:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a81897e/0xd08452c77c56e46f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.461797:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a81897e/0xd08452c77c56e46f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.461820:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a81897e/0xd08452c77c56e46f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.461861:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a81897e/0xd08452c77c56e46f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762719.461970:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140605952:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23003us (199716us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789762719.461983:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:3.0:1789762719.462004:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123911929670 time 123912093144 state 0x2 ref 0 00000100:00100000:3.0:1789762719.466075:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762719.466177:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140606080 00000100:00100000:2.0:1789762719.466190:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140606080 00000100:00100000:2.0:1789762719.466243:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 123911929670 time 123912093144 state 0x0 ref 1 00000100:00100000:2.0:1789762719.466258:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124112093144 time 123912093144 state 0x1 ref 1 00000100:00100000:2.0:1789762719.639088:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124112093144 time 124112240261 state 0x0 ref 1 00000100:00100000:2.0:1789762719.639129:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140606080:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762719.639220:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 19922944, mtime: 0x6aad9c9e, atime: 0x6aad9c9b, ctime: 0x6aad9c9e, blocks: 0x9807 00010000:00010000:2.0:1789762719.639233:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e476 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762719.639254:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=124s v=(0 0) 00010000:00010000:2.0:1789762719.639260:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762719.639268:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e476 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762719.639289:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e476 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762719.660408:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967345 is committed 00002000:00010000:3.0:1789762719.660441:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:3.0:1789762719.660454:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 38919 -> 40967 00010000:00010000:3.0:1789762719.660478:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e476 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.660500:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e476 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.660518:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e476 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.660532:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762719.660541:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e476 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.660560:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e476 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.660592:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e476 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762719.660608:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e476 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762719.660718:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140606080:12345-192.168.203.31@tcp:4:dd.500 Request processed in 21604us (194642us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789762719.660751:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1789762719.660764:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124112093144 time 124112240261 state 0x2 ref 0 00000100:00100000:3.0:1789762719.664285:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762719.664419:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140606208 00000100:00100000:2.0:1789762719.664433:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140606208 00000100:00100000:2.0:1789762719.664485:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124112093144 time 124112240261 state 0x0 ref 1 00000100:00100000:2.0:1789762719.664502:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124312240261 time 124112240261 state 0x1 ref 1 00010000:00010000:2.0:1789762719.783146:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762719.839194:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124312240261 time 124312347241 state 0x0 ref 1 00000100:00100000:2.0:1789762719.839233:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140606208:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762719.839304:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 20971520, mtime: 0x6aad9c9e, atime: 0x6aad9c9b, ctime: 0x6aad9c9e, blocks: 0xa007 00010000:00010000:2.0:1789762719.839317:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e47d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762719.839338:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=124s v=(0 0) 00010000:00010000:2.0:1789762719.839363:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762719.839371:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e47d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762719.839389:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e47d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762719.861378:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00002000:00010000:2.0:1789762719.861487:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:2.0:1789762719.861493:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762718 -> 1789762719 00002000:00010000:2.0:1789762719.861513:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762718 -> 1789762719 00002000:00010000:2.0:1789762719.861517:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 40967 -> 43015 00010000:00010000:2.0:1789762719.861538:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e47d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762719.861564:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e47d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762719.861583:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e47d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762719.861612:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762719.861619:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e47d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762719.861634:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e47d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762719.861679:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e47d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762719.861687:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e47d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762719.861784:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140606208:12345-192.168.203.31@tcp:4:dd.500 Request processed in 22563us (197493us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789762719.861800:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:2.0:1789762719.861811:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124312240261 time 124312347241 state 0x2 ref 0 00000100:00100000:3.0:1789762719.865124:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762719.865202:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140606336 00000100:00100000:0.0:1789762719.865214:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140606336 00000100:00100000:0.0:1789762719.865281:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124312240261 time 124312347241 state 0x0 ref 1 00000100:00100000:0.0:1789762719.865298:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124512347241 time 124312347241 state 0x1 ref 1 00000100:00100000:2.0:1789762720.039317:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124512347241 time 124512468051 state 0x0 ref 1 00000100:00100000:2.0:1789762720.039376:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140606336:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:3.0:1789762720.039425:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789762720.039451:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 22020096, mtime: 0x6aad9c9f, atime: 0x6aad9c9b, ctime: 0x6aad9c9f, blocks: 0xa807 00010000:00010000:2.0:1789762720.039465:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e484 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.039486:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=124s v=(0 0) 00010000:00010000:2.0:1789762720.039493:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762720.039500:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e484 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.039519:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e484 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762720.063705:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967347 is committed 00002000:00010000:2.0:1789762720.063886:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:2.0:1789762720.063895:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 43015 -> 45063 00010000:00010000:2.0:1789762720.063912:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e484 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.063929:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e484 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.063941:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e484 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.063950:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762720.063957:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e484 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.063969:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e484 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.063991:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e484 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.064001:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e484 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762720.064144:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140606336:12345-192.168.203.31@tcp:4:dd.500 Request processed in 24797us (199014us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789762720.064174:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1789762720.064183:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124512347241 time 124512468051 state 0x2 ref 0 00000100:00100000:1.0:1789762720.068113:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762720.068195:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140606464 00000100:00100000:3.0:1789762720.068208:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140606464 00000100:00100000:3.0:1789762720.068262:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124512347241 time 124512468051 state 0x0 ref 1 00000100:00100000:3.0:1789762720.068278:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124712468051 time 124512468051 state 0x1 ref 1 00000100:00100000:0.0:1789762720.239424:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124712468051 time 124712577217 state 0x0 ref 1 00000100:00100000:0.0:1789762720.239459:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140606464:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762720.239526:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 23068672, mtime: 0x6aad9c9f, atime: 0x6aad9c9b, ctime: 0x6aad9c9f, blocks: 0xb007 00010000:00010000:0.0:1789762720.239539:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e48b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762720.239560:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=124s v=(0 0) 00010000:00010000:0.0:1789762720.239566:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762720.239574:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e48b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762720.239593:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e48b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762720.262392:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967348 is committed 00002000:00010000:2.0:1789762720.262511:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:2.0:1789762720.262520:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 45063 -> 47111 00010000:00010000:2.0:1789762720.262537:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e48b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.262555:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e48b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.262567:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e48b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.262577:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762720.262583:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e48b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.262596:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e48b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.262618:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e48b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.262628:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e48b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762720.262750:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140606464:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23298us (194637us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789762720.262766:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:2.0:1789762720.262777:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124712468051 time 124712577217 state 0x2 ref 0 00000100:00100000:3.0:1789762720.266912:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762720.266972:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140606592 00000100:00100000:2.0:1789762720.266986:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140606592 00000100:00100000:2.0:1789762720.267065:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124712468051 time 124712577217 state 0x0 ref 1 00000100:00100000:2.0:1789762720.267084:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124912577217 time 124712577217 state 0x1 ref 1 00000100:00100000:3.0:1789762720.439558:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124912577217 time 124912708744 state 0x0 ref 1 00000100:00100000:3.0:1789762720.439596:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140606592:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762720.439668:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 24117248, mtime: 0x6aad9c9f, atime: 0x6aad9c9b, ctime: 0x6aad9c9f, blocks: 0xb807 00010000:00010000:3.0:1789762720.439681:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e492 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762720.439703:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=124s v=(0 0) 00010000:00010000:3.0:1789762720.439709:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762720.439717:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e492 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762720.439757:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e492 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762720.461333:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967349 is committed 00002000:00010000:2.0:1789762720.461444:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:2.0:1789762720.461453:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 47111 -> 49159 00010000:00010000:2.0:1789762720.461469:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e492 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.461486:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e492 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.461499:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e492 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.461508:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762720.461514:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e492 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.461546:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e492 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.461569:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e492 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.461578:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e492 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762720.461711:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140606592:12345-192.168.203.31@tcp:4:dd.500 Request processed in 22127us (194800us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789762720.461726:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:2.0:1789762720.461737:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124912577217 time 124912708744 state 0x2 ref 0 00000100:00100000:1.0:1789762720.465746:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762720.465814:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140606720 00000100:00100000:2.0:1789762720.465827:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140606720 00000100:00100000:2.0:1789762720.465910:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 124912577217 time 124912708744 state 0x0 ref 1 00000100:00100000:2.0:1789762720.465928:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125112708744 time 124912708744 state 0x1 ref 1 00000100:00100000:2.0:1789762720.639654:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125112708744 time 125112806124 state 0x0 ref 1 00000100:00100000:2.0:1789762720.639693:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140606720:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762720.639767:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 25165824, mtime: 0x6aad9c9f, atime: 0x6aad9c9b, ctime: 0x6aad9c9f, blocks: 0xc007 00010000:00010000:2.0:1789762720.639785:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e499 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.639885:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=125s v=(0 0) 00010000:00010000:2.0:1789762720.639894:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762720.639906:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e499 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.639936:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e499 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762720.662106:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00002000:00010000:2.0:1789762720.662191:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:2.0:1789762720.662201:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 49159 -> 51207 00010000:00010000:2.0:1789762720.662222:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e499 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.662240:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e499 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.662253:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e499 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.662262:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762720.662269:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e499 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.662281:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e499 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.662327:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e499 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.662338:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e499 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762720.662447:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140606720:12345-192.168.203.31@tcp:4:dd.500 Request processed in 22765us (196700us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789762720.662462:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:2.0:1789762720.662474:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125112708744 time 125112806124 state 0x2 ref 0 00000100:00100000:3.0:1789762720.666519:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762720.666604:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140606848 00000100:00100000:2.0:1789762720.666620:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140606848 00000100:00100000:2.0:1789762720.666676:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125112708744 time 125112806124 state 0x0 ref 1 00000100:00100000:2.0:1789762720.666692:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125312806124 time 125112806124 state 0x1 ref 1 00010000:00010000:0.0:1789762720.807081:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762720.839732:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125312806124 time 125312888159 state 0x0 ref 1 00000100:00100000:2.0:1789762720.839767:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140606848:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762720.839853:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 26214400, mtime: 0x6aad9c9f, atime: 0x6aad9c9b, ctime: 0x6aad9c9f, blocks: 0xc807 00010000:00010000:2.0:1789762720.839863:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.839880:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=125s v=(0 0) 00010000:00010000:2.0:1789762720.839884:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762720.839904:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.839917:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762720.858047:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967351 is committed 00002000:00010000:2.0:1789762720.858100:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:2.0:1789762720.858107:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762719 -> 1789762720 00002000:00010000:2.0:1789762720.858111:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762719 -> 1789762720 00002000:00010000:2.0:1789762720.858115:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 51207 -> 53255 00010000:00010000:2.0:1789762720.858132:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.858151:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.858163:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.858170:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762720.858175:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.858184:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.858202:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762720.858220:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762720.858308:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140606848:12345-192.168.203.31@tcp:4:dd.500 Request processed in 18556us (191793us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789762720.858318:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:2.0:1789762720.858327:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125312806124 time 125312888159 state 0x2 ref 0 00000100:00100000:3.0:1789762720.861245:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762720.861328:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140606976 00000100:00100000:2.0:1789762720.861339:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140606976 00000100:00100000:2.0:1789762720.861380:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125312806124 time 125312888159 state 0x0 ref 1 00000100:00100000:2.0:1789762720.861392:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125512888159 time 125312888159 state 0x1 ref 1 00000100:00100000:2.0:1789762721.039879:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125512888159 time 125512991536 state 0x0 ref 1 00000100:00100000:2.0:1789762721.039918:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140606976:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762721.039988:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 27262976, mtime: 0x6aad9ca0, atime: 0x6aad9c9b, ctime: 0x6aad9ca0, blocks: 0xd007 00010000:00010000:2.0:1789762721.040028:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.040051:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=125s v=(0 0) 00010000:00010000:2.0:1789762721.040057:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762721.040066:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.040129:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762721.064212:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967352 is committed 00002000:00010000:2.0:1789762721.064339:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:2.0:1789762721.064348:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 53255 -> 55303 00010000:00010000:2.0:1789762721.064368:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.064385:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.064398:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.064407:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762721.064413:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.064426:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.064449:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.064458:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762721.064598:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140606976:12345-192.168.203.31@tcp:4:dd.500 Request processed in 24687us (203345us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789762721.064621:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:2.0:1789762721.064635:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125512888159 time 125512991536 state 0x2 ref 0 00000100:00100000:3.0:1789762721.068756:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762721.068913:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140607104 00000100:00100000:0.0:1789762721.068940:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140607104 00000100:00100000:0.0:1789762721.068997:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125512888159 time 125512991536 state 0x0 ref 1 00000100:00100000:0.0:1789762721.069040:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125712991536 time 125512991536 state 0x1 ref 1 00000100:00100000:2.0:1789762721.239971:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125712991536 time 125713122364 state 0x0 ref 1 00000100:00100000:2.0:1789762721.240036:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140607104:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762721.240108:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 28311552, mtime: 0x6aad9ca0, atime: 0x6aad9c9b, ctime: 0x6aad9ca0, blocks: 0xd807 00010000:00010000:2.0:1789762721.240121:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.240142:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=125s v=(0 0) 00010000:00010000:2.0:1789762721.240148:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762721.240156:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.240175:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762721.258207:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967353 is committed 00002000:00010000:2.0:1789762721.258294:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:2.0:1789762721.258300:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 55303 -> 57351 00010000:00010000:2.0:1789762721.258314:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.258351:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.258364:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.258375:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762721.258382:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.258395:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.258420:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.258428:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762721.258525:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140607104:12345-192.168.203.31@tcp:4:dd.500 Request processed in 18526us (189771us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789762721.258539:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:2.0:1789762721.258550:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125712991536 time 125713122364 state 0x2 ref 0 00000100:00100000:1.0:1789762721.261885:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762721.261937:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140607232 00000100:00100000:3.0:1789762721.261948:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140607232 00000100:00100000:3.0:1789762721.261989:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125712991536 time 125713122364 state 0x0 ref 1 00000100:00100000:3.0:1789762721.262019:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125913122364 time 125713122364 state 0x1 ref 1 00000100:00100000:0.0:1789762721.440161:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125913122364 time 125913308712 state 0x0 ref 1 00000100:00100000:0.0:1789762721.440202:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140607232:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762721.440290:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 29360128, mtime: 0x6aad9ca0, atime: 0x6aad9c9b, ctime: 0x6aad9ca0, blocks: 0xe007 00010000:00010000:0.0:1789762721.440298:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e4b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762721.440314:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=125s v=(0 0) 00010000:00010000:0.0:1789762721.440318:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762721.440323:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e4b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762721.440335:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e4b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789762721.447960:0:8167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 125921124002ns, next at 126921121036ns, rc = 0 00000100:00100000:3.0:1789762721.448283:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148992512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762721.448422:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702148992896:0@lo:400:kworker.0 00000100:00100000:2.0:1789762721.448488:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762721.448546:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789762721.448553:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702148992768:0@lo:400:kworker.0 00000100:00100000:2.0:1789762721.448577:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762721.448600:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148993280:0@lo:400:kworker.0 00000100:00100000:2.0:1789762721.448639:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762721.448701:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148992896 00000100:00100000:2.0:1789762721.448708:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148992896 00000100:00080000:0.0:1789762721.448740:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762721.448771:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148992768 00000100:00100000:0.0:1789762721.448776:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148992768 00000100:00100000:2.0:1789762721.448778:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789762721.448792:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702148992896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762721.448815:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789762721.448826:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148992768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762721.448874:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702148992896:12345-0@lo:400:kworker.0 Request processed in 85us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762721.448882:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789762721.448895:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148992768:12345-0@lo:400:kworker.0 Request processed in 71us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762721.448911:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789762721.448916:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148992640:0@lo:400:kworker.0 00000100:00100000:2.0:1789762721.448951:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762721.448981:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148992640 00000100:00100000:0.0:1789762721.448987:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148992640 00000100:00100000:2.0:1789762721.448995:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702148993152:0@lo:400:kworker.0 00000100:00100000:0.0:1789762721.449043:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789762721.449043:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762721.449058:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a133c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702148992640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762721.449069:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789762721.449077:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148993024:0@lo:400:kworker.0 00000100:00100000:0.0:1789762721.449107:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a133c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702148992640:12345-0@lo:400:kworker.0 Request processed in 55us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762721.449115:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762721.449121:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789762721.449144:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148993280 00000100:00100000:1.0:1789762721.449150:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148993280 00000100:00100000:2.0:1789762721.449165:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148992640:0@lo:400:kworker.0 00000100:00080000:0.0:1789762721.449176:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762721.449196:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148993024 00000100:00100000:1.0:1789762721.449200:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148993024 00000100:00100000:2.0:1789762721.449214:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148993152 00000100:00100000:2.0:1789762721.449220:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148993152 00000100:00080000:0.0:1789762721.449223:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762721.449233:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762721.449236:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789762721.449248:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148993280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762721.449268:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789762721.449281:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702148993152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762721.449293:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148993280:12345-0@lo:400:kworker.0 Request processed in 47us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762721.449300:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789762721.449318:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789762721.449327:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148993024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762721.449352:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702148993152:12345-0@lo:400:kworker.0 Request processed in 73us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762721.449363:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789762721.449370:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702148993152:0@lo:400:kworker.0 00000100:00100000:1.0:1789762721.449378:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148993024:12345-0@lo:400:kworker.0 Request processed in 51us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762721.449388:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789762721.449396:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148993024:0@lo:400:kworker.0 00000100:00100000:2.0:1789762721.449419:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762721.449444:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148992512 00000100:00100000:0.0:1789762721.449449:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148992512 00000100:00100000:0.0:1789762721.449484:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789762721.449488:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702148992768:0@lo:400:kworker.0 00000100:00100000:0.0:1789762721.449495:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148992512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762721.449505:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967320 gen 2 00000004:00080000:2.0:1789762721.449511:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d043213b80, transno 4294967320 00002000:00000024:0.0:1789762721.449520:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 74907648 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789762721.449530:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148993280:0@lo:400:kworker.0 00000100:00100000:2.0:1789762721.449552:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702148992896:0@lo:400:kworker.0 00000100:00100000:0.0:1789762721.449566:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148992512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762721.449573:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789762721.450071:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148992512:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789762721.457704:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:1.0:1789762721.457785:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762721.457801:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148993408:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762721.457902:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762721.457990:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148993408 00000100:00100000:1.0:1789762721.457995:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148993408 00000100:00100000:1.0:1789762721.458066:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789762721.458081:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148993408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789762721.458103:0:6654:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1789762721.458125:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.458143:0:6654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56e215 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e57a expref: 11 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.458152:0:6654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c56e21c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e581 expref: 11 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.458159:0:6654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c56e223 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e588 expref: 11 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.458164:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1789762721.458168:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762721.458188:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.458227:0:6654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c56e223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e588 expref: 11 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.458241:0:6654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c56e223 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e588 expref: 11 pid: 10283 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762721.458251:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6654:1876702148993536:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789762721.458352:0:6654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c56e21c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e581 expref: 11 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.458361:0:6654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c56e21c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e581 expref: 11 pid: 6654 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762721.458371:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6654:1876702148993664:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789762721.458424:0:6654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56e215 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e57a expref: 11 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.458434:0:6654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56e215 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e57a expref: 11 pid: 8803 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762721.458444:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6654:1876702148993792:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789762721.458471:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d173b86600 going to sleep for 11 seconds 00000100:00100000:0.0:1789762721.459545:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6654:1876702148993536:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789762721.459557:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6654:1876702148993664:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789762721.459567:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6654:1876702148993792:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762721.459601:0:6654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762721.459697:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762721.459744:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140607488 00000100:00100000:1.0:1789762721.459749:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140607488 00010000:00010000:1.0:1789762721.459770:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c56e21c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e581 expref: 12 pid: 6654 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762721.459798:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:1.0:1789762721.459807:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+12:2343:x1876702140607488:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762721.459816:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762721.459821:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c56e21c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e581 expref: 12 pid: 6654 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.459871:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c56e21c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e581 expref: 12 pid: 6654 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762721.459877:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:1.0:1789762721.459900:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c56e21c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e581 expref: 12 pid: 6654 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.459913:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762721.459917:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140607360 00000100:00100000:2.0:1789762721.459918:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762721.459923:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140607360 00010000:00010000:3.0:1789762721.459944:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c56e223 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e588 expref: 12 pid: 10283 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762721.459945:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140607616 00000100:00100000:1.0:1789762721.459946:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+12:2343:x1876702140607488:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 139us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762721.459952:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140607616 00000100:00100000:1.0:1789762721.459964:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00010000:00010000:0.0:1789762721.459973:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56e215 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e57a expref: 13 pid: 8803 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762721.459991:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:1.0:1789762721.460010:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:3.0:1789762721.460051:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+12:2344:x1876702140607360:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789762721.460052:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a048850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+12:2342:x1876702140607616:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762721.460068:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762721.460068:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762721.460073:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56e215 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e57a expref: 12 pid: 8803 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.460085:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c56e223 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e588 expref: 12 pid: 10283 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.460089:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56e215 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e57a expref: 12 pid: 8803 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.460112:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c56e223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e588 expref: 12 pid: 10283 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.460129:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56e215 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e57a expref: 12 pid: 8803 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.460138:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c56e223 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e588 expref: 12 pid: 10283 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.460142:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762721.460149:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762721.460160:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762721.460167:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.460175:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762721.460190:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762721.460210:0:6654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762721.460210:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+10:2344:x1876702140607360:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 210us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762721.460222:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a048850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+10:2342:x1876702140607616:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 201us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762721.460230:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00010000:00010000:2.0:1789762721.460235:0:6654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762721.460242:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00010000:00010000:2.0:1789762721.460251:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.460258:0:6654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.460282:0:6654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762721.460294:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762721.460301:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.460307:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cca00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762721.460311:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.460321:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.460338:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.460360:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e4bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.460428:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762721.460432:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762721.460436:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762721.460716:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702148993408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2636us (2854us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789762721.460722:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000004:00080000:1.0:1789762721.460749:0:3276:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d1742bd880/2, rc 0, transno 4294967355 00000100:00100000:1.0:1789762721.460755:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148993408:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789762721.461264:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967354 is committed 00002000:00010000:3.0:1789762721.461288:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:3.0:1789762721.461294:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 57351 -> 59399 00010000:00010000:3.0:1789762721.461304:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e4b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.461315:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e4b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.461324:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e4b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.461332:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762721.461336:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e4b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.461344:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e4b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.461357:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e4b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.461379:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e4b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762721.461432:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140607232:12345-192.168.203.31@tcp:4:dd.500 Request processed in 21244us (199549us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789762721.461443:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:3.0:1789762721.461450:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125913122364 time 125913308712 state 0x2 ref 0 00000100:00100000:1.0:1789762721.463551:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762721.463618:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140607744 00000100:00100000:2.0:1789762721.463624:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140607744 00000100:00100000:2.0:1789762721.463652:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 125913122364 time 125913308712 state 0x0 ref 1 00000100:00100000:2.0:1789762721.463662:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126113308712 time 125913308712 state 0x1 ref 1 00000100:00100000:3.0:1789762721.640251:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126113308712 time 126113406666 state 0x0 ref 1 00000100:00100000:3.0:1789762721.640281:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140607744:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762721.640340:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 30408704, mtime: 0x6aad9ca0, atime: 0x6aad9c9b, ctime: 0x6aad9ca0, blocks: 0xe807 00010000:00010000:3.0:1789762721.640351:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.640369:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=126s v=(0 0) 00010000:00010000:3.0:1789762721.640373:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762721.640379:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.640392:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762721.652439:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762721.652550:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140607872 00000100:00100000:0.0:1789762721.652559:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140607872 00000100:00100000:0.0:1789762721.652602:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:0.0:1789762721.652611:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140607872:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762721.652669:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140607872:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 60us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762721.652678:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:1.0:1789762721.652729:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762721.652796:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140608128 00000100:00100000:2.0:1789762721.652804:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140608128 00000100:00100000:1.0:1789762721.652805:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762721.652856:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140608000 00000100:00100000:0.0:1789762721.652860:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140608000 00000100:00100000:1.0:1789762721.652890:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762721.652899:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1789762721.652907:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140608256 00000100:00100000:0.0:1789762721.652913:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140608256 00000100:00100000:2.0:1789762721.652914:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140608128:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762721.652944:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1789762721.652953:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1789762721.652961:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2343:x1876702140608000:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762721.652967:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140608256:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762721.653039:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140608256:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 73us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762721.653039:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140608128:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 127us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762721.653043:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2343:x1876702140608000:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 85us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762721.653060:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1789762721.653068:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1789762721.653084:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00080000:0.0:1789762721.653086:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762721.653099:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789762721.654160:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967355 is committed 00000001:00080000:0.0:1789762721.654172:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967356 is committed 00002000:00010000:3.0:1789762721.654181:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:3.0:1789762721.654187:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 59399 -> 61447 00010000:00010000:3.0:1789762721.654205:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.654220:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.654232:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.654242:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762721.654247:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.654259:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.654278:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.654284:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762721.654333:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140607744:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14067us (190784us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1789762721.654342:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:3.0:1789762721.654348:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126113308712 time 126113406666 state 0x2 ref 0 00000100:00100000:1.0:1789762721.657872:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762721.657931:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140608384 00000100:00100000:3.0:1789762721.657942:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140608384 00000100:00100000:1.0:1789762721.657970:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00080000:0.0:1789762721.657990:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762721.658028:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1789762721.658038:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2341:x1876702140608384:12345-192.168.203.31@tcp:9:kworker.0 00000100:00100000:3.0:1789762721.658044:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140608512 00000100:00100000:3.0:1789762721.658051:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140608512 00000020:00000080:1.0:1789762721.658068:0:6654:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd08452c77c56de25 00000100:00080000:0.0:1789762721.658080:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762721.658080:0:6654:0:(import.c:65:import_set_state_nolock()) ffff95d17b478000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789762721.658101:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00010000:00010000:0.0:1789762721.658106:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762721.658113:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2341:x1876702140608512:12345-192.168.203.31@tcp:9:kworker.0 00000001:00000004:1.0:1789762721.658117:0:6654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967356 00000020:00000080:3.0:1789762721.658129:0:8803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd08452c77c56de2c 00000100:00080000:3.0:1789762721.658138:0:8803:0:(import.c:65:import_set_state_nolock()) ffff95d041c1e000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789762721.658164:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789762721.658170:0:8803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967320 00000100:00100000:1.0:1789762721.658346:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+2:2341:x1876702140608384:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 309us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762721.658353:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:3.0:1789762721.658415:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+2:2341:x1876702140608512:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 305us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762721.658423:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:1.0:1789762721.660734:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762721.660778:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140608640 00000100:00100000:2.0:1789762721.660784:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140608640 00000100:00100000:2.0:1789762721.660810:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126113308712 time 126113406666 state 0x0 ref 1 00000100:00100000:2.0:1789762721.660820:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126313406666 time 126113406666 state 0x1 ref 1 00010000:00010000:0.0:1789762721.831073:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762721.840360:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126313406666 time 126313516731 state 0x0 ref 1 00000100:00100000:2.0:1789762721.840392:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140608640:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762721.840487:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 31457280, mtime: 0x6aad9ca0, atime: 0x6aad9c9b, ctime: 0x6aad9ca0, blocks: 0xf007 00010000:00010000:2.0:1789762721.840500:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e4ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.840523:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=126s v=(0 0) 00010000:00010000:2.0:1789762721.840530:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762721.840538:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e4ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762721.840553:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e4ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789762721.856677:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9ed6d081-3f08-4f7b-834f-c9f807e3a9cb 00000020:00000080:0.0:1789762721.856688:0:6684:0:(genops.c:885:class_export_put()) final put ffff95d17b47b000/9ed6d081-3f08-4f7b-834f-c9f807e3a9cb 00000020:00000080:1.0:1789762721.856732:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d17b47b000/9ed6d081-3f08-4f7b-834f-c9f807e3a9cb for lustre-OST0000 00000001:00080000:2.0:1789762721.856782:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967357 is committed 00002000:00010000:3.0:1789762721.856812:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 31457280 -> 32505856 00000020:00000080:1.0:1789762721.856814:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d17b478000 for lustre-OST0000 00002000:00010000:3.0:1789762721.856819:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762720 -> 1789762721 00002000:00010000:3.0:1789762721.856840:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762720 -> 1789762721 00002000:00010000:3.0:1789762721.856842:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 61447 -> 63495 00010000:00010000:3.0:1789762721.856881:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e4ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.856911:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e4ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.856921:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e4ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.856928:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762721.856932:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e4ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.856956:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e4ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.856979:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e4ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762721.856993:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e4ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762721.857119:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140608640:12345-192.168.203.31@tcp:4:dd.500 Request processed in 16738us (196381us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1789762721.857151:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:3.0:1789762721.857161:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126313406666 time 126313516731 state 0x2 ref 0 00000100:00100000:1.0:1789762721.860470:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762721.860534:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140608768 00000100:00100000:3.0:1789762721.860546:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140608768 00000100:00100000:3.0:1789762721.860597:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126313406666 time 126313516731 state 0x0 ref 1 00000100:00100000:3.0:1789762721.860612:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126513516731 time 126313516731 state 0x1 ref 1 00000100:00100000:1.0:1789762721.959113:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148993920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762721.959222:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762721.959278:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148993920 00000100:00100000:2.0:1789762721.959291:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148993920 00000100:00100000:2.0:1789762721.959382:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789762721.959401:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148993920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762721.959431:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124321792 pending 0 free 3826253824 avail 3816816640 00000100:00100000:2.0:1789762721.959502:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148993920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762721.959511:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789762721.959548:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967355 gen 2 00000004:00080000:1.0:1789762721.959557:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d1742bd880, transno 4294967355 00000100:00100000:1.0:1789762721.959585:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148993920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762722.040447:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126513516731 time 126513596436 state 0x0 ref 1 00000100:00100000:2.0:1789762722.040512:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140608768:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762722.040575:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 32505856, mtime: 0x6aad9ca1, atime: 0x6aad9c9b, ctime: 0x6aad9ca1, blocks: 0xf807 00010000:00010000:2.0:1789762722.040585:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789762722.040587:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762722.040617:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=126s v=(0 0) 00010000:00010000:2.0:1789762722.040622:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762722.040629:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762722.040643:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762722.059262:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967358 is committed 00002000:00010000:3.0:1789762722.059325:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:3.0:1789762722.059332:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 63495 -> 65543 00010000:00010000:3.0:1789762722.059346:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.059359:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.059383:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.059391:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762722.059396:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.059405:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.059424:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.059432:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e4d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762722.059542:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140608768:12345-192.168.203.31@tcp:4:dd.500 Request processed in 19069us (199066us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1789762722.059575:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:3.0:1789762722.059585:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126513516731 time 126513596436 state 0x2 ref 0 00000100:00100000:2.0:1789762722.063817:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762722.063937:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140608896 00000100:00100000:3.0:1789762722.063966:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140608896 00000100:00100000:3.0:1789762722.064057:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126513516731 time 126513596436 state 0x0 ref 1 00000100:00100000:3.0:1789762722.064071:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126713596436 time 126513596436 state 0x1 ref 1 00000100:00100000:3.0:1789762722.240559:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126713596436 time 126713703070 state 0x0 ref 1 00000100:00100000:3.0:1789762722.240590:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140608896:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762722.240670:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 33554432, mtime: 0x6aad9ca1, atime: 0x6aad9c9b, ctime: 0x6aad9ca1, blocks: 0x10007 00010000:00010000:3.0:1789762722.240683:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.240704:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=126s v=(0 0) 00010000:00010000:3.0:1789762722.240710:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762722.240718:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.240737:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762722.260817:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967359 is committed 00002000:00010000:3.0:1789762722.260922:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:3.0:1789762722.260932:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 65543 -> 67591 00010000:00010000:3.0:1789762722.260950:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.260967:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.260980:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.261037:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762722.261043:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.261056:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.261087:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.261103:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762722.261233:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140608896:12345-192.168.203.31@tcp:4:dd.500 Request processed in 20649us (197417us total) trans 4294967359 rc 0/0 00000100:00100000:3.0:1789762722.261250:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1789762722.261261:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126713596436 time 126713703070 state 0x2 ref 0 00000100:00100000:2.0:1789762722.265461:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762722.265543:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140609024 00000100:00100000:3.0:1789762722.265559:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140609024 00000100:00100000:3.0:1789762722.265638:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126713596436 time 126713703070 state 0x0 ref 1 00000100:00100000:3.0:1789762722.265655:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126913703070 time 126713703070 state 0x1 ref 1 00000100:00100000:3.0:1789762722.440618:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126913703070 time 126913770998 state 0x0 ref 1 00000100:00100000:3.0:1789762722.440653:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140609024:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762722.440757:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 34603008, mtime: 0x6aad9ca1, atime: 0x6aad9c9b, ctime: 0x6aad9ca1, blocks: 0x10807 00010000:00010000:3.0:1789762722.440771:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.440793:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=126s v=(0 0) 00010000:00010000:3.0:1789762722.440800:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762722.440811:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.440866:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762722.458284:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 34603008 -> 35651584 00000001:00080000:2.0:1789762722.458290:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967360 is committed 00002000:00010000:3.0:1789762722.458292:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 67591 -> 69639 00010000:00010000:3.0:1789762722.458309:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.458323:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.458333:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.458341:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762722.458346:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.458370:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.458390:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.458397:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762722.458480:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140609024:12345-192.168.203.31@tcp:4:dd.500 Request processed in 17838us (193022us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1789762722.458491:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:3.0:1789762722.458499:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126913703070 time 126913770998 state 0x2 ref 0 00000100:00100000:1.0:1789762722.462101:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762722.462181:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140609152 00000100:00100000:2.0:1789762722.462192:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140609152 00000100:00100000:2.0:1789762722.462234:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 126913703070 time 126913770998 state 0x0 ref 1 00000100:00100000:2.0:1789762722.462247:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127113770998 time 126913770998 state 0x1 ref 1 00000001:00100000:2.0:1789762722.483355:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9ed6d081-3f08-4f7b-834f-c9f807e3a9cb 00000020:00000080:2.0:1789762722.483363:0:7606:0:(genops.c:885:class_export_put()) final put ffff95d041c1b000/9ed6d081-3f08-4f7b-834f-c9f807e3a9cb 00000020:00000080:1.0:1789762722.483430:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d041c1b000/9ed6d081-3f08-4f7b-834f-c9f807e3a9cb for lustre-OST0001 00000020:00000080:1.0:1789762722.483541:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d041c1e000 for lustre-OST0001 00000100:00100000:3.0:1789762722.640771:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127113770998 time 127113924952 state 0x0 ref 1 00000100:00100000:3.0:1789762722.640808:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140609152:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762722.640947:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 35651584, mtime: 0x6aad9ca1, atime: 0x6aad9c9b, ctime: 0x6aad9ca1, blocks: 0x11007 00010000:00010000:3.0:1789762722.640958:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.640975:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=127s v=(0 0) 00010000:00010000:3.0:1789762722.640980:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762722.640986:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.641072:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762722.662396:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967361 is committed 00002000:00010000:3.0:1789762722.662440:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:3.0:1789762722.662450:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 69639 -> 71687 00010000:00010000:3.0:1789762722.662473:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.662497:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.662530:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.662542:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762722.662550:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.662565:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.662605:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.662616:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762722.662745:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140609152:12345-192.168.203.31@tcp:4:dd.500 Request processed in 21948us (200640us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1789762722.662776:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:3.0:1789762722.662785:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127113770998 time 127113924952 state 0x2 ref 0 00000100:00100000:0.0:1789762722.666674:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762722.666796:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140609280 00000100:00100000:2.0:1789762722.666809:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140609280 00000100:00100000:2.0:1789762722.666885:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127113770998 time 127113924952 state 0x0 ref 1 00000100:00100000:2.0:1789762722.666898:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127313924952 time 127113924952 state 0x1 ref 1 00000100:00100000:2.0:1789762722.840829:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127313924952 time 127313983557 state 0x0 ref 1 00000100:00100000:2.0:1789762722.840886:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140609280:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762722.840942:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 36700160, mtime: 0x6aad9ca1, atime: 0x6aad9c9b, ctime: 0x6aad9ca1, blocks: 0x11807 00010000:00010000:2.0:1789762722.840952:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e4ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762722.840966:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=127s v=(0 0) 00010000:00010000:2.0:1789762722.840970:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762722.840975:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e4ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762722.841000:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e4ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762722.852151:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967362 is committed 00002000:00010000:3.0:1789762722.852222:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:3.0:1789762722.852228:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762721 -> 1789762722 00002000:00010000:3.0:1789762722.852231:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762721 -> 1789762722 00002000:00010000:3.0:1789762722.852234:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 71687 -> 73735 00010000:00010000:3.0:1789762722.852248:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e4ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.852258:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e4ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.852265:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e4ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.852270:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762722.852273:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e4ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.852280:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e4ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.852306:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e4ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762722.852311:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e4ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762722.852384:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140609280:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11509us (185713us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789762722.852395:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1789762722.852404:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127313924952 time 127313983557 state 0x2 ref 0 00000100:00100000:1.0:1789762722.854505:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762722.854535:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140609408 00000100:00100000:3.0:1789762722.854543:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140609408 00000100:00100000:3.0:1789762722.854576:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127313924952 time 127313983557 state 0x0 ref 1 00000100:00100000:3.0:1789762722.854584:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127513983557 time 127313983557 state 0x1 ref 1 00010000:00010000:3.0:1789762722.855916:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762723.040936:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127513983557 time 127514091237 state 0x0 ref 1 00000100:00100000:2.0:1789762723.040980:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140609408:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762723.041040:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 37748736, mtime: 0x6aad9ca2, atime: 0x6aad9c9b, ctime: 0x6aad9ca2, blocks: 0x12007 00010000:00010000:2.0:1789762723.041047:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e4f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762723.041068:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=127s v=(0 0) 00010000:00010000:2.0:1789762723.041071:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762723.041076:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e4f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762723.041102:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e4f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762723.053663:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967363 is committed 00002000:00010000:3.0:1789762723.053722:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:3.0:1789762723.053729:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 73735 -> 75783 00010000:00010000:3.0:1789762723.053742:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e4f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.053754:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e4f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.053761:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e4f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.053776:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762723.053780:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e4f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.053787:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e4f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.053803:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e4f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.053809:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e4f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762723.053916:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140609408:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12961us (199408us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789762723.053926:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:3.0:1789762723.053934:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127513983557 time 127514091237 state 0x2 ref 0 00000100:00100000:0.0:1789762723.056828:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762723.056879:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140609536 00000100:00100000:3.0:1789762723.056889:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140609536 00000100:00100000:3.0:1789762723.056927:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127513983557 time 127514091237 state 0x0 ref 1 00000100:00100000:3.0:1789762723.056938:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127714091237 time 127514091237 state 0x1 ref 1 00000100:00100000:3.0:1789762723.240983:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127714091237 time 127714139444 state 0x0 ref 1 00000100:00100000:3.0:1789762723.241022:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140609536:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762723.241079:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 38797312, mtime: 0x6aad9ca2, atime: 0x6aad9c9b, ctime: 0x6aad9ca2, blocks: 0x12807 00010000:00010000:3.0:1789762723.241086:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.241100:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=127s v=(0 0) 00010000:00010000:3.0:1789762723.241103:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762723.241107:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.241118:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762723.253878:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967364 is committed 00002000:00010000:3.0:1789762723.253967:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:3.0:1789762723.253971:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 75783 -> 77831 00010000:00010000:3.0:1789762723.253983:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.254010:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.254017:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.254023:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762723.254026:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.254043:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.254059:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.254065:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e4fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762723.254137:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140609536:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13121us (197308us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789762723.254146:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:3.0:1789762723.254153:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127714091237 time 127714139444 state 0x2 ref 0 00000100:00100000:1.0:1789762723.256704:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762723.256746:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140609664 00000100:00100000:2.0:1789762723.256755:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140609664 00000100:00100000:2.0:1789762723.256792:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127714091237 time 127714139444 state 0x0 ref 1 00000100:00100000:2.0:1789762723.256801:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127914139444 time 127714139444 state 0x1 ref 1 00000100:00100000:3.0:1789762723.441092:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127914139444 time 127914247591 state 0x0 ref 1 00000100:00100000:3.0:1789762723.441119:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140609664:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762723.441178:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 39845888, mtime: 0x6aad9ca2, atime: 0x6aad9c9b, ctime: 0x6aad9ca2, blocks: 0x13007 00010000:00010000:3.0:1789762723.441187:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e502 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.441201:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=127s v=(0 0) 00010000:00010000:3.0:1789762723.441205:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762723.441209:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e502 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.441238:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e502 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762723.454249:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967365 is committed 00002000:00010000:3.0:1789762723.454284:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:3.0:1789762723.454292:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 77831 -> 79879 00010000:00010000:3.0:1789762723.454307:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e502 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.454318:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e502 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.454325:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e502 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.454331:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762723.454335:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e502 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.454342:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e502 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.454360:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e502 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.454365:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e502 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762723.454465:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140609664:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13355us (197759us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789762723.454475:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:3.0:1789762723.454484:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127914139444 time 127914247591 state 0x2 ref 0 00000100:00100000:0.0:1789762723.456882:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762723.456962:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140609792 00000100:00100000:2.0:1789762723.456972:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140609792 00000100:00100000:2.0:1789762723.457031:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 127914139444 time 127914247591 state 0x0 ref 1 00000100:00100000:2.0:1789762723.457041:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128114247591 time 127914247591 state 0x1 ref 1 00000100:00100000:2.0:1789762723.641144:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128114247591 time 128114300402 state 0x0 ref 1 00000100:00100000:2.0:1789762723.641173:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140609792:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762723.641225:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 40894464, mtime: 0x6aad9ca2, atime: 0x6aad9c9b, ctime: 0x6aad9ca2, blocks: 0x13807 00010000:00010000:2.0:1789762723.641232:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e509 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762723.641246:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=128s v=(0 0) 00010000:00010000:2.0:1789762723.641249:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762723.641254:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e509 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762723.641284:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e509 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762723.654019:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967366 is committed 00002000:00010000:3.0:1789762723.654058:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:3.0:1789762723.654065:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 79879 -> 81927 00010000:00010000:3.0:1789762723.654079:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e509 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.654090:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e509 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.654096:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e509 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.654101:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762723.654105:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e509 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.654112:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e509 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.654126:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e509 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.654142:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e509 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762723.654213:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140609792:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13052us (197332us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789762723.654222:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:3.0:1789762723.654229:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128114247591 time 128114300402 state 0x2 ref 0 00000100:00100000:0.0:1789762723.656736:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762723.656777:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140609920 00000100:00100000:3.0:1789762723.656786:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140609920 00000100:00100000:3.0:1789762723.656821:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128114247591 time 128114300402 state 0x0 ref 1 00000100:00100000:3.0:1789762723.656830:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128314300402 time 128114300402 state 0x1 ref 1 00000100:00100000:2.0:1789762723.841212:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128314300402 time 128314367797 state 0x0 ref 1 00000100:00100000:2.0:1789762723.841242:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140609920:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762723.841294:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 41943040, mtime: 0x6aad9ca2, atime: 0x6aad9c9b, ctime: 0x6aad9ca2, blocks: 0x14007 00010000:00010000:2.0:1789762723.841301:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e510 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762723.841315:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=128s v=(0 0) 00010000:00010000:2.0:1789762723.841318:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762723.841323:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e510 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762723.841334:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e510 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762723.854786:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967367 is committed 00002000:00010000:3.0:1789762723.854803:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:3.0:1789762723.854809:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762722 -> 1789762723 00002000:00010000:3.0:1789762723.854812:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762722 -> 1789762723 00002000:00010000:3.0:1789762723.854815:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 81927 -> 83975 00010000:00010000:3.0:1789762723.854827:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e510 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.854855:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e510 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.854862:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e510 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.854877:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762723.854881:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e510 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.854888:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e510 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.854903:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e510 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762723.854908:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56e510 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762723.854975:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140609920:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13744us (198239us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789762723.854997:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:3.0:1789762723.855003:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128314300402 time 128314367797 state 0x2 ref 0 00000100:00100000:1.0:1789762723.857498:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762723.857540:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140610048 00000100:00100000:3.0:1789762723.857548:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140610048 00000100:00100000:3.0:1789762723.857579:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128314300402 time 128314367797 state 0x0 ref 1 00000100:00100000:3.0:1789762723.857588:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128514367797 time 128314367797 state 0x1 ref 1 00010000:00010000:0.0:1789762723.878975:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762724.041279:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128514367797 time 128514432257 state 0x0 ref 1 00000100:00100000:3.0:1789762724.041322:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140610048:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:0.0:1789762724.041386:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762724.041392:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 42991616, mtime: 0x6aad9ca3, atime: 0x6aad9c9b, ctime: 0x6aad9ca3, blocks: 0x14807 00010000:00010000:3.0:1789762724.041401:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e517 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.041417:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=128s v=(0 0) 00010000:00010000:3.0:1789762724.041422:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762724.041429:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e517 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.041445:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e517 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762724.055091:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967368 is committed 00002000:00010000:3.0:1789762724.055113:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:3.0:1789762724.055120:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 83975 -> 86023 00010000:00010000:3.0:1789762724.055135:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e517 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.055148:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e517 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.055157:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e517 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.055164:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762724.055169:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e517 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.055192:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e517 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.055211:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e517 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.055218:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e517 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762724.055361:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140610048:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14061us (197861us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789762724.055369:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:3.0:1789762724.055375:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128514367797 time 128514432257 state 0x2 ref 0 00000100:00100000:0.0:1789762724.057694:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762724.057732:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140610176 00000100:00100000:3.0:1789762724.057740:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140610176 00000100:00100000:3.0:1789762724.057773:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128514367797 time 128514432257 state 0x0 ref 1 00000100:00100000:3.0:1789762724.057782:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128714432257 time 128514432257 state 0x1 ref 1 00000100:00100000:3.0:1789762724.241383:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128714432257 time 128714534167 state 0x0 ref 1 00000100:00100000:3.0:1789762724.241419:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140610176:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762724.241491:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 44040192, mtime: 0x6aad9ca3, atime: 0x6aad9c9b, ctime: 0x6aad9ca3, blocks: 0x15007 00010000:00010000:3.0:1789762724.241503:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e51e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.241553:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=128s v=(0 0) 00010000:00010000:3.0:1789762724.241559:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762724.241567:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e51e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.241603:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e51e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762724.259462:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967369 is committed 00002000:00010000:3.0:1789762724.259531:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:3.0:1789762724.259540:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 86023 -> 88073 00010000:00010000:3.0:1789762724.259556:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e51e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.259571:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e51e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.259584:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e51e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.259592:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762724.259598:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e51e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.259610:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e51e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.259651:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e51e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.259661:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e51e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762724.259765:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140610176:12345-192.168.203.31@tcp:4:dd.500 Request processed in 18357us (202070us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789762724.259777:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:3.0:1789762724.259786:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128714432257 time 128714534167 state 0x2 ref 0 00000100:00100000:2.0:1789762724.263312:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762724.263371:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140610304 00000100:00100000:3.0:1789762724.263384:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140610304 00000100:00100000:3.0:1789762724.263437:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128714432257 time 128714534167 state 0x0 ref 1 00000100:00100000:3.0:1789762724.263452:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128914534167 time 128714534167 state 0x1 ref 1 00000100:00100000:3.0:1789762724.441493:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128914534167 time 128914642257 state 0x0 ref 1 00000100:00100000:3.0:1789762724.441553:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140610304:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762724.441628:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 45088768, mtime: 0x6aad9ca3, atime: 0x6aad9c9b, ctime: 0x6aad9ca3, blocks: 0x15809 00010000:00010000:3.0:1789762724.441641:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e525 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.441664:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=128s v=(0 0) 00010000:00010000:3.0:1789762724.441670:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762724.441695:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.441715:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762724.464219:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967370 is committed 00002000:00010000:3.0:1789762724.464313:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:3.0:1789762724.464323:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 88073 -> 90121 00010000:00010000:3.0:1789762724.464339:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.464356:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e525 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.464369:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e525 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.464378:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762724.464384:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e525 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.464396:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e525 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.464419:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e525 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.464449:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e525 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762724.464560:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140610304:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23039us (201245us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789762724.464576:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:3.0:1789762724.464587:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128914534167 time 128914642257 state 0x2 ref 0 00000100:00100000:0.0:1789762724.468684:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762724.468750:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140610432 00000100:00100000:2.0:1789762724.468764:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140610432 00000100:00100000:2.0:1789762724.468823:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 128914534167 time 128914642257 state 0x0 ref 1 00000100:00100000:2.0:1789762724.468857:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129114642257 time 128914642257 state 0x1 ref 1 00000100:00100000:3.0:1789762724.641692:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129114642257 time 129114842911 state 0x0 ref 1 00000100:00100000:3.0:1789762724.641735:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140610432:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762724.641808:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 46137344, mtime: 0x6aad9ca3, atime: 0x6aad9c9b, ctime: 0x6aad9ca3, blocks: 0x16009 00010000:00010000:3.0:1789762724.641821:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e52c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.641883:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=129s v=(0 0) 00010000:00010000:3.0:1789762724.641890:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762724.641898:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e52c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.641919:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e52c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762724.664415:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967371 is committed 00002000:00010000:3.0:1789762724.664457:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:3.0:1789762724.664467:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 90121 -> 92169 00010000:00010000:3.0:1789762724.664498:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e52c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.664515:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e52c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.664531:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e52c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.664547:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762724.664557:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e52c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.664575:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e52c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.664608:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e52c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.664626:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e52c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762724.664774:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140610432:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23049us (196085us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789762724.664797:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:3.0:1789762724.664809:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129114642257 time 129114842911 state 0x2 ref 0 00000100:00100000:1.0:1789762724.669284:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762724.669356:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140610560 00000100:00100000:2.0:1789762724.669370:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140610560 00000100:00100000:2.0:1789762724.669431:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129114642257 time 129114842911 state 0x0 ref 1 00000100:00100000:2.0:1789762724.669445:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129314842911 time 129114842911 state 0x1 ref 1 00000100:00100000:2.0:1789762724.841764:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129314842911 time 129314911141 state 0x0 ref 1 00000100:00100000:2.0:1789762724.841812:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140610560:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762724.841931:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 47185920, mtime: 0x6aad9ca3, atime: 0x6aad9c9b, ctime: 0x6aad9ca3, blocks: 0x16809 00010000:00010000:2.0:1789762724.841946:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e533 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762724.841966:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=129s v=(0 0) 00010000:00010000:2.0:1789762724.841985:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762724.841992:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e533 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762724.842008:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e533 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762724.866226:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967372 is committed 00002000:00010000:3.0:1789762724.866313:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 47185920 -> 48234496 00002000:00010000:3.0:1789762724.866339:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762723 -> 1789762724 00002000:00010000:3.0:1789762724.866345:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762723 -> 1789762724 00002000:00010000:3.0:1789762724.866351:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 92169 -> 94217 00010000:00010000:3.0:1789762724.866376:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e533 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.866397:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e533 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.866410:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.866419:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762724.866426:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.866438:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.866463:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e533 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762724.866472:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e533 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762724.866587:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140610560:12345-192.168.203.31@tcp:4:dd.500 Request processed in 24794us (197301us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789762724.866619:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1789762724.866631:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129314842911 time 129314911141 state 0x2 ref 0 00000100:00100000:1.0:1789762724.870758:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762724.870824:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140610688 00000100:00100000:3.0:1789762724.870868:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140610688 00000100:00100000:3.0:1789762724.870926:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129314842911 time 129314911141 state 0x0 ref 1 00000100:00100000:3.0:1789762724.870943:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129514911141 time 129314911141 state 0x1 ref 1 00010000:00010000:2.0:1789762724.903173:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762725.041826:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129514911141 time 129514983084 state 0x0 ref 1 00000100:00100000:2.0:1789762725.041865:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140610688:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762725.041913:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 48234496, mtime: 0x6aad9ca4, atime: 0x6aad9c9b, ctime: 0x6aad9ca4, blocks: 0x17009 00010000:00010000:2.0:1789762725.041934:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e53a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762725.041947:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=129s v=(0 0) 00010000:00010000:2.0:1789762725.041950:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762725.041955:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e53a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762725.041966:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e53a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762725.053470:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967373 is committed 00002000:00010000:3.0:1789762725.053491:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:3.0:1789762725.053498:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 94217 -> 96265 00010000:00010000:3.0:1789762725.053512:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e53a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.053525:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e53a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.053536:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e53a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.053543:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762725.053549:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e53a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.053559:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e53a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.053579:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e53a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.053594:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c56e53a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762725.053661:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140610688:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11804us (182907us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789762725.053670:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:3.0:1789762725.053676:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129514911141 time 129514983084 state 0x2 ref 0 00000100:00100000:0.0:1789762725.055675:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762725.055710:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140610816 00000100:00100000:3.0:1789762725.055717:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140610816 00000100:00100000:3.0:1789762725.055761:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129514911141 time 129514983084 state 0x0 ref 1 00000100:00100000:3.0:1789762725.055771:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129714983084 time 129514983084 state 0x1 ref 1 00000100:00100000:3.0:1789762725.241882:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129714983084 time 129715038196 state 0x0 ref 1 00000100:00100000:3.0:1789762725.241904:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140610816:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762725.241952:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 49283072, mtime: 0x6aad9ca4, atime: 0x6aad9c9b, ctime: 0x6aad9ca4, blocks: 0x17809 00010000:00010000:3.0:1789762725.241959:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e541 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.241985:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=129s v=(0 0) 00010000:00010000:3.0:1789762725.241989:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762725.241994:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.242023:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762725.253727:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967374 is committed 00002000:00010000:3.0:1789762725.253751:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 49283072 -> 50331648 00002000:00010000:3.0:1789762725.253756:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 96265 -> 98313 00010000:00010000:3.0:1789762725.253766:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.253775:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e541 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.253782:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e541 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.253787:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762725.253790:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e541 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.253797:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e541 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.253811:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e541 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.253816:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e541 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762725.253901:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140610816:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12004us (198225us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789762725.253910:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:3.0:1789762725.253915:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129714983084 time 129715038196 state 0x2 ref 0 00000100:00100000:1.0:1789762725.255877:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762725.255935:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140610944 00000100:00100000:2.0:1789762725.255945:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140610944 00000100:00100000:2.0:1789762725.256008:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129714983084 time 129715038196 state 0x0 ref 1 00000100:00100000:2.0:1789762725.256022:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129915038196 time 129715038196 state 0x1 ref 1 00000100:00100000:3.0:1789762725.442030:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129915038196 time 129915185654 state 0x0 ref 1 00000100:00100000:3.0:1789762725.442058:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140610944:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762725.442108:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 50331648, mtime: 0x6aad9ca4, atime: 0x6aad9c9b, ctime: 0x6aad9ca4, blocks: 0x18009 00010000:00010000:3.0:1789762725.442116:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e548 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.442129:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=129s v=(0 0) 00010000:00010000:3.0:1789762725.442133:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762725.442137:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e548 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.442154:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e548 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762725.453744:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967375 is committed 00002000:00010000:3.0:1789762725.453774:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:3.0:1789762725.453779:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 98313 -> 100361 00010000:00010000:3.0:1789762725.453790:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e548 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.453810:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e548 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.453817:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e548 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.453822:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762725.453825:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e548 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.453847:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e548 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.453862:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e548 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.453868:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e548 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762725.453938:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140610944:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11890us (198059us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789762725.453946:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:3.0:1789762725.453953:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129915038196 time 129915185654 state 0x2 ref 0 00000100:00100000:2.0:1789762725.456215:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762725.456249:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140611072 00000100:00100000:3.0:1789762725.456263:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140611072 00000100:00100000:3.0:1789762725.456296:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 129915038196 time 129915185654 state 0x0 ref 1 00000100:00100000:3.0:1789762725.456305:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130115185654 time 129915185654 state 0x1 ref 1 00000100:00100000:2.0:1789762725.642146:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130115185654 time 130115303086 state 0x0 ref 1 00000100:00100000:2.0:1789762725.642175:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140611072:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762725.642225:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 51380224, mtime: 0x6aad9ca4, atime: 0x6aad9c9b, ctime: 0x6aad9ca4, blocks: 0x18809 00010000:00010000:2.0:1789762725.642232:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e54f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762725.642246:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=130s v=(0 0) 00010000:00010000:2.0:1789762725.642250:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762725.642254:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e54f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762725.642280:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e54f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762725.653690:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967376 is committed 00002000:00010000:3.0:1789762725.653728:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:3.0:1789762725.653734:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 100361 -> 102409 00010000:00010000:3.0:1789762725.653750:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e54f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.653763:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e54f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.653774:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e54f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.653781:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762725.653787:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e54f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.653797:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e54f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.653817:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e54f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.653826:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e54f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762725.653922:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140611072:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11759us (197706us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789762725.653931:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:3.0:1789762725.653938:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130115185654 time 130115303086 state 0x2 ref 0 00000100:00100000:2.0:1789762725.656113:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762725.656142:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140611200 00000100:00100000:3.0:1789762725.656150:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140611200 00000100:00100000:3.0:1789762725.656182:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130115185654 time 130115303086 state 0x0 ref 1 00000100:00100000:3.0:1789762725.656191:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130315303086 time 130115303086 state 0x1 ref 1 00000100:00100000:3.0:1789762725.842200:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130315303086 time 130315356666 state 0x0 ref 1 00000100:00100000:3.0:1789762725.842229:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140611200:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762725.842280:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 52428800, mtime: 0x6aad9ca4, atime: 0x6aad9c9b, ctime: 0x6aad9ca4, blocks: 0x19009 00010000:00010000:3.0:1789762725.842287:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e556 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.842300:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=130s v=(0 0) 00010000:00010000:3.0:1789762725.842304:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762725.842308:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762725.842319:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762725.854829:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967377 is committed 00002000:00010000:1.0:1789762725.854873:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:1.0:1789762725.854883:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762724 -> 1789762725 00002000:00010000:1.0:1789762725.854886:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762724 -> 1789762725 00002000:00010000:1.0:1789762725.854887:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 102409 -> 104457 00010000:00010000:1.0:1789762725.854900:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762725.854913:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e556 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762725.854925:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e556 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762725.854934:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762725.854940:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e556 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762725.854947:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e556 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762725.854963:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e556 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762725.854982:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56e556 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762725.855047:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140611200:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12830us (198934us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789762725.855063:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:1.0:1789762725.855069:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130315303086 time 130315356666 state 0x2 ref 0 00000100:00100000:1.0:1789762725.857126:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762725.857175:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140611328 00000100:00100000:2.0:1789762725.857183:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140611328 00000100:00100000:2.0:1789762725.857218:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130315303086 time 130315356666 state 0x0 ref 1 00000100:00100000:2.0:1789762725.857227:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130515356666 time 130315356666 state 0x1 ref 1 00010000:00010000:0.0:1789762725.926927:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762726.042281:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130515356666 time 130515436032 state 0x0 ref 1 00000100:00100000:3.0:1789762726.042319:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140611328:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762726.042365:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 53477376, mtime: 0x6aad9ca5, atime: 0x6aad9c9b, ctime: 0x6aad9ca5, blocks: 0x19809 00010000:00010000:3.0:1789762726.042373:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e55d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789762726.042379:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762726.042387:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=130s v=(0 0) 00010000:00010000:3.0:1789762726.042392:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762726.042399:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e55d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762726.042413:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e55d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762726.054002:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967378 is committed 00002000:00010000:2.0:1789762726.054008:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:2.0:1789762726.054016:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 104457 -> 106505 00010000:00010000:2.0:1789762726.054030:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e55d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.054042:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e55d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.054049:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e55d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.054054:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762726.054057:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e55d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.054064:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e55d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.054086:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e55d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.054092:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c56e55d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762726.054153:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140611328:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11854us (197026us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789762726.054161:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:2.0:1789762726.054167:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130515356666 time 130515436032 state 0x2 ref 0 00000100:00100000:0.0:1789762726.056186:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762726.056227:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140611456 00000100:00100000:3.0:1789762726.056235:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140611456 00000100:00100000:3.0:1789762726.056268:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130515356666 time 130515436032 state 0x0 ref 1 00000100:00100000:3.0:1789762726.056276:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130715436032 time 130515436032 state 0x1 ref 1 00000100:00100000:2.0:1789762726.242358:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130715436032 time 130715511471 state 0x0 ref 1 00000100:00100000:2.0:1789762726.242388:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140611456:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762726.242441:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 54525952, mtime: 0x6aad9ca5, atime: 0x6aad9c9b, ctime: 0x6aad9ca5, blocks: 0x1a009 00010000:00010000:2.0:1789762726.242449:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e564 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.242463:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=130s v=(0 0) 00010000:00010000:2.0:1789762726.242466:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762726.242471:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e564 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.242482:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e564 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762726.253434:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967379 is committed 00002000:00010000:2.0:1789762726.253444:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:2.0:1789762726.253451:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 106505 -> 108553 00010000:00010000:2.0:1789762726.253465:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e564 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.253476:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e564 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.253484:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e564 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.253489:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762726.253493:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e564 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.253499:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e564 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.253513:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e564 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762726.253519:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e564 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762726.253589:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140611456:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11211us (197400us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789762726.253604:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:2.0:1789762726.253610:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130715436032 time 130715511471 state 0x2 ref 0 00000100:00100000:1.0:1789762726.255637:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762726.255683:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140611584 00000100:00100000:3.0:1789762726.255692:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140611584 00000100:00100000:3.0:1789762726.255726:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130715436032 time 130715511471 state 0x0 ref 1 00000100:00100000:3.0:1789762726.255735:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130915511471 time 130715511471 state 0x1 ref 1 00000100:00100000:3.0:1789762726.442407:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130915511471 time 130915563367 state 0x0 ref 1 00000100:00100000:3.0:1789762726.442435:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140611584:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762726.442496:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 55574528, mtime: 0x6aad9ca5, atime: 0x6aad9c9b, ctime: 0x6aad9ca5, blocks: 0x1a809 00010000:00010000:3.0:1789762726.442506:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e56b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762726.442527:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=130s v=(0 0) 00010000:00010000:3.0:1789762726.442531:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762726.442536:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e56b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762726.442548:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e56b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762726.453710:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967380 is committed 00002000:00010000:1.0:1789762726.453765:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:1.0:1789762726.453770:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 108553 -> 110601 00010000:00010000:1.0:1789762726.453780:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e56b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.453790:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e56b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.453796:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e56b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.453801:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762726.453805:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e56b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.453812:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e56b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.453825:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e56b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.453830:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e56b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762726.453918:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140611584:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11493us (198281us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1789762726.453927:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:1.0:1789762726.453933:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130915511471 time 130915563367 state 0x2 ref 0 00000100:00100000:0.0:1789762726.455958:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762726.456007:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140611712 00000100:00100000:1.0:1789762726.456015:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140611712 00000100:00100000:1.0:1789762726.456049:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 130915511471 time 130915563367 state 0x0 ref 1 00000100:00100000:1.0:1789762726.456058:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131115563367 time 130915563367 state 0x1 ref 1 00000004:00080000:3.0:1789762726.566955:0:8167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 131040118559ns, next at 132040115768ns, rc = 0 00000100:00100000:0.0:1789762726.566986:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d04320ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148994176:0@lo:400:kworker.0 00000100:00100000:3.0:1789762726.566998:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148994048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762726.567056:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702148994304:0@lo:400:kworker.0 00000100:00100000:0.0:1789762726.567062:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762726.567065:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762726.567111:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762726.567134:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702148994688:0@lo:400:kworker.0 00000100:00100000:3.0:1789762726.567134:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148994560:0@lo:400:kworker.0 00000100:00100000:2.0:1789762726.567140:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148994816:0@lo:400:kworker.0 00000100:00100000:1.0:1789762726.567174:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148994176 00000100:00100000:1.0:1789762726.567182:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148994176 00000100:00100000:0.0:1789762726.567187:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762726.567188:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762726.567202:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148994304 00000100:00100000:2.0:1789762726.567207:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148994304 00000100:00100000:3.0:1789762726.567231:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789762726.567235:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789762726.567248:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148994688 00000100:00100000:2.0:1789762726.567252:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148994688 00000100:00100000:0.0:1789762726.567255:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789762726.567255:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702148994176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762726.567268:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148994304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762726.567288:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789762726.567301:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702148994688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762726.567303:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702148994432:0@lo:400:kworker.0 00000100:00100000:0.0:1789762726.567325:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148994304:12345-0@lo:400:kworker.0 Request processed in 56us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762726.567331:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702148994176:12345-0@lo:400:kworker.0 Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762726.567337:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789762726.567343:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789762726.567352:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762726.567366:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702148994688:12345-0@lo:400:kworker.0 Request processed in 65us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762726.567367:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148994432 00000100:00100000:0.0:1789762726.567375:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148994432 00000100:00100000:2.0:1789762726.567380:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789762726.567405:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702148994688:0@lo:400:kworker.0 00000100:00100000:1.0:1789762726.567421:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d04320ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148994176:0@lo:400:kworker.0 00000100:00100000:0.0:1789762726.567426:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789762726.567438:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702148994432:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762726.567467:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762726.567492:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702148994432:12345-0@lo:400:kworker.0 Request processed in 57us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762726.567499:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789762726.567516:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148994048 00000100:00100000:1.0:1789762726.567519:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148994560 00000100:00100000:3.0:1789762726.567522:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148994048 00000100:00100000:1.0:1789762726.567527:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148994560 00000100:00100000:0.0:1789762726.567536:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762726.567588:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702148994304:0@lo:400:kworker.0 00000100:00100000:1.0:1789762726.567589:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148994816 00000100:00100000:1.0:1789762726.567594:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148994816 00000100:00100000:3.0:1789762726.567619:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789762726.567630:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702148994048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762726.567632:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789762726.567650:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789762726.567651:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148994560:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789762726.567655:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789762726.567668:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702148994816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762726.567695:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148994560:12345-0@lo:400:kworker.0 Request processed in 48us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762726.567703:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789762726.567754:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702148994816:12345-0@lo:400:kworker.0 Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762726.567762:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789762726.567803:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702148994432:0@lo:400:kworker.0 00000100:00080000:3.0:1789762726.567805:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762726.567813:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762726.567828:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148994816:0@lo:400:kworker.0 00000100:00100000:2.0:1789762726.567830:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148994560:0@lo:400:kworker.0 00000100:00100000:3.0:1789762726.567924:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148994048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 295us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762726.567931:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789762726.567939:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148994048:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789762726.574354:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:3.0:1789762726.574430:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148994944:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789762726.574472:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762726.574498:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148994944 00000100:00100000:0.0:1789762726.574504:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148994944 00000100:00100000:0.0:1789762726.574537:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789762726.574543:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148994944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789762726.574561:0:8803:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1789762726.574586:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 8388608, mtime: 0x6aad9c99, atime: 0x6aad9c97, ctime: 0x6aad9c99, blocks: 0x4007 00010000:00010000:0.0:1789762726.574593:0:8803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e572 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762726.574606:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=131s v=(0 0) 00010000:00010000:0.0:1789762726.574610:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762726.574616:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e572 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762726.574632:0:8803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e572 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762726.574644:0:8803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e572 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762726.574653:0:8803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e572 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762726.574678:0:8803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762726.574690:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762726.574697:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e572 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762726.574706:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762726.574710:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e572 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762726.574718:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e572 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762726.574732:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e572 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762726.574738:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcdf8dbf/0xd08452c77c56e572 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762726.574761:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762726.574762:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762726.574764:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762726.575163:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702148994944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 619us (690us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789762726.575171:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:3.0:1789762726.575190:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d1742eb100/2, rc 0, transno 4294967321 00000100:00100000:3.0:1789762726.575195:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148994944:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789762726.642523:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131115563367 time 131115677686 state 0x0 ref 1 00000100:00100000:3.0:1789762726.642552:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140611712:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762726.642604:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 56623104, mtime: 0x6aad9ca5, atime: 0x6aad9c9b, ctime: 0x6aad9ca5, blocks: 0x1b009 00010000:00010000:3.0:1789762726.642612:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56e579 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762726.642624:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=131s v=(0 0) 00010000:00010000:3.0:1789762726.642628:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762726.642632:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56e579 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762726.642643:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56e579 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762726.653910:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967381 is committed 00002000:00010000:1.0:1789762726.653920:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 56623104 -> 57671680 00002000:00010000:1.0:1789762726.653927:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 110601 -> 112649 00010000:00010000:1.0:1789762726.653941:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56e579 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.653952:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56e579 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.653972:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56e579 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.653978:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762726.653982:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56e579 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.653988:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56e579 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.654004:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56e579 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.654013:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56e579 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762726.654090:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140611712:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11549us (198131us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1789762726.654099:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:1.0:1789762726.654105:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131115563367 time 131115677686 state 0x2 ref 0 00000100:00100000:1.0:1789762726.656229:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762726.656311:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140611840 00000100:00100000:2.0:1789762726.656320:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140611840 00000100:00100000:2.0:1789762726.656355:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131115563367 time 131115677686 state 0x0 ref 1 00000100:00100000:2.0:1789762726.656364:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131315677686 time 131115677686 state 0x1 ref 1 00000100:00100000:2.0:1789762726.772325:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762726.772377:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762726.772400:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762726.772404:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140612096 00000100:00100000:0.0:1789762726.772414:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140612096 00000100:00100000:1.0:1789762726.772435:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140611968 00000100:00100000:1.0:1789762726.772442:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140611968 00000100:00100000:2.0:1789762726.772443:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762726.772471:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140612352 00000100:00100000:3.0:1789762726.772478:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140612352 00000100:00080000:2.0:1789762726.772488:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762726.772498:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1789762726.772499:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:2.0:1789762726.772513:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1789762726.772518:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140612096:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762726.772529:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140612352:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762726.772530:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140611968:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762726.772553:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140612224 00000100:00100000:3.0:1789762726.772559:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140612224 00000100:00100000:0.0:1789762726.772588:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140612096:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 73us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762726.772589:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140612352:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 64us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762726.772602:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140611968:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 87us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762726.772605:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:3.0:1789762726.772611:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1789762726.772617:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:1.0:1789762726.772625:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:3.0:1789762726.772626:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140612224:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:2.0:1789762726.772643:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762726.772672:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140612224:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 50us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762726.772680:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:1.0:1789762726.842611:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131315677686 time 131315766674 state 0x0 ref 1 00000100:00100000:1.0:1789762726.842642:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140611840:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762726.842689:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 57671680, mtime: 0x6aad9ca5, atime: 0x6aad9c9b, ctime: 0x6aad9ca5, blocks: 0x1b809 00010000:00010000:1.0:1789762726.842697:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e580 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.842710:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=131s v=(0 0) 00010000:00010000:1.0:1789762726.842714:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762726.842719:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e580 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.842745:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e580 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762726.853955:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967382 is committed 00002000:00010000:1.0:1789762726.853991:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:1.0:1789762726.853998:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762725 -> 1789762726 00002000:00010000:1.0:1789762726.854001:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762725 -> 1789762726 00002000:00010000:1.0:1789762726.854003:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 112649 -> 114697 00010000:00010000:1.0:1789762726.854018:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e580 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.854032:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e580 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.854042:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e580 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.854050:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762726.854056:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e580 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.854067:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e580 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.854087:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e580 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762726.854111:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e580 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762726.854192:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140611840:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11558us (197961us total) trans 4294967382 rc 0/0 00000100:00100000:1.0:1789762726.854201:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:1.0:1789762726.854209:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131315677686 time 131315766674 state 0x2 ref 0 00000100:00100000:2.0:1789762726.856471:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762726.856515:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140612480 00000100:00100000:3.0:1789762726.856524:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140612480 00000100:00100000:3.0:1789762726.856560:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131315677686 time 131315766674 state 0x0 ref 1 00000100:00100000:3.0:1789762726.856570:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131515766674 time 131315766674 state 0x1 ref 1 00010000:00010000:0.0:1789762726.950987:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762727.042707:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131515766674 time 131515863561 state 0x0 ref 1 00000100:00100000:2.0:1789762727.042730:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140612480:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762727.042777:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 58720256, mtime: 0x6aad9ca6, atime: 0x6aad9c9b, ctime: 0x6aad9ca6, blocks: 0x1c009 00010000:00010000:2.0:1789762727.042784:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e587 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762727.042798:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=131s v=(0 0) 00010000:00010000:2.0:1789762727.042801:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762727.042806:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e587 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762727.042816:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e587 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762727.054814:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 58720256 -> 59768832 00000001:00080000:0.0:1789762727.054820:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967383 is committed 00002000:00010000:2.0:1789762727.054820:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 114697 -> 116745 00010000:00010000:2.0:1789762727.054856:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e587 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762727.054867:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e587 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762727.054874:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e587 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762727.054878:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762727.054882:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e587 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762727.054892:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e587 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762727.054910:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e587 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762727.054920:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051cc8bcb/0xd08452c77c56e587 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762727.054997:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140612480:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12275us (198525us total) trans 4294967383 rc 0/0 00000100:00100000:2.0:1789762727.055011:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:2.0:1789762727.055016:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131515766674 time 131515863561 state 0x2 ref 0 00000100:00100000:1.0:1789762727.057226:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762727.057267:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140612608 00000100:00100000:3.0:1789762727.057281:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140612608 00000100:00100000:3.0:1789762727.057314:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131515766674 time 131515863561 state 0x0 ref 1 00000100:00100000:3.0:1789762727.057323:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131715863561 time 131515863561 state 0x1 ref 1 00000100:00100000:2.0:1789762727.079002:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148995072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762727.079042:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762727.079088:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148995072 00000100:00100000:1.0:1789762727.079094:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148995072 00000100:00100000:1.0:1789762727.079137:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789762727.079150:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148995072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762727.079168:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 168624128 pending 0 free 3803185152 avail 3797942272 00000100:00100000:1.0:1789762727.079221:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148995072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762727.079232:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789762727.079251:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148995072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762727.242779:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131715863561 time 131715935181 state 0x0 ref 1 00000100:00100000:3.0:1789762727.242805:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140612608:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762727.242912:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 59768832, mtime: 0x6aad9ca6, atime: 0x6aad9c9b, ctime: 0x6aad9ca6, blocks: 0x1c809 00010000:00010000:3.0:1789762727.242923:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e58e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.242942:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=131s v=(0 0) 00010000:00010000:3.0:1789762727.242947:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762727.242953:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e58e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.243004:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e58e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762727.259698:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967384 is committed 00002000:00010000:3.0:1789762727.259784:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:3.0:1789762727.259792:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 116745 -> 118793 00010000:00010000:3.0:1789762727.259807:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e58e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.259821:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e58e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.259831:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e58e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.259864:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762727.259869:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e58e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.259879:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e58e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.259898:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e58e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.259906:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e58e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762727.260030:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140612608:12345-192.168.203.31@tcp:4:dd.500 Request processed in 17232us (202802us total) trans 4294967384 rc 0/0 00000100:00100000:3.0:1789762727.260070:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:3.0:1789762727.260079:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131715863561 time 131715935181 state 0x2 ref 0 00000100:00100000:0.0:1789762727.263143:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762727.263223:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140612736 00000100:00100000:1.0:1789762727.263236:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140612736 00000100:00100000:1.0:1789762727.263285:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131715863561 time 131715935181 state 0x0 ref 1 00000100:00100000:1.0:1789762727.263298:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131915935181 time 131715935181 state 0x1 ref 1 00000100:00100000:1.0:1789762727.442973:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131915935181 time 131916104319 state 0x0 ref 1 00000100:00100000:1.0:1789762727.443036:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140612736:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762727.443135:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 60817408, mtime: 0x6aad9ca6, atime: 0x6aad9c9b, ctime: 0x6aad9ca6, blocks: 0x1d009 00010000:00010000:1.0:1789762727.443147:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e595 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762727.443167:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=131s v=(0 0) 00010000:00010000:1.0:1789762727.443172:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762727.443179:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762727.443196:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762727.461177:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967385 is committed 00002000:00010000:3.0:1789762727.461223:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:3.0:1789762727.461230:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 118793 -> 120841 00010000:00010000:3.0:1789762727.461246:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.461259:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e595 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.461267:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.461273:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cca00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762727.461276:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.461283:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.461301:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e595 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.461310:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c56e595 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762727.461422:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140612736:12345-192.168.203.31@tcp:4:dd.500 Request processed in 18411us (198295us total) trans 4294967385 rc 0/0 00000100:00100000:3.0:1789762727.461431:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:3.0:1789762727.461437:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131915935181 time 131916104319 state 0x2 ref 0 00000100:00100000:0.0:1789762727.464394:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762727.464431:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140612864 00000100:00100000:3.0:1789762727.464441:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140612864 00000100:00100000:3.0:1789762727.464477:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 131915935181 time 131916104319 state 0x0 ref 1 00000100:00100000:3.0:1789762727.464487:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132116104319 time 131916104319 state 0x1 ref 1 00000001:00080000:2.0:1789762727.600508:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1789762727.643074:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132116104319 time 132116230107 state 0x0 ref 1 00000100:00100000:1.0:1789762727.643103:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140612864:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762727.643154:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 61865984, mtime: 0x6aad9ca6, atime: 0x6aad9c9b, ctime: 0x6aad9ca6, blocks: 0x1d809 00010000:00010000:1.0:1789762727.643161:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e59c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762727.643175:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=132s v=(0 0) 00010000:00010000:1.0:1789762727.643178:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762727.643183:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e59c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762727.643195:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e59c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762727.655135:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967386 is committed 00002000:00010000:1.0:1789762727.655140:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:1.0:1789762727.655144:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 120841 -> 122889 00010000:00010000:1.0:1789762727.655158:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e59c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762727.655172:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e59c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762727.655183:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e59c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762727.655191:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762727.655197:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e59c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762727.655206:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e59c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762727.655224:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e59c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762727.655233:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e59c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762727.655311:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140612864:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12216us (190912us total) trans 4294967386 rc 0/0 00000100:00100000:1.0:1789762727.655329:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:1.0:1789762727.655336:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132116104319 time 132116230107 state 0x2 ref 0 00000100:00100000:0.0:1789762727.657845:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762727.657897:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140612992 00000100:00100000:2.0:1789762727.657906:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140612992 00000100:00100000:2.0:1789762727.657941:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132116104319 time 132116230107 state 0x0 ref 1 00000100:00100000:2.0:1789762727.657962:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132316230107 time 132116230107 state 0x1 ref 1 00000100:00100000:3.0:1789762727.843167:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132316230107 time 132316322579 state 0x0 ref 1 00000100:00100000:3.0:1789762727.843194:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140612992:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762727.843245:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 62914560, mtime: 0x6aad9ca6, atime: 0x6aad9c9b, ctime: 0x6aad9ca6, blocks: 0x1e009 00010000:00010000:3.0:1789762727.843252:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.843266:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=132s v=(0 0) 00010000:00010000:3.0:1789762727.843270:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762727.843275:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.843286:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762727.857784:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967387 is committed 00002000:00010000:3.0:1789762727.857814:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:3.0:1789762727.857820:0:11723:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762726 -> 1789762727 00002000:00010000:3.0:1789762727.857823:0:11723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762726 -> 1789762727 00002000:00010000:3.0:1789762727.857825:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 122889 -> 124937 00010000:00010000:3.0:1789762727.857853:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.857865:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.857873:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.857878:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762727.857882:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.857889:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.857904:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762727.857910:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762727.858043:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140612992:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14856us (200207us total) trans 4294967387 rc 0/0 00000100:00100000:3.0:1789762727.858054:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:3.0:1789762727.858061:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132316230107 time 132316322579 state 0x2 ref 0 00000100:00100000:2.0:1789762727.860633:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762727.860681:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140613120 00000100:00100000:3.0:1789762727.860690:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140613120 00000100:00100000:3.0:1789762727.860727:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132316230107 time 132316322579 state 0x0 ref 1 00000100:00100000:3.0:1789762727.860737:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132516322579 time 132316322579 state 0x1 ref 1 00010000:00010000:2.0:1789762727.975132:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762728.043303:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132516322579 time 132516457299 state 0x0 ref 1 00000100:00100000:2.0:1789762728.043360:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140613120:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:0.0:1789762728.043423:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789762728.043424:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 63963136, mtime: 0x6aad9ca7, atime: 0x6aad9c9b, ctime: 0x6aad9ca7, blocks: 0x1e809 00010000:00010000:2.0:1789762728.043438:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e5aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762728.043456:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=132s v=(0 0) 00010000:00010000:2.0:1789762728.043462:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762728.043468:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e5aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762728.043500:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e5aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762728.062785:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:2.0:1789762728.062792:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 124937 -> 126985 00000001:00080000:3.0:1789762728.062801:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967388 is committed 00010000:00010000:2.0:1789762728.062804:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e5aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762728.062816:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e5aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762728.062824:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e5aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762728.062829:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762728.062852:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e5aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762728.062859:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e5aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762728.062876:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e5aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762728.062885:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e5aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762728.063009:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140613120:12345-192.168.203.31@tcp:4:dd.500 Request processed in 19662us (202353us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789762728.063024:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:2.0:1789762728.063035:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132516322579 time 132516457299 state 0x2 ref 0 00000100:00100000:1.0:1789762728.066349:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762728.066392:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140613248 00000100:00100000:3.0:1789762728.066400:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140613248 00000100:00100000:3.0:1789762728.066438:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132516322579 time 132516457299 state 0x0 ref 1 00000100:00100000:3.0:1789762728.066447:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132716457299 time 132516457299 state 0x1 ref 1 00000100:00100000:3.0:1789762728.243356:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132716457299 time 132716512109 state 0x0 ref 1 00000100:00100000:3.0:1789762728.243382:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140613248:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762728.243433:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 65011712, mtime: 0x6aad9ca7, atime: 0x6aad9c9b, ctime: 0x6aad9ca7, blocks: 0x1f009 00010000:00010000:3.0:1789762728.243443:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.243474:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=132s v=(0 0) 00010000:00010000:3.0:1789762728.243479:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762728.243499:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.243512:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762728.254802:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:3.0:1789762728.254808:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 126985 -> 129033 00010000:00010000:3.0:1789762728.254818:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.254829:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.254858:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.254865:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762728.254869:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.254876:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762728.254884:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967389 is committed 00010000:00010000:3.0:1789762728.254892:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.254910:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762728.254999:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140613248:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11625us (188649us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1789762728.255008:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:3.0:1789762728.255015:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132716457299 time 132716512109 state 0x2 ref 0 00000100:00100000:1.0:1789762728.257317:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762728.257351:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140613376 00000100:00100000:3.0:1789762728.257360:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140613376 00000100:00100000:3.0:1789762728.257394:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132716457299 time 132716512109 state 0x0 ref 1 00000100:00100000:3.0:1789762728.257405:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132916512109 time 132716512109 state 0x1 ref 1 00000100:00100000:3.0:1789762728.443417:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132916512109 time 132916573791 state 0x0 ref 1 00000100:00100000:3.0:1789762728.443446:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140613376:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762728.443495:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 66060288, mtime: 0x6aad9ca7, atime: 0x6aad9c9b, ctime: 0x6aad9ca7, blocks: 0x1f809 00010000:00010000:3.0:1789762728.443502:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.443516:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=132s v=(0 0) 00010000:00010000:3.0:1789762728.443520:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762728.443524:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.443560:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762728.456524:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967390 is committed 00002000:00010000:3.0:1789762728.456555:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:3.0:1789762728.456560:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 129033 -> 131081 00010000:00010000:3.0:1789762728.456571:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.456585:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.456596:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.456604:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762728.456609:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.456635:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.456656:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.456662:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762728.456758:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140613376:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13323us (199440us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789762728.456767:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:3.0:1789762728.456774:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132916512109 time 132916573791 state 0x2 ref 0 00000100:00100000:0.0:1789762728.459279:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762728.459332:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140613504 00000100:00100000:1.0:1789762728.459341:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140613504 00000100:00100000:1.0:1789762728.459375:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 132916512109 time 132916573791 state 0x0 ref 1 00000100:00100000:1.0:1789762728.459385:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133116573791 time 132916573791 state 0x1 ref 1 00000100:00100000:3.0:1789762728.643591:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133116573791 time 133116744192 state 0x0 ref 1 00000100:00100000:3.0:1789762728.643631:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140613504:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762728.643692:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 67108864, mtime: 0x6aad9ca7, atime: 0x6aad9c9b, ctime: 0x6aad9ca7, blocks: 0x20009 00010000:00010000:3.0:1789762728.643700:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.643716:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=133s v=(0 0) 00010000:00010000:3.0:1789762728.643720:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762728.643726:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.643740:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762728.661008:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967391 is committed 00002000:00010000:3.0:1789762728.661055:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:3.0:1789762728.661062:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 131081 -> 133129 00010000:00010000:3.0:1789762728.661076:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.661104:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.661113:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.661119:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762728.661124:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.661132:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.661151:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.661158:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762728.661264:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140613504:12345-192.168.203.31@tcp:4:dd.500 Request processed in 17647us (201980us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789762728.661277:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:3.0:1789762728.661288:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133116573791 time 133116744192 state 0x2 ref 0 00000100:00100000:2.0:1789762728.664590:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762728.664633:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140613632 00000100:00100000:3.0:1789762728.664650:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140613632 00000100:00100000:3.0:1789762728.664688:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133116573791 time 133116744192 state 0x0 ref 1 00000100:00100000:3.0:1789762728.664699:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133316744192 time 133116744192 state 0x1 ref 1 00000100:00100000:1.0:1789762728.843684:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133316744192 time 133316840447 state 0x0 ref 1 00000100:00100000:1.0:1789762728.843713:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140613632:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762728.843763:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 68157440, mtime: 0x6aad9ca7, atime: 0x6aad9c9b, ctime: 0x6aad9ca7, blocks: 0x20809 00010000:00010000:1.0:1789762728.843770:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e5c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762728.843784:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=133s v=(0 0) 00010000:00010000:1.0:1789762728.843787:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762728.843792:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e5c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762728.843804:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e5c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762728.854516:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967392 is committed 00002000:00010000:3.0:1789762728.854592:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:3.0:1789762728.854598:0:11723:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762727 -> 1789762728 00002000:00010000:3.0:1789762728.854601:0:11723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762727 -> 1789762728 00002000:00010000:3.0:1789762728.854604:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 133129 -> 135177 00010000:00010000:3.0:1789762728.854616:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e5c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.854629:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e5c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.854639:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e5c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.854647:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588ccc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762728.854651:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e5c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.854661:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e5c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.854680:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e5c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762728.854701:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e5c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762728.854779:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140613632:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11074us (190186us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789762728.854788:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:3.0:1789762728.854795:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133316744192 time 133316840447 state 0x2 ref 0 00000100:00100000:2.0:1789762728.857027:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762728.857067:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140613760 00000100:00100000:3.0:1789762728.857076:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140613760 00000100:00100000:3.0:1789762728.857108:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133316744192 time 133316840447 state 0x0 ref 1 00000100:00100000:3.0:1789762728.857117:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133516840447 time 133316840447 state 0x1 ref 1 00010000:00010000:0.0:1789762728.998995:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762729.043777:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133516840447 time 133516932107 state 0x0 ref 1 00000100:00100000:3.0:1789762729.043806:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140613760:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762729.043890:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 69206016, mtime: 0x6aad9ca8, atime: 0x6aad9c9b, ctime: 0x6aad9ca8, blocks: 0x21009 00010000:00010000:3.0:1789762729.043899:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.043915:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=133s v=(0 0) 00010000:00010000:3.0:1789762729.043920:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762729.043926:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.043997:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762729.059859:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967393 is committed 00002000:00010000:3.0:1789762729.059955:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 69206016 -> 70254592 00002000:00010000:3.0:1789762729.059962:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 135177 -> 137225 00010000:00010000:3.0:1789762729.059974:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.059985:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.059993:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.059999:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762729.060003:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.060014:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.060036:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.060046:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762729.060156:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140613760:12345-192.168.203.31@tcp:4:dd.500 Request processed in 16358us (203126us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789762729.060166:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:3.0:1789762729.060174:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133516840447 time 133516932107 state 0x2 ref 0 00000100:00100000:2.0:1789762729.062808:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762729.062917:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140613888 00000100:00100000:1.0:1789762729.062926:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140613888 00000100:00100000:1.0:1789762729.062983:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133516840447 time 133516932107 state 0x0 ref 1 00000100:00100000:1.0:1789762729.062994:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133716932107 time 133516932107 state 0x1 ref 1 00000100:00100000:3.0:1789762729.243868:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133716932107 time 133717024959 state 0x0 ref 1 00000100:00100000:3.0:1789762729.243893:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140613888:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762729.243957:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 70254592, mtime: 0x6aad9ca8, atime: 0x6aad9c9b, ctime: 0x6aad9ca8, blocks: 0x21809 00010000:00010000:3.0:1789762729.243967:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.243981:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=133s v=(0 0) 00010000:00010000:3.0:1789762729.243984:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762729.243995:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.244007:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762729.255583:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967394 is committed 00002000:00010000:3.0:1789762729.255639:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:3.0:1789762729.255644:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 137225 -> 139273 00010000:00010000:3.0:1789762729.255654:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.255674:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.255681:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.255686:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762729.255689:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.255697:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.255711:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.255717:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762729.255776:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140613888:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11891us (192969us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789762729.255805:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:3.0:1789762729.255814:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133716932107 time 133717024959 state 0x2 ref 0 00000100:00100000:0.0:1789762729.258144:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762729.258186:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140614016 00000100:00100000:1.0:1789762729.258195:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140614016 00000100:00100000:1.0:1789762729.258229:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133716932107 time 133717024959 state 0x0 ref 1 00000100:00100000:1.0:1789762729.258239:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133917024959 time 133717024959 state 0x1 ref 1 00000100:00100000:1.0:1789762729.444018:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133917024959 time 133917172987 state 0x0 ref 1 00000100:00100000:1.0:1789762729.444050:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140614016:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762729.444115:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 71303168, mtime: 0x6aad9ca8, atime: 0x6aad9c9b, ctime: 0x6aad9ca8, blocks: 0x22009 00010000:00010000:1.0:1789762729.444123:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e5db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762729.444139:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=133s v=(0 0) 00010000:00010000:1.0:1789762729.444142:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762729.444147:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e5db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762729.444159:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e5db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762729.458157:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967395 is committed 00002000:00010000:3.0:1789762729.458177:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:3.0:1789762729.458189:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 139273 -> 141321 00010000:00010000:3.0:1789762729.458202:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e5db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.458213:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e5db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.458221:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e5db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.458226:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cdc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762729.458230:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e5db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.458238:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.458255:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e5db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.458261:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e5db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762729.458334:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140614016:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14297us (200189us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789762729.458345:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:3.0:1789762729.458352:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133917024959 time 133917172987 state 0x2 ref 0 00000100:00100000:0.0:1789762729.461449:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762729.461493:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140614144 00000100:00100000:3.0:1789762729.461503:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140614144 00000100:00100000:3.0:1789762729.461564:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 133917024959 time 133917172987 state 0x0 ref 1 00000100:00100000:3.0:1789762729.461578:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134117172987 time 133917172987 state 0x1 ref 1 00000100:00100000:1.0:1789762729.644121:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134117172987 time 134117275979 state 0x0 ref 1 00000100:00100000:1.0:1789762729.644149:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140614144:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762729.644200:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 72351744, mtime: 0x6aad9ca8, atime: 0x6aad9c9b, ctime: 0x6aad9ca8, blocks: 0x22809 00010000:00010000:1.0:1789762729.644207:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e5e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762729.644221:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=134s v=(0 0) 00010000:00010000:1.0:1789762729.644224:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762729.644234:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e5e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762729.644247:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e5e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762729.657603:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967396 is committed 00002000:00010000:3.0:1789762729.657638:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:3.0:1789762729.657645:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 141321 -> 143369 00010000:00010000:3.0:1789762729.657660:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e5e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.657674:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e5e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.657685:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e5e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.657694:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cd600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762729.657699:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e5e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.657710:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e5e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.657730:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e5e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.657739:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e5e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762729.657865:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140614144:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13691us (196383us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789762729.657877:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:3.0:1789762729.657886:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134117172987 time 134117275979 state 0x2 ref 0 00000100:00100000:2.0:1789762729.660298:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762729.660334:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140614272 00000100:00100000:3.0:1789762729.660342:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140614272 00000100:00100000:3.0:1789762729.660374:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134117172987 time 134117275979 state 0x0 ref 1 00000100:00100000:3.0:1789762729.660384:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134317275979 time 134117275979 state 0x1 ref 1 00000100:00100000:3.0:1789762729.844196:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134317275979 time 134317350939 state 0x0 ref 1 00000100:00100000:3.0:1789762729.844225:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140614272:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762729.844279:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 73400320, mtime: 0x6aad9ca8, atime: 0x6aad9c9b, ctime: 0x6aad9ca8, blocks: 0x23009 00010000:00010000:3.0:1789762729.844289:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.844307:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=134s v=(0 0) 00010000:00010000:3.0:1789762729.844312:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762729.844317:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.844330:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762729.855237:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967397 is committed 00002000:00010000:3.0:1789762729.855257:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:3.0:1789762729.855264:0:11723:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762728 -> 1789762729 00002000:00010000:3.0:1789762729.855267:0:11723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762728 -> 1789762729 00002000:00010000:3.0:1789762729.855270:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 143369 -> 145417 00010000:00010000:3.0:1789762729.855283:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.855294:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.855301:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.855307:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762729.855310:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.855316:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.855332:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762729.855337:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762729.855413:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140614272:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11200us (195113us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1789762729.855421:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:3.0:1789762729.855428:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134317275979 time 134317350939 state 0x2 ref 0 00000100:00100000:1.0:1789762729.857915:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762729.857961:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140614400 00000100:00100000:2.0:1789762729.857970:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140614400 00000100:00100000:2.0:1789762729.858010:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134317275979 time 134317350939 state 0x0 ref 1 00000100:00100000:2.0:1789762729.858019:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134517350939 time 134317350939 state 0x1 ref 1 00010000:00010000:3.0:1789762730.022979:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762730.044304:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134517350939 time 134517463024 state 0x0 ref 1 00000100:00100000:3.0:1789762730.044341:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140614400:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:0.0:1789762730.044362:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762730.044390:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 74448896, mtime: 0x6aad9ca9, atime: 0x6aad9c9b, ctime: 0x6aad9ca9, blocks: 0x23809 00010000:00010000:3.0:1789762730.044398:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.044411:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=134s v=(0 0) 00010000:00010000:3.0:1789762730.044414:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762730.044419:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.044430:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762730.055979:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967398 is committed 00002000:00010000:3.0:1789762730.056008:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:3.0:1789762730.056012:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 145417 -> 147465 00010000:00010000:3.0:1789762730.056023:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.056044:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.056051:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.056056:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762730.056059:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.056066:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.056080:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.056086:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e5f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762730.056151:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140614400:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11831us (198235us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789762730.056159:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:3.0:1789762730.056166:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134517350939 time 134517463024 state 0x2 ref 0 00000100:00100000:1.0:1789762730.058347:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762730.058379:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140614528 00000100:00100000:3.0:1789762730.058391:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140614528 00000100:00100000:3.0:1789762730.058423:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134517350939 time 134517463024 state 0x0 ref 1 00000100:00100000:3.0:1789762730.058433:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134717463024 time 134517463024 state 0x1 ref 1 00000100:00100000:2.0:1789762730.244383:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134717463024 time 134717539309 state 0x0 ref 1 00000100:00100000:2.0:1789762730.244406:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140614528:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762730.244453:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 75497472, mtime: 0x6aad9ca9, atime: 0x6aad9c9b, ctime: 0x6aad9ca9, blocks: 0x24009 00010000:00010000:2.0:1789762730.244460:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e5f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762730.244473:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=134s v=(0 0) 00010000:00010000:2.0:1789762730.244489:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762730.244494:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e5f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762730.244505:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e5f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762730.256105:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 75497472 -> 76546048 00000001:00080000:3.0:1789762730.256109:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967399 is committed 00002000:00010000:2.0:1789762730.256111:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 147465 -> 149513 00010000:00010000:2.0:1789762730.256126:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e5f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762730.256137:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e5f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762730.256144:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e5f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762730.256149:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762730.256152:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e5f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762730.256159:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e5f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762730.256174:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e5f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762730.256190:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c56e5f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762730.256262:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140614528:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11861us (197913us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789762730.256270:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:2.0:1789762730.256277:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134717463024 time 134717539309 state 0x2 ref 0 00000100:00100000:1.0:1789762730.258451:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762730.258495:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140614656 00000100:00100000:3.0:1789762730.258503:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140614656 00000100:00100000:3.0:1789762730.258536:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134717463024 time 134717539309 state 0x0 ref 1 00000100:00100000:3.0:1789762730.258546:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134917539309 time 134717539309 state 0x1 ref 1 00000100:00100000:1.0:1789762730.444545:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134917539309 time 134917697473 state 0x0 ref 1 00000100:00100000:1.0:1789762730.444581:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140614656:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762730.444632:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 76546048, mtime: 0x6aad9ca9, atime: 0x6aad9c9b, ctime: 0x6aad9ca9, blocks: 0x24809 00010000:00010000:1.0:1789762730.444639:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061a86d37/0xd08452c77c56e5fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762730.444665:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=134s v=(0 0) 00010000:00010000:1.0:1789762730.444669:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762730.444673:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061a86d37/0xd08452c77c56e5fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762730.444685:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061a86d37/0xd08452c77c56e5fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762730.455808:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967400 is committed 00002000:00010000:3.0:1789762730.455854:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:3.0:1789762730.455861:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 149513 -> 151561 00010000:00010000:3.0:1789762730.455875:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061a86d37/0xd08452c77c56e5fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.455889:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061a86d37/0xd08452c77c56e5fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.455900:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061a86d37/0xd08452c77c56e5fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.455908:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cce00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762730.455912:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061a86d37/0xd08452c77c56e5fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.455920:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061a86d37/0xd08452c77c56e5fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.455959:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061a86d37/0xd08452c77c56e5fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.455964:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061a86d37/0xd08452c77c56e5fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762730.456028:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140614656:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11463us (197576us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789762730.456036:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:3.0:1789762730.456041:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134917539309 time 134917697473 state 0x2 ref 0 00000100:00100000:1.0:1789762730.458165:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762730.458198:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140614784 00000100:00100000:3.0:1789762730.458206:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140614784 00000100:00100000:3.0:1789762730.458239:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 134917539309 time 134917697473 state 0x0 ref 1 00000100:00100000:3.0:1789762730.458248:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135117697473 time 134917697473 state 0x1 ref 1 00000100:00100000:3.0:1789762730.644604:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135117697473 time 135117760516 state 0x0 ref 1 00000100:00100000:3.0:1789762730.644631:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140614784:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762730.644680:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 77594624, mtime: 0x6aad9ca9, atime: 0x6aad9c9b, ctime: 0x6aad9ca9, blocks: 0x25009 00010000:00010000:3.0:1789762730.644687:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e605 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.644700:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=135s v=(0 0) 00010000:00010000:3.0:1789762730.644703:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762730.644720:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e605 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.644733:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e605 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762730.655464:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967401 is committed 00002000:00010000:3.0:1789762730.655526:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:3.0:1789762730.655531:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 151561 -> 153609 00010000:00010000:3.0:1789762730.655541:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e605 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.655550:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e605 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.655557:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e605 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.655562:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762730.655565:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e605 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.655573:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e605 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.655587:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e605 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.655602:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e605 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762730.655663:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140614784:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11043us (197499us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789762730.655671:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:3.0:1789762730.655676:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135117697473 time 135117760516 state 0x2 ref 0 00000100:00100000:1.0:1789762730.657699:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762730.657744:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140614912 00000100:00100000:2.0:1789762730.657753:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140614912 00000100:00100000:2.0:1789762730.657785:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135117697473 time 135117760516 state 0x0 ref 1 00000100:00100000:2.0:1789762730.657793:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135317760516 time 135117760516 state 0x1 ref 1 00000100:00100000:3.0:1789762730.844714:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135317760516 time 135317867664 state 0x0 ref 1 00000100:00100000:3.0:1789762730.844746:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140614912:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762730.844798:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 78643200, mtime: 0x6aad9ca9, atime: 0x6aad9c9b, ctime: 0x6aad9ca9, blocks: 0x25809 00010000:00010000:3.0:1789762730.844806:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e60c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.844820:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=135s v=(0 0) 00010000:00010000:3.0:1789762730.844823:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762730.844828:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e60c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.844859:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e60c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762730.856195:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967402 is committed 00002000:00010000:3.0:1789762730.856211:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 78643200 -> 79691776 00002000:00010000:3.0:1789762730.856215:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762729 -> 1789762730 00002000:00010000:3.0:1789762730.856223:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762729 -> 1789762730 00002000:00010000:3.0:1789762730.856225:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 153609 -> 155657 00010000:00010000:3.0:1789762730.856236:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e60c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.856245:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e60c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.856252:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e60c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.856257:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762730.856261:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e60c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.856267:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e60c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.856281:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e60c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762730.856286:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e60c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762730.856349:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140614912:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11614us (198648us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789762730.856360:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:3.0:1789762730.856375:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135317760516 time 135317867664 state 0x2 ref 0 00000100:00100000:1.0:1789762730.858440:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762730.858487:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140615040 00000100:00100000:2.0:1789762730.858495:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140615040 00000100:00100000:2.0:1789762730.858527:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135317760516 time 135317867664 state 0x0 ref 1 00000100:00100000:2.0:1789762730.858537:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135517867664 time 135317867664 state 0x1 ref 1 00000100:00100000:2.0:1789762731.044775:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135517867664 time 135517931413 state 0x0 ref 1 00000100:00100000:2.0:1789762731.044802:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140615040:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762731.044870:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 79691776, mtime: 0x6aad9caa, atime: 0x6aad9c9b, ctime: 0x6aad9caa, blocks: 0x26009 00010000:00010000:2.0:1789762731.044877:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e613 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762731.044905:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=135s v=(0 0) 00010000:00010000:2.0:1789762731.044908:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762731.044913:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e613 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762731.044943:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e613 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762731.046941:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789762731.055814:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967403 is committed 00002000:00010000:3.0:1789762731.055850:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:3.0:1789762731.055857:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 155657 -> 157705 00010000:00010000:3.0:1789762731.055871:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e613 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.055886:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e613 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.055896:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.055903:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762731.055907:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.055914:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e613 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.055940:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e613 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.055946:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c56e613 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762731.056021:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140615040:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11227us (197577us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1789762731.056038:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:3.0:1789762731.056044:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135517867664 time 135517931413 state 0x2 ref 0 00000100:00100000:1.0:1789762731.058068:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762731.058100:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140615168 00000100:00100000:3.0:1789762731.058108:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140615168 00000100:00100000:3.0:1789762731.058142:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135517867664 time 135517931413 state 0x0 ref 1 00000100:00100000:3.0:1789762731.058151:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135717931413 time 135517931413 state 0x1 ref 1 00000100:00100000:2.0:1789762731.244861:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135717931413 time 135718017671 state 0x0 ref 1 00000100:00100000:2.0:1789762731.244885:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140615168:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762731.244944:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 80740352, mtime: 0x6aad9caa, atime: 0x6aad9c9b, ctime: 0x6aad9caa, blocks: 0x26809 00010000:00010000:2.0:1789762731.244952:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e61a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762731.244965:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=135s v=(0 0) 00010000:00010000:2.0:1789762731.244968:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762731.244973:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e61a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762731.244984:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e61a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762731.256126:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967404 is committed 00002000:00010000:3.0:1789762731.256177:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 80740352 -> 81788928 00002000:00010000:3.0:1789762731.256183:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 157705 -> 159753 00010000:00010000:3.0:1789762731.256196:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e61a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.256208:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e61a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.256219:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e61a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.256227:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762731.256232:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e61a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.256243:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e61a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.256262:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e61a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.256274:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56e61a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762731.256338:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140615168:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11461us (198269us total) trans 4294967404 rc 0/0 00000100:00100000:3.0:1789762731.256346:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:3.0:1789762731.256352:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135717931413 time 135718017671 state 0x2 ref 0 00000100:00100000:2.0:1789762731.258377:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762731.258410:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140615296 00000100:00100000:3.0:1789762731.258418:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140615296 00000100:00100000:3.0:1789762731.258452:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135717931413 time 135718017671 state 0x0 ref 1 00000100:00100000:3.0:1789762731.258461:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135918017671 time 135718017671 state 0x1 ref 1 00000100:00100000:3.0:1789762731.444967:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135918017671 time 135918122753 state 0x0 ref 1 00000100:00100000:3.0:1789762731.444995:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140615296:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762731.445045:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 81788928, mtime: 0x6aad9caa, atime: 0x6aad9c9b, ctime: 0x6aad9caa, blocks: 0x27009 00010000:00010000:3.0:1789762731.445052:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e621 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.445065:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=135s v=(0 0) 00010000:00010000:3.0:1789762731.445069:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762731.445074:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.445101:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762731.456527:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967405 is committed 00002000:00010000:3.0:1789762731.456546:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 81788928 -> 82837504 00002000:00010000:3.0:1789762731.456551:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 159753 -> 161801 00010000:00010000:3.0:1789762731.456563:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.456573:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e621 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.456580:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e621 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.456585:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762731.456589:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e621 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.456596:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e621 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.456610:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e621 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.456615:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e621 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762731.456686:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140615296:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11701us (198306us total) trans 4294967405 rc 0/0 00000100:00100000:3.0:1789762731.456693:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:3.0:1789762731.456700:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135918017671 time 135918122753 state 0x2 ref 0 00000100:00100000:0.0:1789762731.458682:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762731.458726:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140615424 00000100:00100000:1.0:1789762731.458734:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140615424 00000100:00100000:1.0:1789762731.458769:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 135918017671 time 135918122753 state 0x0 ref 1 00000100:00100000:1.0:1789762731.458778:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136118122753 time 135918122753 state 0x1 ref 1 00000100:00100000:3.0:1789762731.645065:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136118122753 time 136118220279 state 0x0 ref 1 00000100:00100000:3.0:1789762731.645099:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140615424:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762731.645152:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 82837504, mtime: 0x6aad9caa, atime: 0x6aad9c9b, ctime: 0x6aad9caa, blocks: 0x27809 00010000:00010000:3.0:1789762731.645160:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e628 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.645174:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=136s v=(0 0) 00010000:00010000:3.0:1789762731.645177:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762731.645182:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.645194:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762731.656699:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967406 is committed 00002000:00010000:3.0:1789762731.656772:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:3.0:1789762731.656777:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 161801 -> 163849 00010000:00010000:3.0:1789762731.656788:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.656809:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e628 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.656816:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.656821:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762731.656825:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.656846:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.656862:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e628 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.656868:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e628 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762731.656947:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140615424:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11859us (198262us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1789762731.656955:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:3.0:1789762731.656962:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136118122753 time 136118220279 state 0x2 ref 0 00000100:00100000:2.0:1789762731.659020:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762731.659060:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140615552 00000100:00100000:3.0:1789762731.659072:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140615552 00000100:00100000:3.0:1789762731.659104:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136118122753 time 136118220279 state 0x0 ref 1 00000100:00100000:3.0:1789762731.659113:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136318220279 time 136118220279 state 0x1 ref 1 00000100:00100000:1.0:1789762731.687022:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148995200:0@lo:400:kworker.0 00000100:00100000:0.0:1789762731.687039:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702148995456:0@lo:400:kworker.0 00000100:00100000:2.0:1789762731.687056:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702148995584:0@lo:400:kworker.0 00000100:00100000:1.0:1789762731.687091:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762731.687095:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762731.687157:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762731.687166:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148995968:0@lo:400:kworker.0 00000100:00100000:1.0:1789762731.687166:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148995712:0@lo:400:kworker.0 00000100:00100000:2.0:1789762731.687205:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148995456 00000100:00100000:0.0:1789762731.687209:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762731.687213:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148995456 00000100:00100000:1.0:1789762731.687232:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148995200 00000100:00100000:1.0:1789762731.687237:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148995200 00000100:00100000:2.0:1789762731.687260:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148995584 00000100:00100000:2.0:1789762731.687264:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148995584 00000100:00100000:0.0:1789762731.687270:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148995328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762731.687287:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789762731.687300:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702148995200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762731.687305:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789762731.687313:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762731.687318:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702148995456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762731.687341:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702148995840:0@lo:400:kworker.0 00000100:00100000:1.0:1789762731.687361:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702148995200:12345-0@lo:400:kworker.0 Request processed in 66us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762731.687369:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789762731.687373:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148995328 00000100:00100000:0.0:1789762731.687376:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762731.687380:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148995328 00000100:00100000:2.0:1789762731.687385:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702148995456:12345-0@lo:400:kworker.0 Request processed in 69us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762731.687393:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789762731.687414:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148995840 00000100:00100000:1.0:1789762731.687419:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762731.687419:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148995840 00000100:00100000:0.0:1789762731.687428:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789762731.687439:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702148995584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762731.687446:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789762731.687456:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702148995840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762731.687462:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789762731.687464:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148995200:0@lo:400:kworker.0 00000100:00100000:1.0:1789762731.687501:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148995968 00000100:00100000:0.0:1789762731.687502:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702148995584:12345-0@lo:400:kworker.0 Request processed in 64us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762731.687507:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148995968 00000100:00100000:2.0:1789762731.687508:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702148995840:12345-0@lo:400:kworker.0 Request processed in 53us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762731.687512:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148995328:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762731.687521:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789762731.687528:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789762731.687541:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148995712 00000100:00100000:1.0:1789762731.687545:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148995712 00002000:00000024:3.0:1789762731.687547:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789762731.687559:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762731.687560:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789762731.687567:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789762731.687574:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762731.687577:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702148995968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762731.687591:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702148995328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762731.687597:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789762731.687602:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789762731.687612:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148995712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762731.687616:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702148995584:0@lo:400:kworker.0 00000100:00100000:0.0:1789762731.687632:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148995968:12345-0@lo:400:kworker.0 Request processed in 60us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762731.687639:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789762731.687656:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1789762731.687661:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d1742eb100, transno 4294967321 00000100:00100000:1.0:1789762731.687672:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148995712:12345-0@lo:400:kworker.0 Request processed in 65us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762731.687681:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789762731.687689:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148995328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762731.687709:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148995712:0@lo:400:kworker.0 00000100:00100000:2.0:1789762731.687711:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702148995840:0@lo:400:kworker.0 00000100:00100000:0.0:1789762731.687774:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148995968:0@lo:400:kworker.0 00000100:00100000:0.0:1789762731.687787:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702148995456:0@lo:400:kworker.0 00000004:00080000:1.0:1789762731.688401:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:1.0:1789762731.845212:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136318220279 time 136318362708 state 0x0 ref 1 00000100:00100000:1.0:1789762731.845276:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140615552:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762731.845349:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 83886080, mtime: 0x6aad9caa, atime: 0x6aad9c9b, ctime: 0x6aad9caa, blocks: 0x28009 00010000:00010000:1.0:1789762731.845361:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e62f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762731.845408:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=136s v=(0 0) 00010000:00010000:1.0:1789762731.845415:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762731.845423:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e62f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762731.845442:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e62f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762731.859481:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967407 is committed 00002000:00010000:3.0:1789762731.859503:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:3.0:1789762731.859508:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762730 -> 1789762731 00002000:00010000:3.0:1789762731.859511:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762730 -> 1789762731 00002000:00010000:3.0:1789762731.859514:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 163849 -> 165897 00010000:00010000:3.0:1789762731.859527:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e62f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.859541:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e62f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.859552:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e62f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.859560:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cd200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762731.859565:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e62f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.859585:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e62f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.859605:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e62f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762731.859614:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e62f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762731.859697:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140615552:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14460us (200674us total) trans 4294967407 rc 0/0 00000100:00100000:3.0:1789762731.859709:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:3.0:1789762731.859716:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136318220279 time 136318362708 state 0x2 ref 0 00000100:00100000:2.0:1789762731.862389:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762731.862459:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140615680 00000100:00100000:3.0:1789762731.862473:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140615680 00000100:00100000:3.0:1789762731.862550:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136318220279 time 136318362708 state 0x0 ref 1 00000100:00100000:3.0:1789762731.862562:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136518362708 time 136318362708 state 0x1 ref 1 00000100:00100000:0.0:1789762731.892120:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762731.892175:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762731.892209:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762731.892251:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140615936 00000100:00100000:2.0:1789762731.892266:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140615936 00000100:00100000:0.0:1789762731.892306:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762731.892306:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140615808 00000100:00100000:3.0:1789762731.892312:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140616192 00000100:00100000:1.0:1789762731.892314:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140615808 00000100:00100000:3.0:1789762731.892318:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140616192 00000100:00100000:0.0:1789762731.892364:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140616064 00000100:00100000:0.0:1789762731.892375:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140616064 00000100:00100000:2.0:1789762731.892378:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:3.0:1789762731.892405:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:2.0:1789762731.892407:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140615936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762731.892420:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:3.0:1789762731.892432:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140616192:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762731.892453:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140615808:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762731.892463:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:0.0:1789762731.892487:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140616064:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762731.892521:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140616192:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 97us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762731.892522:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140615936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 120us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762731.892555:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140615808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 93us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762731.892561:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:1.0:1789762731.892568:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:3.0:1789762731.892575:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1789762731.892576:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140616064:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762731.892589:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00080000:2.0:1789762731.892590:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789762731.892596:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762732.045394:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136518362708 time 136518545808 state 0x0 ref 1 00000100:00100000:3.0:1789762732.045453:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140615680:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762732.045518:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 84934656, mtime: 0x6aad9cab, atime: 0x6aad9c9b, ctime: 0x6aad9cab, blocks: 0x28809 00010000:00010000:3.0:1789762732.045529:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e636 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.045547:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=136s v=(0 0) 00010000:00010000:3.0:1789762732.045552:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762732.045559:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.045575:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789762732.045815:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789762732.058104:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967408 is committed 00002000:00010000:3.0:1789762732.058159:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:3.0:1789762732.058164:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 165897 -> 167945 00010000:00010000:3.0:1789762732.058176:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.058187:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e636 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.058194:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.058210:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762732.058213:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.058220:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e636 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.058235:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e636 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.058240:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e636 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762732.058313:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140615680:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12896us (195926us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1789762732.058322:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:3.0:1789762732.058330:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136518362708 time 136518545808 state 0x2 ref 0 00000100:00100000:3.0:1789762732.060547:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762732.060565:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140616320 00000100:00100000:1.0:1789762732.060573:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140616320 00000100:00100000:1.0:1789762732.060609:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136518362708 time 136518545808 state 0x0 ref 1 00000100:00100000:1.0:1789762732.060619:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136718545808 time 136518545808 state 0x1 ref 1 00010000:00010000:2.0:1789762732.070963:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762732.199062:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148996096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762732.199136:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762732.199186:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148996096 00000100:00100000:2.0:1789762732.199196:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148996096 00000100:00100000:2.0:1789762732.199246:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789762732.199255:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148996096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762732.199275:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211222528 pending 0 free 3782213632 avail 3771727872 00000100:00100000:2.0:1789762732.199322:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148996096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762732.199328:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789762732.199368:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148996096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762732.245511:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136718545808 time 136718667911 state 0x0 ref 1 00000100:00100000:3.0:1789762732.245533:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140616320:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762732.245580:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 85983232, mtime: 0x6aad9cab, atime: 0x6aad9c9b, ctime: 0x6aad9cab, blocks: 0x29009 00010000:00010000:3.0:1789762732.245587:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e63d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.245613:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=136s v=(0 0) 00010000:00010000:3.0:1789762732.245617:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762732.245622:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e63d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.245632:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e63d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762732.261539:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967409 is committed 00002000:00010000:3.0:1789762732.261569:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:3.0:1789762732.261578:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 167945 -> 169993 00010000:00010000:3.0:1789762732.261594:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e63d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.261618:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e63d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.261626:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e63d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.261631:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762732.261636:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e63d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.261644:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e63d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.261688:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e63d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.261694:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e63d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762732.261782:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140616320:12345-192.168.203.31@tcp:4:dd.500 Request processed in 16253us (201232us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789762732.261792:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:3.0:1789762732.261800:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136718545808 time 136718667911 state 0x2 ref 0 00000100:00100000:1.0:1789762732.265028:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762732.265075:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140616448 00000100:00100000:3.0:1789762732.265086:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140616448 00000100:00100000:3.0:1789762732.265131:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136718545808 time 136718667911 state 0x0 ref 1 00000100:00100000:3.0:1789762732.265143:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136918667911 time 136718667911 state 0x1 ref 1 00000100:00100000:1.0:1789762732.445702:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136918667911 time 136918848204 state 0x0 ref 1 00000100:00100000:1.0:1789762732.445755:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140616448:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762732.445828:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 87031808, mtime: 0x6aad9cab, atime: 0x6aad9c9b, ctime: 0x6aad9cab, blocks: 0x29809 00010000:00010000:1.0:1789762732.445898:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e644 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762732.445944:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=136s v=(0 0) 00010000:00010000:1.0:1789762732.445952:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762732.445962:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762732.445987:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762732.467959:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967410 is committed 00002000:00010000:3.0:1789762732.467967:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 87031808 -> 88080384 00002000:00010000:3.0:1789762732.467976:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 169993 -> 172041 00010000:00010000:3.0:1789762732.467994:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.468008:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.468016:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e644 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.468034:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cd600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762732.468039:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e644 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.468046:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e644 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.468069:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e644 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.468075:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d409acc/0xd08452c77c56e644 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762732.468178:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140616448:12345-192.168.203.31@tcp:4:dd.500 Request processed in 22444us (203147us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789762732.468189:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:3.0:1789762732.468200:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136918667911 time 136918848204 state 0x2 ref 0 00000100:00100000:3.0:1789762732.472108:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762732.472187:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140616576 00000100:00100000:1.0:1789762732.472203:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140616576 00000100:00100000:1.0:1789762732.472269:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 136918667911 time 136918848204 state 0x0 ref 1 00000100:00100000:1.0:1789762732.472286:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137118848204 time 136918848204 state 0x1 ref 1 00000100:00100000:3.0:1789762732.645950:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137118848204 time 137119098728 state 0x0 ref 1 00000100:00100000:3.0:1789762732.645998:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140616576:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762732.646082:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 88080384, mtime: 0x6aad9cab, atime: 0x6aad9c9b, ctime: 0x6aad9cab, blocks: 0x2a009 00010000:00010000:3.0:1789762732.646092:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e64b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.646133:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=137s v=(0 0) 00010000:00010000:3.0:1789762732.646138:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762732.646144:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e64b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.646162:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e64b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762732.662794:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 88080384 -> 89128960 00000001:00080000:1.0:1789762732.662798:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967411 is committed 00002000:00010000:3.0:1789762732.662801:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 172041 -> 174089 00010000:00010000:3.0:1789762732.662817:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e64b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.662827:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e64b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.662856:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e64b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.662862:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762732.662867:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e64b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.662874:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e64b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.662902:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e64b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.662909:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e64b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762732.662993:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140616576:12345-192.168.203.31@tcp:4:dd.500 Request processed in 17022us (190884us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789762732.663002:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:3.0:1789762732.663009:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137118848204 time 137119098728 state 0x2 ref 0 00000100:00100000:3.0:1789762732.666871:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762732.666964:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140616704 00000100:00100000:2.0:1789762732.666974:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140616704 00000100:00100000:2.0:1789762732.667020:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137118848204 time 137119098728 state 0x0 ref 1 00000100:00100000:2.0:1789762732.667032:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137319098728 time 137119098728 state 0x1 ref 1 00000100:00100000:1.0:1789762732.846114:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137319098728 time 137319265364 state 0x0 ref 1 00000100:00100000:1.0:1789762732.846159:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140616704:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762732.846254:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 89128960, mtime: 0x6aad9cab, atime: 0x6aad9c9b, ctime: 0x6aad9cab, blocks: 0x2a809 00010000:00010000:1.0:1789762732.846287:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e652 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762732.846308:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=137s v=(0 0) 00010000:00010000:1.0:1789762732.846315:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762732.846323:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e652 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762732.846342:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e652 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762732.868681:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967412 is committed 00002000:00010000:3.0:1789762732.868820:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:3.0:1789762732.868830:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762731 -> 1789762732 00002000:00010000:3.0:1789762732.868863:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762731 -> 1789762732 00002000:00010000:3.0:1789762732.868867:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 174089 -> 176137 00010000:00010000:3.0:1789762732.868886:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e652 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.868904:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e652 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.868944:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e652 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.868959:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cdc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762732.868982:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e652 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.869003:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e652 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.869038:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e652 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762732.869063:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e652 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762732.869178:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140616704:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23035us (202299us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789762732.869192:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:3.0:1789762732.869202:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137319098728 time 137319265364 state 0x2 ref 0 00000100:00100000:3.0:1789762732.873055:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762732.873157:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140616832 00000100:00100000:2.0:1789762732.873183:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140616832 00000100:00100000:2.0:1789762732.873246:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137319098728 time 137319265364 state 0x0 ref 1 00000100:00100000:2.0:1789762732.873260:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137519265364 time 137319265364 state 0x1 ref 1 00000100:00100000:2.0:1789762733.046183:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137519265364 time 137519331438 state 0x0 ref 1 00000100:00100000:2.0:1789762733.046219:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140616832:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762733.046302:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 90177536, mtime: 0x6aad9cac, atime: 0x6aad9c9b, ctime: 0x6aad9cac, blocks: 0x2b009 00010000:00010000:2.0:1789762733.046312:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e659 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762733.046332:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=137s v=(0 0) 00010000:00010000:2.0:1789762733.046336:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762733.046342:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e659 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762733.046357:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e659 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762733.069028:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967413 is committed 00002000:00010000:3.0:1789762733.069284:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:3.0:1789762733.069293:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 176137 -> 178185 00010000:00010000:3.0:1789762733.069316:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e659 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.069337:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e659 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.069355:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e659 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.069377:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762733.069383:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e659 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.069393:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e659 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.069415:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e659 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.069424:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e659 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762733.069558:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140616832:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23345us (196497us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789762733.069578:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:3.0:1789762733.069592:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137519265364 time 137519331438 state 0x2 ref 0 00000100:00100000:3.0:1789762733.074162:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762733.074258:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140616960 00000100:00100000:1.0:1789762733.074274:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140616960 00000100:00100000:1.0:1789762733.074354:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137519265364 time 137519331438 state 0x0 ref 1 00000100:00100000:1.0:1789762733.074372:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137719331438 time 137519331438 state 0x1 ref 1 00010000:00010000:0.0:1789762733.095066:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762733.246320:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137719331438 time 137719471938 state 0x0 ref 1 00000100:00100000:2.0:1789762733.246358:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140616960:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762733.246430:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 91226112, mtime: 0x6aad9cac, atime: 0x6aad9c9b, ctime: 0x6aad9cac, blocks: 0x2b809 00010000:00010000:2.0:1789762733.246444:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e660 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762733.246508:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=137s v=(0 0) 00010000:00010000:2.0:1789762733.246515:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762733.246524:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e660 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762733.246543:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e660 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762733.269246:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967414 is committed 00002000:00010000:3.0:1789762733.269317:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:3.0:1789762733.269326:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 178185 -> 180233 00010000:00010000:3.0:1789762733.269344:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e660 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.269364:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e660 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.269399:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e660 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.269414:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762733.269424:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e660 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.269444:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e660 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.269477:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e660 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.269489:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c56e660 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762733.269624:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140616960:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23275us (195466us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789762733.269641:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:3.0:1789762733.269652:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137719331438 time 137719471938 state 0x2 ref 0 00000100:00100000:0.0:1789762733.273823:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762733.273967:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140617088 00000100:00100000:3.0:1789762733.273982:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140617088 00000100:00100000:3.0:1789762733.274060:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137719331438 time 137719471938 state 0x0 ref 1 00000100:00100000:3.0:1789762733.274076:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137919471938 time 137719471938 state 0x1 ref 1 00000100:00100000:1.0:1789762733.446501:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137919471938 time 137919647311 state 0x0 ref 1 00000100:00100000:1.0:1789762733.446553:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140617088:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762733.446646:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 92274688, mtime: 0x6aad9cac, atime: 0x6aad9c9b, ctime: 0x6aad9cac, blocks: 0x2c009 00010000:00010000:1.0:1789762733.446659:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e667 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.446681:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=137s v=(0 0) 00010000:00010000:1.0:1789762733.446706:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762733.446715:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e667 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.446734:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e667 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762733.472157:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967415 is committed 00002000:00010000:1.0:1789762733.472213:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 92274688 -> 93323264 00002000:00010000:1.0:1789762733.472222:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 180233 -> 182281 00010000:00010000:1.0:1789762733.472241:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e667 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.472259:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e667 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.472272:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e667 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.472281:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588ccc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762733.472287:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e667 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.472299:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e667 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.472324:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e667 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.472371:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e667 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762733.472494:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140617088:12345-192.168.203.31@tcp:4:dd.500 Request processed in 25960us (198669us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789762733.472509:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:1.0:1789762733.472521:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137919471938 time 137919647311 state 0x2 ref 0 00000100:00100000:3.0:1789762733.476600:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762733.476675:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140617216 00000100:00100000:1.0:1789762733.476689:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140617216 00000100:00100000:1.0:1789762733.476745:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 137919471938 time 137919647311 state 0x0 ref 1 00000100:00100000:1.0:1789762733.476761:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138119647311 time 137919647311 state 0x1 ref 1 00000100:00100000:3.0:1789762733.646699:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138119647311 time 138119849751 state 0x0 ref 1 00000100:00100000:3.0:1789762733.646741:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140617216:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762733.646814:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 93323264, mtime: 0x6aad9cac, atime: 0x6aad9c9b, ctime: 0x6aad9cac, blocks: 0x2c809 00010000:00010000:3.0:1789762733.646827:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e66e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.646883:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=138s v=(0 0) 00010000:00010000:3.0:1789762733.646889:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762733.646898:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e66e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.646941:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e66e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762733.670106:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967416 is committed 00002000:00010000:1.0:1789762733.670235:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 93323264 -> 94371840 00002000:00010000:1.0:1789762733.670244:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 182281 -> 184331 00010000:00010000:1.0:1789762733.670262:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e66e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.670279:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e66e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.670292:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e66e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.670302:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762733.670323:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e66e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.670335:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e66e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.670361:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e66e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.670371:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c56e66e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762733.670488:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140617216:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23760us (193887us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789762733.670502:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:1.0:1789762733.670513:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138119647311 time 138119849751 state 0x2 ref 0 00000100:00100000:0.0:1789762733.674474:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762733.674571:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140617344 00000100:00100000:2.0:1789762733.674586:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140617344 00000100:00100000:2.0:1789762733.674643:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138119647311 time 138119849751 state 0x0 ref 1 00000100:00100000:2.0:1789762733.674660:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138319849751 time 138119849751 state 0x1 ref 1 00000100:00100000:1.0:1789762733.846964:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138319849751 time 138320115041 state 0x0 ref 1 00000100:00100000:1.0:1789762733.847006:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140617344:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762733.847079:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 94371840, mtime: 0x6aad9cac, atime: 0x6aad9c9b, ctime: 0x6aad9cac, blocks: 0x2d00b 00010000:00010000:1.0:1789762733.847091:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e675 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.847112:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=138s v=(0 0) 00010000:00010000:1.0:1789762733.847118:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762733.847127:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762733.847162:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762733.870030:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967417 is committed 00002000:00010000:3.0:1789762733.870145:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 94371840 -> 95420416 00002000:00010000:3.0:1789762733.870154:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762732 -> 1789762733 00002000:00010000:3.0:1789762733.870158:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762732 -> 1789762733 00002000:00010000:3.0:1789762733.870161:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 184331 -> 186379 00010000:00010000:3.0:1789762733.870183:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.870208:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e675 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.870256:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e675 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.870272:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588ccc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762733.870282:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e675 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.870302:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e675 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.870334:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e675 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762733.870345:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e01df9a7/0xd08452c77c56e675 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762733.870487:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140617344:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23492us (196009us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789762733.870508:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:3.0:1789762733.870522:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138319849751 time 138320115041 state 0x2 ref 0 00000100:00100000:0.0:1789762733.874951:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762733.875013:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140617472 00000100:00100000:3.0:1789762733.875028:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140617472 00000100:00100000:3.0:1789762733.875082:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138319849751 time 138320115041 state 0x0 ref 1 00000100:00100000:3.0:1789762733.875099:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138520115041 time 138320115041 state 0x1 ref 1 00000100:00100000:2.0:1789762734.047089:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138520115041 time 138520239377 state 0x0 ref 1 00000100:00100000:2.0:1789762734.047149:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140617472:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:0.0:1789762734.047183:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789762734.047219:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 95420416, mtime: 0x6aad9cad, atime: 0x6aad9c9b, ctime: 0x6aad9cad, blocks: 0x2d80b 00010000:00010000:2.0:1789762734.047233:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e67c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762734.047256:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=138s v=(0 0) 00010000:00010000:2.0:1789762734.047282:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762734.047292:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e67c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762734.047367:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e67c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762734.064559:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967418 is committed 00002000:00010000:0.0:1789762734.064560:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 95420416 -> 96468992 00002000:00010000:0.0:1789762734.064567:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 186379 -> 188427 00010000:00010000:0.0:1789762734.064580:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e67c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762734.064591:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e67c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762734.064609:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e67c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762734.064614:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762734.064617:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e67c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762734.064624:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e67c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762734.064640:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e67c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762734.064645:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d12a07f9/0xd08452c77c56e67c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762734.064717:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140617472:12345-192.168.203.31@tcp:4:dd.500 Request processed in 17604us (189769us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789762734.064725:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:0.0:1789762734.064732:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138520115041 time 138520239377 state 0x2 ref 0 00000100:00100000:3.0:1789762734.067544:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762734.067598:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140617600 00000100:00100000:1.0:1789762734.067607:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140617600 00000100:00100000:1.0:1789762734.067663:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138520115041 time 138520239377 state 0x0 ref 1 00000100:00100000:1.0:1789762734.067676:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138720239377 time 138520239377 state 0x1 ref 1 00010000:00010000:3.0:1789762734.119044:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762734.247169:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138720239377 time 138720325160 state 0x0 ref 1 00000100:00100000:3.0:1789762734.247194:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140617600:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762734.247251:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 96468992, mtime: 0x6aad9cad, atime: 0x6aad9c9b, ctime: 0x6aad9cad, blocks: 0x2e00b 00010000:00010000:3.0:1789762734.247263:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e683 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.247291:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=138s v=(0 0) 00010000:00010000:3.0:1789762734.247296:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762734.247303:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.247319:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762734.260774:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967419 is committed 00002000:00010000:3.0:1789762734.260807:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:3.0:1789762734.260813:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 188427 -> 190475 00010000:00010000:3.0:1789762734.260825:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.260855:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e683 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.260876:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e683 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.260883:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762734.260888:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e683 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.260895:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e683 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.260929:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e683 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.260936:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e683 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762734.261013:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140617600:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13825us (193468us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789762734.261023:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:3.0:1789762734.261030:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138720239377 time 138720325160 state 0x2 ref 0 00000100:00100000:2.0:1789762734.263814:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762734.263883:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140617728 00000100:00100000:1.0:1789762734.263894:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140617728 00000100:00100000:1.0:1789762734.263946:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138720239377 time 138720325160 state 0x0 ref 1 00000100:00100000:1.0:1789762734.263957:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138920325160 time 138720325160 state 0x1 ref 1 00000100:00100000:1.0:1789762734.447246:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138920325160 time 138920400521 state 0x0 ref 1 00000100:00100000:1.0:1789762734.447279:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140617728:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762734.447342:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 97517568, mtime: 0x6aad9cad, atime: 0x6aad9c9b, ctime: 0x6aad9cad, blocks: 0x2e80b 00010000:00010000:1.0:1789762734.447353:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e68a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762734.447374:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=138s v=(0 0) 00010000:00010000:1.0:1789762734.447380:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762734.447389:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e68a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762734.447424:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e68a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762734.467529:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967420 is committed 00002000:00010000:3.0:1789762734.467552:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 97517568 -> 98566144 00002000:00010000:3.0:1789762734.467558:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 190475 -> 192523 00010000:00010000:3.0:1789762734.467572:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e68a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.467595:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e68a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.467602:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e68a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.467607:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762734.467611:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e68a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.467619:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e68a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.467636:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e68a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.467641:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e68a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762734.467719:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140617728:12345-192.168.203.31@tcp:4:dd.500 Request processed in 20453us (203904us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789762734.467729:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:3.0:1789762734.467735:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138920325160 time 138920400521 state 0x2 ref 0 00000100:00100000:2.0:1789762734.470932:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762734.470966:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140617856 00000100:00100000:3.0:1789762734.470982:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140617856 00000100:00100000:3.0:1789762734.471020:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 138920325160 time 138920400521 state 0x0 ref 1 00000100:00100000:3.0:1789762734.471029:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139120400521 time 138920400521 state 0x1 ref 1 00000100:00100000:1.0:1789762734.647405:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139120400521 time 139120555071 state 0x0 ref 1 00000100:00100000:1.0:1789762734.647449:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140617856:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762734.647531:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 98566144, mtime: 0x6aad9cad, atime: 0x6aad9c9b, ctime: 0x6aad9cad, blocks: 0x2f00b 00010000:00010000:1.0:1789762734.647540:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e691 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762734.647575:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=139s v=(0 0) 00010000:00010000:1.0:1789762734.647581:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762734.647589:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e691 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762734.647611:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e691 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762734.668325:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967421 is committed 00002000:00010000:3.0:1789762734.668375:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:3.0:1789762734.668382:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 192523 -> 194571 00010000:00010000:3.0:1789762734.668397:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e691 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.668411:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e691 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.668422:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e691 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.668432:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cd200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762734.668438:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e691 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.668450:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e691 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.668472:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e691 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.668482:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa217a09/0xd08452c77c56e691 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762734.668632:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140617856:12345-192.168.203.31@tcp:4:dd.500 Request processed in 21198us (197722us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789762734.668649:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:3.0:1789762734.668674:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139120400521 time 139120555071 state 0x2 ref 0 00000100:00100000:3.0:1789762734.671977:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762734.672081:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140617984 00000100:00100000:0.0:1789762734.672096:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140617984 00000100:00100000:0.0:1789762734.672166:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139120400521 time 139120555071 state 0x0 ref 1 00000100:00100000:0.0:1789762734.672183:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139320555071 time 139120555071 state 0x1 ref 1 00000100:00100000:3.0:1789762734.847625:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139320555071 time 139320774238 state 0x0 ref 1 00000100:00100000:3.0:1789762734.847668:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140617984:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762734.847742:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 99614720, mtime: 0x6aad9cad, atime: 0x6aad9c9b, ctime: 0x6aad9cad, blocks: 0x2f80b 00010000:00010000:3.0:1789762734.847754:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e698 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.847776:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=139s v=(0 0) 00010000:00010000:3.0:1789762734.847782:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762734.847791:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e698 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.847809:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e698 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762734.869132:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967422 is committed 00002000:00010000:3.0:1789762734.869171:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:3.0:1789762734.869179:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762733 -> 1789762734 00002000:00010000:3.0:1789762734.869183:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762733 -> 1789762734 00002000:00010000:3.0:1789762734.869186:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 194571 -> 196619 00010000:00010000:3.0:1789762734.869213:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e698 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.869228:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e698 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.869238:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e698 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.869246:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762734.869251:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e698 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.869261:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e698 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.869282:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e698 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762734.869290:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e698 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762734.869400:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140617984:12345-192.168.203.31@tcp:4:dd.500 Request processed in 21748us (197422us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789762734.869412:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:3.0:1789762734.869422:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139320555071 time 139320774238 state 0x2 ref 0 00000100:00100000:2.0:1789762734.872823:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762734.872919:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140618112 00000100:00100000:0.0:1789762734.872930:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140618112 00000100:00100000:0.0:1789762734.872975:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139320555071 time 139320774238 state 0x0 ref 1 00000100:00100000:0.0:1789762734.872988:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139520774238 time 139320774238 state 0x1 ref 1 00000100:00100000:0.0:1789762735.047742:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139520774238 time 139520893538 state 0x0 ref 1 00000100:00100000:0.0:1789762735.047782:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140618112:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762735.047933:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 100663296, mtime: 0x6aad9cae, atime: 0x6aad9c9b, ctime: 0x6aad9cae, blocks: 0x3000b 00010000:00010000:0.0:1789762735.047948:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e69f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.047969:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=139s v=(0 0) 00010000:00010000:0.0:1789762735.047976:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762735.047984:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e69f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.048002:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e69f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762735.071459:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967423 is committed 00002000:00010000:3.0:1789762735.071505:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:3.0:1789762735.071513:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 196619 -> 198667 00010000:00010000:3.0:1789762735.071549:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e69f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.071567:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e69f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.071579:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e69f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.071589:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762735.071595:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e69f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.071607:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e69f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.071632:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e69f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.071642:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e69f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762735.071768:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140618112:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23998us (198942us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789762735.071796:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:3.0:1789762735.071806:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139520774238 time 139520893538 state 0x2 ref 0 00000100:00100000:2.0:1789762735.075478:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762735.075555:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140618240 00000100:00100000:3.0:1789762735.075570:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140618240 00000100:00100000:3.0:1789762735.075625:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139520774238 time 139520893538 state 0x0 ref 1 00000100:00100000:3.0:1789762735.075642:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139720893538 time 139520893538 state 0x1 ref 1 00010000:00010000:0.0:1789762735.143051:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762735.247944:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139720893538 time 139721096041 state 0x0 ref 1 00000100:00100000:0.0:1789762735.248005:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140618240:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762735.248078:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 101711872, mtime: 0x6aad9cae, atime: 0x6aad9c9b, ctime: 0x6aad9cae, blocks: 0x3080b 00010000:00010000:0.0:1789762735.248090:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.248113:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=139s v=(0 0) 00010000:00010000:0.0:1789762735.248119:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762735.248127:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.248145:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762735.271580:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 101711872 -> 102760448 00000001:00080000:1.0:1789762735.271585:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967424 is committed 00002000:00010000:0.0:1789762735.271592:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 198667 -> 200715 00010000:00010000:0.0:1789762735.271632:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.271652:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.271664:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.271674:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762735.271680:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.271707:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.271733:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.271743:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762735.271948:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140618240:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23948us (196466us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1789762735.271964:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:0.0:1789762735.271975:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139720893538 time 139721096041 state 0x2 ref 0 00000100:00100000:3.0:1789762735.276204:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762735.276304:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140618368 00000100:00100000:1.0:1789762735.276319:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140618368 00000100:00100000:1.0:1789762735.276375:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139720893538 time 139721096041 state 0x0 ref 1 00000100:00100000:1.0:1789762735.276392:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139921096041 time 139721096041 state 0x1 ref 1 00000100:00100000:3.0:1789762735.448142:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139921096041 time 139921290176 state 0x0 ref 1 00000100:00100000:3.0:1789762735.448193:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140618368:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762735.448277:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 102760448, mtime: 0x6aad9cae, atime: 0x6aad9c9b, ctime: 0x6aad9cae, blocks: 0x3100b 00010000:00010000:3.0:1789762735.448294:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e6ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.448324:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=139s v=(0 0) 00010000:00010000:3.0:1789762735.448333:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762735.448346:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e6ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.448374:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e6ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762735.472618:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967425 is committed 00002000:00010000:3.0:1789762735.472678:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:3.0:1789762735.472690:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 200715 -> 202763 00010000:00010000:3.0:1789762735.472724:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e6ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.472747:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e6ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.472759:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e6ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.472769:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762735.472775:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e6ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.472786:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e6ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.472810:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e6ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.472820:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c56e6ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762735.473005:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140618368:12345-192.168.203.31@tcp:4:dd.500 Request processed in 24828us (196799us total) trans 4294967425 rc 0/0 00000100:00100000:3.0:1789762735.473021:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:3.0:1789762735.473033:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139921096041 time 139921290176 state 0x2 ref 0 00000100:00100000:3.0:1789762735.476799:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762735.476931:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140618496 00000100:00100000:1.0:1789762735.476946:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140618496 00000100:00100000:1.0:1789762735.477008:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 139921096041 time 139921290176 state 0x0 ref 1 00000100:00100000:1.0:1789762735.477029:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140121290176 time 139921290176 state 0x1 ref 1 00000100:00100000:1.0:1789762735.648265:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140121290176 time 140121412065 state 0x0 ref 1 00000100:00100000:1.0:1789762735.648317:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140618496:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762735.648392:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 103809024, mtime: 0x6aad9cae, atime: 0x6aad9c9b, ctime: 0x6aad9cae, blocks: 0x3180b 00010000:00010000:1.0:1789762735.648405:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762735.648425:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=140s v=(0 0) 00010000:00010000:1.0:1789762735.648431:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762735.648439:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762735.648458:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762735.673233:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:1.0:1789762735.673249:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 202763 -> 204811 00000001:00080000:3.0:1789762735.673250:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967426 is committed 00010000:00010000:1.0:1789762735.673283:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762735.673340:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762735.673360:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762735.673377:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762735.673406:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762735.673426:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762735.673457:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762735.673470:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762735.673612:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140618496:12345-192.168.203.31@tcp:4:dd.500 Request processed in 25310us (196806us total) trans 4294967426 rc 0/0 00000100:00100000:1.0:1789762735.673634:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:1.0:1789762735.673648:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140121290176 time 140121412065 state 0x2 ref 0 00000100:00100000:1.0:1789762735.676723:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762735.676823:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140618752 00000100:00100000:2.0:1789762735.676863:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140618752 00000100:00080000:0.0:1789762735.676955:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762735.676979:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:2.0:1789762735.677001:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+8:10498:x1876702140618752:12345-192.168.203.31@tcp:35:dd.500 00000001:00080000:2.0:1789762735.677356:0:8160:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967351 00000100:00100000:2.0:1789762735.677506:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+10:10498:x1876702140618752:12345-192.168.203.31@tcp:35:dd.500 Request processed in 508us (781us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789762735.677522:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000020:00080000:2.0:1789762735.677562:0:8160:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789762735.766118:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762735.766237:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140619008 00000100:00100000:0.0:1789762735.766255:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140619008 00000100:00100000:0.0:1789762735.766344:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:0.0:1789762735.766360:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+10:10517:x1876702140619008:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762735.766404:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762735.766444:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56e6bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.766544:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e6c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.766586:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.766602:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.766702:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e6c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.766714:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.766723:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767588:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e6d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767601:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767611:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762735.767623:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 104857600 00010000:00010000:0.0:1789762735.767791:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767804:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e6c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767811:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e6c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767826:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762735.767832:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e6c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767839:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e6c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767853:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:0.0:1789762735.767856:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762735.767861:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e6c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767912:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5200/0xd08452c77c56e6c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767928:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767935:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e6c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767941:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767946:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762735.767950:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767956:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767977:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff95d151e90a00) 00010000:00010000:0.0:1789762735.767980:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762735.767983:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e6c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.767990:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4000/0xd08452c77c56e6c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.768036:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4a00/0xd08452c77c56e6bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f8 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.768049:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f8 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.768057:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:0.0:1789762735.768059:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762735.768062:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f5800, rc 0) 00000100:00100000:0.0:1789762735.768128:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+12:10517:x1876702140619008:12345-192.168.203.31@tcp:101:dd.500 Request processed in 1772us (2040us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789762735.768136:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:3.0:1789762735.770719:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762735.770782:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140619136 00000100:00100000:0.0:1789762735.770789:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140619136 00000100:00100000:0.0:1789762735.770863:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1789762735.770874:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140619136:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762735.770886:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762735.770921:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e6de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e5ff expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762735.770983:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 104857600, mtime: 0x6aad9cae, atime: 0x6aad9c9b, ctime: 0x6aad9cae, blocks: 0x3200b 00010000:00010000:0.0:1789762735.771001:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=140s v=(0 0) 00010000:00010000:0.0:1789762735.771007:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762735.771018:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e6de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5ff expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.771034:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e6de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5ff expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762735.771047:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747f5e00, rc 0) 00000100:00100000:0.0:1789762735.771093:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140619136:12345-192.168.203.31@tcp:101:dd.500 Request processed in 221us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762735.771102:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:1.0:1789762735.775293:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762735.775377:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140619264 00000100:00100000:3.0:1789762735.775387:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140619264 00000100:00100000:3.0:1789762735.775452:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140121290176 time 140121412065 state 0x0 ref 1 00000100:00100000:3.0:1789762735.775469:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140321412065 time 140121412065 state 0x1 ref 1 00000100:00100000:1.0:1789762735.848338:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140321412065 time 140321494240 state 0x0 ref 1 00000100:00100000:1.0:1789762735.848367:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140619264:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762735.848416:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6e5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762735.848437:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762735.848441:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762735.848447:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6e5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762735.848460:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6e5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.852647:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6e5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.852659:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.852668:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.852674:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762735.852678:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.852685:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.852699:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762735.852705:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c56e6e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762735.852769:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140619264:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4414us (77480us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762735.852777:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:3.0:1789762735.852784:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140321412065 time 140321494240 state 0x2 ref 0 00000100:00100000:3.0:1789762735.854993:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762735.855054:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140619392 00000100:00100000:0.0:1789762735.855065:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140619392 00000100:00100000:0.0:1789762735.855108:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140321412065 time 140321494240 state 0x0 ref 1 00000100:00100000:0.0:1789762735.855123:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140521494240 time 140321494240 state 0x1 ref 1 00000100:00100000:3.0:1789762736.048468:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140521494240 time 140521621455 state 0x0 ref 1 00000100:00100000:3.0:1789762736.048517:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140619392:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:0.0:1789762736.048536:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762736.048556:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6ec lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762736.048571:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762736.048574:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762736.048579:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6ec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762736.048590:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6ec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762736.051695:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6ec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762736.051704:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762736.051721:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762736.051726:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762736.051730:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762736.051737:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762736.051750:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762736.051756:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762736.051803:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140619392:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3317us (196810us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762736.051809:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:3.0:1789762736.051815:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140521494240 time 140521621455 state 0x2 ref 0 00000100:00100000:3.0:1789762736.053723:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762736.053772:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140619520 00000100:00100000:1.0:1789762736.053780:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140619520 00000100:00100000:1.0:1789762736.053813:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140521494240 time 140521621455 state 0x0 ref 1 00000100:00100000:1.0:1789762736.053823:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140721621455 time 140521621455 state 0x1 ref 1 00010000:00010000:2.0:1789762736.166964:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762736.248579:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140721621455 time 140721731929 state 0x0 ref 1 00000100:00100000:0.0:1789762736.248646:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140619520:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762736.248708:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6f3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762736.248757:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762736.248779:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762736.248784:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762736.248795:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762736.252902:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762736.252939:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762736.252952:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762736.252962:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762736.252968:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762736.252980:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762736.253001:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762736.253031:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e6f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762736.253120:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140619520:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4518us (199393us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762736.253133:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:0.0:1789762736.253143:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140721621455 time 140721731929 state 0x2 ref 0 00000100:00100000:3.0:1789762736.255827:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762736.255877:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140619648 00000100:00100000:1.0:1789762736.255885:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140619648 00000100:00100000:1.0:1789762736.255957:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140721621455 time 140721731929 state 0x0 ref 1 00000100:00100000:1.0:1789762736.255974:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140921731929 time 140721731929 state 0x1 ref 1 00000100:00100000:3.0:1789762736.448810:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140921731929 time 140921961915 state 0x0 ref 1 00000100:00100000:3.0:1789762736.448883:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140619648:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762736.449003:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6fa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762736.449035:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762736.449041:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762736.449049:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762736.449070:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.454179:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.454233:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.454252:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.454267:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762736.454275:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.454296:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.454328:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.454345:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56e6fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762736.454459:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140619648:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5620us (198625us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762736.454478:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:1.0:1789762736.454490:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140921731929 time 140921961915 state 0x2 ref 0 00000100:00100000:2.0:1789762736.457806:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762736.457953:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140619776 00000100:00100000:1.0:1789762736.457969:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140619776 00000100:00100000:1.0:1789762736.458036:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 140921731929 time 140921961915 state 0x0 ref 1 00000100:00100000:1.0:1789762736.458051:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141121961915 time 140921961915 state 0x1 ref 1 00000100:00100000:1.0:1789762736.648970:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141121961915 time 141122117822 state 0x0 ref 1 00000100:00100000:1.0:1789762736.649024:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140619776:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762736.649091:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f29cb2fb/0xd08452c77c56e701 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.649115:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762736.649122:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762736.649130:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f29cb2fb/0xd08452c77c56e701 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.649151:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f29cb2fb/0xd08452c77c56e701 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762736.654308:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f29cb2fb/0xd08452c77c56e701 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762736.654329:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f29cb2fb/0xd08452c77c56e701 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762736.654341:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f29cb2fb/0xd08452c77c56e701 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762736.654367:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14af70a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762736.654374:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f29cb2fb/0xd08452c77c56e701 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762736.654386:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f29cb2fb/0xd08452c77c56e701 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762736.654407:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f29cb2fb/0xd08452c77c56e701 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762736.654418:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f29cb2fb/0xd08452c77c56e701 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762736.654526:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140619776:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5525us (196720us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762736.654540:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:2.0:1789762736.654550:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141121961915 time 141122117822 state 0x2 ref 0 00000100:00100000:2.0:1789762736.657873:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762736.657959:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140619904 00000100:00100000:3.0:1789762736.657971:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140619904 00000100:00100000:3.0:1789762736.658020:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141121961915 time 141122117822 state 0x0 ref 1 00000100:00100000:3.0:1789762736.658034:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141322117822 time 141122117822 state 0x1 ref 1 00000100:00100000:1.0:1789762736.807113:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789762736.807114:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148996224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762736.807161:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148996736:0@lo:400:kworker.0 00000100:00100000:3.0:1789762736.807235:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702148996480:0@lo:400:kworker.0 00000100:00100000:1.0:1789762736.807254:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762736.807283:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762736.807317:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762736.807363:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702148996608:0@lo:400:kworker.0 00000100:00100000:2.0:1789762736.807369:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148996352:0@lo:400:kworker.0 00000100:00100000:3.0:1789762736.807373:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d15225b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148996992:0@lo:400:kworker.0 00000100:00100000:3.0:1789762736.807451:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762736.807475:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762736.807487:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762736.807502:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789762736.807520:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d15225aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702148996864:0@lo:400:kworker.0 00000100:00100000:1.0:1789762736.807588:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148996736 00000100:00100000:1.0:1789762736.807600:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148996736 00000100:00100000:3.0:1789762736.807628:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762736.807714:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148996992 00000100:00100000:1.0:1789762736.807722:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148996992 00000100:00100000:1.0:1789762736.807799:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789762736.807816:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148996736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762736.807821:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789762736.807841:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148996992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762736.807945:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148996224 00000100:00100000:3.0:1789762736.807954:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148996224 00000100:00100000:1.0:1789762736.807989:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148996736:12345-0@lo:400:kworker.0 Request processed in 177us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762736.808010:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789762736.808011:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789762736.808012:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702148996992:12345-0@lo:400:kworker.0 Request processed in 171us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762736.808028:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789762736.808029:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702148996224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762736.808049:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148996352 00000100:00100000:1.0:1789762736.808054:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148996352 00002000:00000024:3.0:1789762736.808083:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762736.808085:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148996480 00000100:00100000:2.0:1789762736.808095:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148996480 00000100:00100000:1.0:1789762736.808102:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789762736.808118:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702148996352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762736.808176:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148996608 00000100:00100000:2.0:1789762736.808183:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148996608 00000100:00100000:3.0:1789762736.808195:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148996224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762736.808196:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702148996352:12345-0@lo:400:kworker.0 Request processed in 83us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762736.808215:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789762736.808215:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789762736.808238:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148996864 00000100:00100000:2.0:1789762736.808245:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148996864 00000100:00100000:2.0:1789762736.808311:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789762736.808329:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148996736:0@lo:400:kworker.0 00000100:00100000:2.0:1789762736.808335:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148996480:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762736.808405:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762736.808417:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762736.808420:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148996480:12345-0@lo:400:kworker.0 Request processed in 96us (1106us total) trans 0 rc 0/0 00000100:00080000:1.0:1789762736.808425:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762736.808440:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789762736.808561:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702148996480:0@lo:400:kworker.0 00000100:00100000:0.0:1789762736.808569:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789762736.808588:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789762736.808592:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d15225b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148996992:0@lo:400:kworker.0 00000100:00100000:2.0:1789762736.808612:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702148996864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762736.808691:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702148996864:12345-0@lo:400:kworker.0 Request processed in 88us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762736.808703:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789762736.808728:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d15225aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702148996864:0@lo:400:kworker.0 00000100:00100000:2.0:1789762736.808817:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148996224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762736.808832:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148996352:0@lo:400:kworker.0 00000100:00100000:1.0:1789762736.809025:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702148996608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762736.809100:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702148996608:12345-0@lo:400:kworker.0 Request processed in 512us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762736.809113:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789762736.809129:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702148996608:0@lo:400:kworker.0 00000001:00080000:1.0:1789762736.818693:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000100:00100000:1.0:1789762736.849073:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141322117822 time 141322230194 state 0x0 ref 1 00000100:00100000:1.0:1789762736.849098:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140619904:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762736.849135:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008cef35f2/0xd08452c77c56e708 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.849153:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762736.849168:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762736.849175:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cef35f2/0xd08452c77c56e708 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.849190:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cef35f2/0xd08452c77c56e708 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.853210:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008cef35f2/0xd08452c77c56e708 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.853249:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cef35f2/0xd08452c77c56e708 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.853269:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cef35f2/0xd08452c77c56e708 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.853280:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14af71c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762736.853287:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cef35f2/0xd08452c77c56e708 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.853300:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cef35f2/0xd08452c77c56e708 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.853323:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cef35f2/0xd08452c77c56e708 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762736.853332:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cef35f2/0xd08452c77c56e708 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762736.853433:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140619904:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4341us (195600us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762736.853450:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:1.0:1789762736.853463:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141322117822 time 141322230194 state 0x2 ref 0 00000100:00100000:3.0:1789762736.856490:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762736.856554:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140620032 00000100:00100000:0.0:1789762736.856565:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140620032 00000100:00100000:0.0:1789762736.856604:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141322117822 time 141322230194 state 0x0 ref 1 00000100:00100000:0.0:1789762736.856617:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141522230194 time 141322230194 state 0x1 ref 1 00000100:00100000:2.0:1789762737.012957:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762737.013055:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140620160 00000100:00100000:1.0:1789762737.013071:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140620160 00000100:00100000:2.0:1789762737.013077:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762737.013157:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:1.0:1789762737.013177:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140620160:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762737.013262:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140620288 00000100:00100000:3.0:1789762737.013273:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140620288 00000100:00100000:1.0:1789762737.013283:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140620160:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 106us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762737.013300:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:3.0:1789762737.013366:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00080000:0.0:1789762737.013381:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762737.013383:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140620288:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762737.013481:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140620288:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 102us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762737.013495:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:2.0:1789762737.020270:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762737.020310:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762737.020365:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140620416 00000100:00100000:0.0:1789762737.020378:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140620416 00000100:00100000:3.0:1789762737.020383:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140620544 00000100:00100000:3.0:1789762737.020397:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140620544 00000100:00100000:0.0:1789762737.020472:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00080000:1.0:1789762737.020474:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762737.020483:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00080000:1.0:1789762737.020488:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762737.020502:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2341:x1876702140620416:12345-192.168.203.31@tcp:9:kworker.0 00000100:00100000:3.0:1789762737.020507:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140620544:12345-192.168.203.31@tcp:400:kworker.0 00000020:00000080:0.0:1789762737.020546:0:6654:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd08452c77c56e0be 00000100:00080000:0.0:1789762737.020562:0:6654:0:(import.c:65:import_set_state_nolock()) ffff95d15886a800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789762737.020584:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140620544:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 86us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762737.020595:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000001:00000004:0.0:1789762737.020616:0:6654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967321 00010000:00010000:1.0:1789762737.020623:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762737.020970:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+2:2341:x1876702140620416:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 478us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762737.021000:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:3.0:1789762737.049224:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141522230194 time 141522378698 state 0x0 ref 1 00000100:00100000:3.0:1789762737.049271:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140620032:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762737.049316:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e70f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.049338:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762737.049344:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762737.049352:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e70f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.049370:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e70f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.053816:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e70f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.053864:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e70f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.053877:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e70f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.053917:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747c8e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762737.053924:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e70f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.053937:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e70f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.053973:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e70f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.053984:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e70f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762737.054067:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140620032:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4799us (197573us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762737.054085:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:3.0:1789762737.054096:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141522230194 time 141522378698 state 0x2 ref 0 00000100:00100000:1.0:1789762737.057537:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762737.057605:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140620672 00000100:00100000:3.0:1789762737.057618:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140620672 00000100:00100000:3.0:1789762737.057665:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141522230194 time 141522378698 state 0x0 ref 1 00000100:00100000:3.0:1789762737.057680:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141722378698 time 141522378698 state 0x1 ref 1 00010000:00010000:3.0:1789762737.191091:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762737.249423:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141722378698 time 141722573162 state 0x0 ref 1 00000100:00100000:0.0:1789762737.249484:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140620672:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762737.249538:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e716 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762737.249559:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762737.249567:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762737.249577:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e716 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762737.249601:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e716 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762737.254498:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e716 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762737.254519:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e716 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762737.254532:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e716 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762737.254542:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762737.254547:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e716 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762737.254578:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e716 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762737.254610:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e716 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762737.254627:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e716 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762737.254718:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140620672:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5265us (197182us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762737.254731:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:0.0:1789762737.254741:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141722378698 time 141722573162 state 0x2 ref 0 00000100:00100000:2.0:1789762737.258385:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762737.258494:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140620800 00000100:00100000:1.0:1789762737.258508:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140620800 00000100:00100000:1.0:1789762737.258556:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141722378698 time 141722573162 state 0x0 ref 1 00000100:00100000:1.0:1789762737.258571:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141922573162 time 141722573162 state 0x1 ref 1 00000100:00100000:1.0:1789762737.319151:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789762737.319183:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148997120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762737.319271:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762737.319359:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148997120 00000100:00100000:2.0:1789762737.319376:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148997120 00000100:00100000:2.0:1789762737.319450:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789762737.319465:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148997120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762737.319511:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00100000:2.0:1789762737.319607:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702148997120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762737.319617:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789762737.319721:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702148997120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762737.449584:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141922573162 time 141922733688 state 0x0 ref 1 00000100:00100000:3.0:1789762737.449627:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140620800:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762737.449683:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e71d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.449707:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762737.449713:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762737.449721:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e71d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.449782:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e71d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.454797:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e71d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.455021:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e71d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.455039:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e71d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.455052:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747c8e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762737.455060:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e71d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.455078:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e71d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.455108:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e71d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762737.455124:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a21f0b3/0xd08452c77c56e71d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762737.455220:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140620800:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5610us (196838us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762737.455245:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:3.0:1789762737.455254:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141922573162 time 141922733688 state 0x2 ref 0 00000100:00100000:2.0:1789762737.458734:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762737.458817:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140620928 00000100:00100000:1.0:1789762737.458905:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140620928 00000100:00100000:1.0:1789762737.458972:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 141922573162 time 141922733688 state 0x0 ref 1 00000100:00100000:1.0:1789762737.458989:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142122733688 time 141922733688 state 0x1 ref 1 00000100:00100000:1.0:1789762737.649707:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142122733688 time 142122857815 state 0x0 ref 1 00000100:00100000:1.0:1789762737.649749:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140620928:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762737.649805:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011896a08/0xd08452c77c56e724 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762737.649828:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762737.649869:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762737.649905:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011896a08/0xd08452c77c56e724 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762737.649930:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011896a08/0xd08452c77c56e724 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762737.654707:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011896a08/0xd08452c77c56e724 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762737.654730:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011896a08/0xd08452c77c56e724 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762737.654745:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011896a08/0xd08452c77c56e724 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762737.654756:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f94600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762737.654764:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011896a08/0xd08452c77c56e724 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762737.654777:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011896a08/0xd08452c77c56e724 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762737.654801:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011896a08/0xd08452c77c56e724 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762737.654872:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011896a08/0xd08452c77c56e724 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762737.654991:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140620928:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5259us (196258us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762737.655006:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:2.0:1789762737.655016:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142122733688 time 142122857815 state 0x2 ref 0 00000100:00100000:2.0:1789762737.658313:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762737.658388:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140621056 00000100:00100000:3.0:1789762737.658402:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140621056 00000100:00100000:3.0:1789762737.658455:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142122733688 time 142122857815 state 0x0 ref 1 00000100:00100000:3.0:1789762737.658471:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142322857815 time 142122857815 state 0x1 ref 1 00000001:00100000:1.0:1789762737.845531:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:1.0:1789762737.845543:0:7606:0:(genops.c:885:class_export_put()) final put ffff95d158869000/77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:3.0:1789762737.845587:0:2356:0:(genops.c:844:class_export_destroy()) destroying export ffff95d158869000/77777931-b235-4c03-82d2-4b1d12553008 for lustre-OST0001 00000020:00000080:3.0:1789762737.845672:0:2356:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d15886a800 for lustre-OST0001 00000100:00100000:1.0:1789762737.849861:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142322857815 time 142322997198 state 0x0 ref 1 00000100:00100000:1.0:1789762737.849935:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140621056:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762737.849977:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0cb3f18/0xd08452c77c56e72b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762737.850010:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762737.850015:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762737.850021:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0cb3f18/0xd08452c77c56e72b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762737.850036:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0cb3f18/0xd08452c77c56e72b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762737.853869:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0cb3f18/0xd08452c77c56e72b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762737.853907:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0cb3f18/0xd08452c77c56e72b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762737.853917:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0cb3f18/0xd08452c77c56e72b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762737.853924:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f94000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762737.853929:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0cb3f18/0xd08452c77c56e72b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762737.853938:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0cb3f18/0xd08452c77c56e72b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762737.853962:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0cb3f18/0xd08452c77c56e72b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762737.853994:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0cb3f18/0xd08452c77c56e72b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762737.854069:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140621056:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4165us (195759us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762737.854080:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:1.0:1789762737.854087:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142322857815 time 142322997198 state 0x2 ref 0 00000100:00100000:1.0:1789762737.856772:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762737.856922:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140621184 00000100:00100000:0.0:1789762737.856936:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140621184 00000100:00100000:0.0:1789762737.856988:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142322857815 time 142322997198 state 0x0 ref 1 00000100:00100000:0.0:1789762737.857004:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142522997198 time 142322997198 state 0x1 ref 1 00000100:00100000:3.0:1789762738.050036:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142522997198 time 142523188407 state 0x0 ref 1 00000100:00100000:3.0:1789762738.050087:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140621184:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762738.050137:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005d28bf87/0xd08452c77c56e732 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789762738.050148:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762738.050161:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762738.050171:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762738.050182:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d28bf87/0xd08452c77c56e732 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.050205:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d28bf87/0xd08452c77c56e732 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.054338:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005d28bf87/0xd08452c77c56e732 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.054366:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d28bf87/0xd08452c77c56e732 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.054376:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d28bf87/0xd08452c77c56e732 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.054383:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d170214e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762738.054388:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d28bf87/0xd08452c77c56e732 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.054397:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d28bf87/0xd08452c77c56e732 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.054413:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d28bf87/0xd08452c77c56e732 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.054419:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d28bf87/0xd08452c77c56e732 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762738.054491:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140621184:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4432us (197718us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762738.054510:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:3.0:1789762738.054519:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142522997198 time 142523188407 state 0x2 ref 0 00000100:00100000:3.0:1789762738.057605:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762738.057695:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140621312 00000100:00100000:1.0:1789762738.057703:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140621312 00000100:00100000:1.0:1789762738.057736:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142522997198 time 142523188407 state 0x0 ref 1 00000100:00100000:1.0:1789762738.057746:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142723188407 time 142523188407 state 0x1 ref 1 00010000:00010000:0.0:1789762738.215014:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762738.250143:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142723188407 time 142723300621 state 0x0 ref 1 00000100:00100000:0.0:1789762738.250172:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140621312:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762738.250212:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e739 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762738.250247:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762738.250252:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762738.250257:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e739 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762738.250270:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e739 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762738.253496:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e739 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762738.253511:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e739 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762738.253520:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e739 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762738.253527:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762738.253541:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e739 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762738.253553:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e739 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762738.253569:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e739 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762738.253589:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e739 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762738.253649:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140621312:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3488us (196044us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762738.253659:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:0.0:1789762738.253666:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142723188407 time 142723300621 state 0x2 ref 0 00000100:00100000:2.0:1789762738.255743:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762738.255856:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140621440 00000100:00100000:1.0:1789762738.255867:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140621440 00000100:00100000:1.0:1789762738.255922:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142723188407 time 142723300621 state 0x0 ref 1 00000100:00100000:1.0:1789762738.255933:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142923300621 time 142723300621 state 0x1 ref 1 00000100:00100000:1.0:1789762738.450304:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142923300621 time 142923457161 state 0x0 ref 1 00000100:00100000:1.0:1789762738.450341:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140621440:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762738.450389:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006d059706/0xd08452c77c56e740 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762738.450432:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762738.450437:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762738.450443:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d059706/0xd08452c77c56e740 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762738.450458:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d059706/0xd08452c77c56e740 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.454758:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006d059706/0xd08452c77c56e740 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.454776:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d059706/0xd08452c77c56e740 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.454788:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d059706/0xd08452c77c56e740 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.454797:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1741e0e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762738.454803:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d059706/0xd08452c77c56e740 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.454813:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d059706/0xd08452c77c56e740 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.454890:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d059706/0xd08452c77c56e740 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.454899:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d059706/0xd08452c77c56e740 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762738.454978:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140621440:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4652us (199233us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762738.454990:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:3.0:1789762738.455014:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142923300621 time 142923457161 state 0x2 ref 0 00000100:00100000:2.0:1789762738.458096:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762738.458148:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140621568 00000100:00100000:3.0:1789762738.458171:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140621568 00000100:00100000:3.0:1789762738.458211:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 142923300621 time 142923457161 state 0x0 ref 1 00000100:00100000:3.0:1789762738.458224:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143123457161 time 142923457161 state 0x1 ref 1 00000100:00100000:1.0:1789762738.650406:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143123457161 time 143123560380 state 0x0 ref 1 00000100:00100000:1.0:1789762738.650436:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140621568:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762738.650475:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d7cd3177/0xd08452c77c56e747 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762738.650489:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762738.650492:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762738.650499:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cd3177/0xd08452c77c56e747 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762738.650517:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7cd3177/0xd08452c77c56e747 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762738.653336:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d7cd3177/0xd08452c77c56e747 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762738.653352:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cd3177/0xd08452c77c56e747 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762738.653376:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7cd3177/0xd08452c77c56e747 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762738.653381:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1741e1800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762738.653386:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7cd3177/0xd08452c77c56e747 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762738.653396:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7cd3177/0xd08452c77c56e747 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762738.653415:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7cd3177/0xd08452c77c56e747 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762738.653425:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7cd3177/0xd08452c77c56e747 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762738.653478:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140621568:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3057us (195386us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762738.653486:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:1.0:1789762738.653492:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143123457161 time 143123560380 state 0x2 ref 0 00000100:00100000:1.0:1789762738.655291:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762738.655323:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140621696 00000100:00100000:3.0:1789762738.655331:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140621696 00000100:00100000:3.0:1789762738.655362:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143123457161 time 143123560380 state 0x0 ref 1 00000100:00100000:3.0:1789762738.655371:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143323560380 time 143123560380 state 0x1 ref 1 00000100:00100000:3.0:1789762738.850502:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143323560380 time 143323656425 state 0x0 ref 1 00000100:00100000:3.0:1789762738.850538:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140621696:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762738.850589:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e74e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.850608:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762738.850613:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762738.850620:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e74e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.850635:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e74e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.853414:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e74e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.853429:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e74e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.853447:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e74e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.853457:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d170215a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762738.853463:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e74e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.853474:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e74e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.853492:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e74e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762738.853502:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e74e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762738.853561:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140621696:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3038us (198268us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762738.853572:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:3.0:1789762738.853580:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143323560380 time 143323656425 state 0x2 ref 0 00000100:00100000:3.0:1789762738.855296:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762738.855355:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140621824 00000100:00100000:0.0:1789762738.855362:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140621824 00000100:00100000:0.0:1789762738.855393:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143323560380 time 143323656425 state 0x0 ref 1 00000100:00100000:0.0:1789762738.855401:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143523656425 time 143323656425 state 0x1 ref 1 00000100:00100000:3.0:1789762739.050606:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143523656425 time 143523760220 state 0x0 ref 1 00000100:00100000:3.0:1789762739.050637:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140621824:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762739.050698:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e755 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762739.050715:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762739.050720:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762739.050727:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e755 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762739.050742:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e755 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.053719:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e755 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.053734:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e755 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.053745:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e755 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.053753:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d170215a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762739.053758:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e755 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.053783:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e755 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.053801:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e755 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.053810:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009704e5ad/0xd08452c77c56e755 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762739.053920:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140621824:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3294us (198622us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762739.053932:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:0.0:1789762739.053939:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143523656425 time 143523760220 state 0x2 ref 0 00000100:00100000:3.0:1789762739.055614:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762739.055659:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140621952 00000100:00100000:1.0:1789762739.055666:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140621952 00000100:00100000:1.0:1789762739.055699:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143523656425 time 143523760220 state 0x0 ref 1 00000100:00100000:1.0:1789762739.055716:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143723760220 time 143523760220 state 0x1 ref 1 00010000:00010000:2.0:1789762739.238971:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762739.250703:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143723760220 time 143723863070 state 0x0 ref 1 00000100:00100000:0.0:1789762739.250727:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140621952:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762739.250763:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e75c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.250776:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762739.250779:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762739.250783:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e75c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.250793:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e75c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.253594:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e75c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.253605:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e75c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.253612:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e75c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.253618:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762739.253622:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e75c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.253629:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e75c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.253643:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e75c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762739.253648:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e75c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762739.253698:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140621952:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2978us (198084us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762739.253706:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:0.0:1789762739.253717:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143723760220 time 143723863070 state 0x2 ref 0 00000100:00100000:1.0:1789762739.255582:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762739.255637:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140622080 00000100:00100000:2.0:1789762739.255647:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140622080 00000100:00100000:2.0:1789762739.255685:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143723760220 time 143723863070 state 0x0 ref 1 00000100:00100000:2.0:1789762739.255693:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143923863070 time 143723863070 state 0x1 ref 1 00000100:00100000:1.0:1789762739.450789:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143923863070 time 143923946482 state 0x0 ref 1 00000100:00100000:1.0:1789762739.450817:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140622080:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762739.450899:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2e18c85/0xd08452c77c56e763 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762739.450913:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762739.450917:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762739.450922:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e18c85/0xd08452c77c56e763 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762739.450932:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2e18c85/0xd08452c77c56e763 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762739.453696:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2e18c85/0xd08452c77c56e763 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762739.453706:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e18c85/0xd08452c77c56e763 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762739.453714:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2e18c85/0xd08452c77c56e763 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762739.453719:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f94200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762739.453723:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e18c85/0xd08452c77c56e763 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762739.453729:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e18c85/0xd08452c77c56e763 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762739.453756:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2e18c85/0xd08452c77c56e763 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762739.453762:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2e18c85/0xd08452c77c56e763 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762739.453810:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140622080:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3005us (198229us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762739.453817:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:3.0:1789762739.453822:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143923863070 time 143923946482 state 0x2 ref 0 00000100:00100000:1.0:1789762739.455629:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762739.455661:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140622208 00000100:00100000:3.0:1789762739.455669:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140622208 00000100:00100000:3.0:1789762739.455698:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 143923863070 time 143923946482 state 0x0 ref 1 00000100:00100000:3.0:1789762739.455706:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144123946482 time 143923946482 state 0x1 ref 1 00000100:00100000:2.0:1789762739.650908:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144123946482 time 144124063982 state 0x0 ref 1 00000100:00100000:2.0:1789762739.650935:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140622208:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762739.650972:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e76a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762739.650986:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762739.650990:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762739.651004:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e76a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762739.651018:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e76a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762739.654121:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e76a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762739.654136:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e76a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762739.654146:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e76a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762739.654154:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17ac16600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762739.654159:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e76a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762739.654169:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e76a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762739.654187:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e76a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762739.654196:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e76a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762739.654265:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140622208:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3340us (198636us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762739.654275:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:2.0:1789762739.654281:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144123946482 time 144124063982 state 0x2 ref 0 00000100:00100000:1.0:1789762739.656093:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762739.656137:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140622336 00000100:00100000:0.0:1789762739.656146:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140622336 00000100:00100000:0.0:1789762739.656179:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144123946482 time 144124063982 state 0x0 ref 1 00000100:00100000:0.0:1789762739.656191:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144324063982 time 144124063982 state 0x1 ref 1 00000100:00100000:3.0:1789762739.851024:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144324063982 time 144324176189 state 0x0 ref 1 00000100:00100000:3.0:1789762739.851062:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140622336:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762739.851124:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000004e6922a/0xd08452c77c56e771 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762739.851142:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762739.851146:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762739.851152:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004e6922a/0xd08452c77c56e771 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762739.851204:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004e6922a/0xd08452c77c56e771 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762739.854525:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000004e6922a/0xd08452c77c56e771 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762739.854546:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004e6922a/0xd08452c77c56e771 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762739.854555:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004e6922a/0xd08452c77c56e771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762739.854576:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d150537600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762739.854587:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004e6922a/0xd08452c77c56e771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762739.854595:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004e6922a/0xd08452c77c56e771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762739.854610:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004e6922a/0xd08452c77c56e771 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762739.854618:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004e6922a/0xd08452c77c56e771 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762739.854690:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140622336:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3645us (198594us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762739.854701:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:1.0:1789762739.854708:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144324063982 time 144324176189 state 0x2 ref 0 00000100:00100000:1.0:1789762739.856653:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762739.856702:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140622464 00000100:00100000:0.0:1789762739.856712:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140622464 00000100:00100000:0.0:1789762739.856751:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144324063982 time 144324176189 state 0x0 ref 1 00000100:00100000:0.0:1789762739.856763:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144524176189 time 144324176189 state 0x1 ref 1 00000100:00100000:0.0:1789762740.051108:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144524176189 time 144524263535 state 0x0 ref 1 00000100:00100000:0.0:1789762740.051152:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140622464:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762740.051189:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e778 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.051203:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762740.051207:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762740.051212:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e778 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789762740.051217:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762740.051224:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e778 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.054006:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e778 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.054034:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e778 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.054042:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e778 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.054047:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762740.054051:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e778 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.054057:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e778 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.054071:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e778 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.054077:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e778 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762740.054128:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140622464:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3006us (197476us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762740.054135:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:0.0:1789762740.054141:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144524176189 time 144524263535 state 0x2 ref 0 00000100:00100000:3.0:1789762740.056431:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762740.056489:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140622592 00000100:00100000:1.0:1789762740.056500:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140622592 00000100:00100000:1.0:1789762740.056551:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144524176189 time 144524263535 state 0x0 ref 1 00000100:00100000:1.0:1789762740.056563:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144724263535 time 144524263535 state 0x1 ref 1 00000100:00100000:0.0:1789762740.251266:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144724263535 time 144724416829 state 0x0 ref 1 00000100:00100000:0.0:1789762740.251315:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140622592:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762740.251366:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e77f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.251383:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762740.251387:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762740.251393:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e77f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.251407:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e77f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.255374:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e77f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.255389:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e77f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.255397:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e77f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.255405:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762740.255409:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e77f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.255416:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e77f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.255444:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e77f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762740.255451:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e77f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762740.255511:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140622592:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4206us (199083us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762740.255519:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:0.0:1789762740.255526:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144724263535 time 144724416829 state 0x2 ref 0 00000100:00100000:3.0:1789762740.257458:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762740.257522:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140622720 00000100:00100000:2.0:1789762740.257535:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140622720 00000100:00100000:2.0:1789762740.257584:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144724263535 time 144724416829 state 0x0 ref 1 00000100:00100000:2.0:1789762740.257594:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144924416829 time 144724416829 state 0x1 ref 1 00010000:00010000:1.0:1789762740.262939:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762740.451411:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144924416829 time 144924561897 state 0x0 ref 1 00000100:00100000:1.0:1789762740.451452:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140622720:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762740.451504:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021b9302b/0xd08452c77c56e786 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.451522:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762740.451526:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762740.451532:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b9302b/0xd08452c77c56e786 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.451558:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b9302b/0xd08452c77c56e786 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.455084:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021b9302b/0xd08452c77c56e786 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.455097:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b9302b/0xd08452c77c56e786 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.455105:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b9302b/0xd08452c77c56e786 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.455112:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1744f7e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762740.455117:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b9302b/0xd08452c77c56e786 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.455141:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b9302b/0xd08452c77c56e786 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.455161:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b9302b/0xd08452c77c56e786 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.455176:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b9302b/0xd08452c77c56e786 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762740.455236:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140622720:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3804us (197778us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762740.455244:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:1.0:1789762740.455251:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144924416829 time 144924561897 state 0x2 ref 0 00000100:00100000:1.0:1789762740.457312:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762740.457352:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140622848 00000100:00100000:3.0:1789762740.457362:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140622848 00000100:00100000:3.0:1789762740.457414:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 144924416829 time 144924561897 state 0x0 ref 1 00000100:00100000:3.0:1789762740.457425:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145124561897 time 144924561897 state 0x1 ref 1 00000100:00100000:2.0:1789762740.651607:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145124561897 time 145124741740 state 0x0 ref 1 00000100:00100000:2.0:1789762740.651661:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140622848:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762740.651743:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e78d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762740.651768:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762740.651774:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762740.651794:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e78d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762740.651820:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e78d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762740.655354:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e78d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762740.655380:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e78d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762740.655388:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e78d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762740.655394:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17ac16600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762740.655398:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e78d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762740.655405:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e78d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762740.655421:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e78d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762740.655427:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063e45ba4/0xd08452c77c56e78d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762740.655494:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140622848:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3862us (198181us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762740.655503:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:2.0:1789762740.655510:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145124561897 time 145124741740 state 0x2 ref 0 00000100:00100000:3.0:1789762740.657671:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762740.657739:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140622976 00000100:00100000:0.0:1789762740.657750:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140622976 00000100:00100000:0.0:1789762740.657810:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145124561897 time 145124741740 state 0x0 ref 1 00000100:00100000:0.0:1789762740.657826:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145324741740 time 145124741740 state 0x1 ref 1 00000100:00100000:3.0:1789762740.851724:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145324741740 time 145324875632 state 0x0 ref 1 00000100:00100000:3.0:1789762740.851767:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140622976:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762740.851825:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000098e39d4c/0xd08452c77c56e794 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762740.851896:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762740.851913:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762740.851920:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098e39d4c/0xd08452c77c56e794 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762740.851934:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098e39d4c/0xd08452c77c56e794 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.855545:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000098e39d4c/0xd08452c77c56e794 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.855560:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098e39d4c/0xd08452c77c56e794 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.855568:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098e39d4c/0xd08452c77c56e794 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.855574:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747c9a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762740.855587:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098e39d4c/0xd08452c77c56e794 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.855595:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098e39d4c/0xd08452c77c56e794 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.855614:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098e39d4c/0xd08452c77c56e794 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762740.855619:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098e39d4c/0xd08452c77c56e794 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762740.855683:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140622976:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3936us (198011us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762740.855693:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:1.0:1789762740.855700:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145324741740 time 145324875632 state 0x2 ref 0 00000100:00100000:1.0:1789762740.858528:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762740.858576:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140623104 00000100:00100000:0.0:1789762740.858599:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140623104 00000100:00100000:0.0:1789762740.858652:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145324741740 time 145324875632 state 0x0 ref 1 00000100:00100000:0.0:1789762740.858666:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145524875632 time 145324875632 state 0x1 ref 1 00000100:00100000:0.0:1789762741.051798:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145524875632 time 145524949645 state 0x0 ref 1 00000100:00100000:0.0:1789762741.051884:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140623104:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762741.051946:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e79b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.051977:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762741.051981:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762741.051987:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e79b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.052001:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e79b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.055213:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e79b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.055228:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e79b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.055235:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e79b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.055241:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762741.055245:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e79b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.055253:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e79b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.055271:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e79b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.055297:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e79b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762741.055374:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140623104:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3554us (196855us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762741.055383:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:0.0:1789762741.055391:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145524875632 time 145524949645 state 0x2 ref 0 00000100:00100000:1.0:1789762741.057413:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762741.057456:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140623232 00000100:00100000:3.0:1789762741.057465:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140623232 00000100:00100000:3.0:1789762741.057509:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145524875632 time 145524949645 state 0x0 ref 1 00000100:00100000:3.0:1789762741.057519:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145724949645 time 145524949645 state 0x1 ref 1 00000100:00100000:0.0:1789762741.251937:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145724949645 time 145725087532 state 0x0 ref 1 00000100:00100000:0.0:1789762741.251973:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140623232:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762741.252025:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7a2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.252042:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762741.252047:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762741.252052:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.252067:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.255434:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.255461:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.255469:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.255475:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762741.255480:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.255492:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.255515:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762741.255525:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762741.255588:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140623232:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3633us (198183us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762741.255597:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:0.0:1789762741.255605:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145724949645 time 145725087532 state 0x2 ref 0 00000100:00100000:3.0:1789762741.257523:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762741.257576:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140623360 00000100:00100000:2.0:1789762741.257593:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140623360 00000100:00100000:2.0:1789762741.257633:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145724949645 time 145725087532 state 0x0 ref 1 00000100:00100000:2.0:1789762741.257644:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145925087532 time 145725087532 state 0x1 ref 1 00010000:00010000:3.0:1789762741.287018:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762741.452040:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145925087532 time 145925195965 state 0x0 ref 1 00000100:00100000:3.0:1789762741.452069:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140623360:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762741.452106:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d4ef20d3/0xd08452c77c56e7a9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.452121:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762741.452124:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762741.452129:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4ef20d3/0xd08452c77c56e7a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.452140:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4ef20d3/0xd08452c77c56e7a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.455033:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d4ef20d3/0xd08452c77c56e7a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.455042:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4ef20d3/0xd08452c77c56e7a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.455060:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4ef20d3/0xd08452c77c56e7a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.455066:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1744f7800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762741.455069:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4ef20d3/0xd08452c77c56e7a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.455075:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4ef20d3/0xd08452c77c56e7a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.455087:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4ef20d3/0xd08452c77c56e7a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.455092:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4ef20d3/0xd08452c77c56e7a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762741.455137:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140623360:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3082us (197623us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762741.455143:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:3.0:1789762741.455148:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145925087532 time 145925195965 state 0x2 ref 0 00000100:00100000:3.0:1789762741.457097:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762741.457172:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140623488 00000100:00100000:1.0:1789762741.457181:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140623488 00000100:00100000:1.0:1789762741.457212:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 145925087532 time 145925195965 state 0x0 ref 1 00000100:00100000:1.0:1789762741.457221:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146125195965 time 145925195965 state 0x1 ref 1 00000100:00100000:2.0:1789762741.652122:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146125195965 time 146125277830 state 0x0 ref 1 00000100:00100000:2.0:1789762741.652149:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140623488:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762741.652185:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb0d96af/0xd08452c77c56e7b0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762741.652199:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762741.652202:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762741.652207:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb0d96af/0xd08452c77c56e7b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762741.652219:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb0d96af/0xd08452c77c56e7b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762741.655052:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb0d96af/0xd08452c77c56e7b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762741.655062:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb0d96af/0xd08452c77c56e7b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762741.655070:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb0d96af/0xd08452c77c56e7b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762741.655089:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762741.655093:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb0d96af/0xd08452c77c56e7b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762741.655100:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb0d96af/0xd08452c77c56e7b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762741.655112:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb0d96af/0xd08452c77c56e7b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762741.655117:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb0d96af/0xd08452c77c56e7b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762741.655164:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140623488:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3027us (198067us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762741.655171:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:2.0:1789762741.655177:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146125195965 time 146125277830 state 0x2 ref 0 00000100:00100000:3.0:1789762741.657081:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762741.657153:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140623616 00000100:00100000:0.0:1789762741.657182:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140623616 00000100:00100000:0.0:1789762741.657238:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146125195965 time 146125277830 state 0x0 ref 1 00000100:00100000:0.0:1789762741.657250:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146325277830 time 146125277830 state 0x1 ref 1 00000100:00100000:1.0:1789762741.852244:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146325277830 time 146325397369 state 0x0 ref 1 00000100:00100000:1.0:1789762741.852280:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140623616:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762741.852355:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e7b7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762741.852375:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762741.852380:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762741.852387:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e7b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762741.852404:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e7b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.855424:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e7b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.855444:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e7b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.855451:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e7b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.855456:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762741.855459:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e7b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.855466:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e7b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.855479:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e7b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762741.855483:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e7b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762741.855531:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140623616:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3268us (198451us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762741.855538:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:3.0:1789762741.855543:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146325277830 time 146325397369 state 0x2 ref 0 00000100:00100000:3.0:1789762741.857506:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762741.857582:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140623744 00000100:00100000:0.0:1789762741.857596:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140623744 00000100:00100000:0.0:1789762741.857651:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146325277830 time 146325397369 state 0x0 ref 1 00000100:00100000:0.0:1789762741.857663:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146525397369 time 146325397369 state 0x1 ref 1 00000100:00100000:1.0:1789762741.927051:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789762741.927071:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789762741.927078:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d150caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148997248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762741.927086:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702148997504:0@lo:400:kworker.0 00000100:00100000:2.0:1789762741.927139:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702148997888:0@lo:400:kworker.0 00000100:00100000:3.0:1789762741.927157:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762741.927160:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762741.927194:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762741.927242:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702148997376:0@lo:400:kworker.0 00000100:00100000:2.0:1789762741.927264:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762741.927268:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702148997632:0@lo:400:kworker.0 00000100:00100000:2.0:1789762741.927284:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148998016:0@lo:400:kworker.0 00000100:00100000:3.0:1789762741.927286:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762741.927323:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762741.927335:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762741.927359:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148997504 00000100:00100000:3.0:1789762741.927366:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148997504 00000100:00100000:1.0:1789762741.927378:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789762741.927394:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148997888 00000100:00100000:1.0:1789762741.927395:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148997760:0@lo:400:kworker.0 00000100:00100000:2.0:1789762741.927399:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148997888 00000100:00100000:3.0:1789762741.927413:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148997632 00000100:00100000:3.0:1789762741.927418:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148997632 00000100:00100000:1.0:1789762741.927436:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762741.927484:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789762741.927492:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789762741.927494:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148997504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762741.927501:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789762741.927507:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702148997888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762741.927518:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702148997632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762741.927554:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148997376 00000100:00100000:0.0:1789762741.927566:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148997376 00000100:00100000:3.0:1789762741.927574:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148997504:12345-0@lo:400:kworker.0 Request processed in 78us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762741.927580:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702148997888:12345-0@lo:400:kworker.0 Request processed in 76us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762741.927591:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789762741.927592:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702148997632:12345-0@lo:400:kworker.0 Request processed in 75us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762741.927600:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789762741.927610:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789762741.927638:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148998016 00000100:00100000:2.0:1789762741.927644:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148998016 00000100:00100000:1.0:1789762741.927655:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148997760 00000100:00100000:1.0:1789762741.927663:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148997760 00000100:00100000:3.0:1789762741.927698:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702148997504:0@lo:400:kworker.0 00000100:00100000:0.0:1789762741.927741:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789762741.927741:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789762741.927764:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789762741.927791:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702148997376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762741.927792:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148998016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762741.927793:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148997760:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789762741.927795:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762741.927805:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762741.927817:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762741.927912:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702148997888:0@lo:400:kworker.0 00000100:00100000:1.0:1789762741.927959:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148997760:12345-0@lo:400:kworker.0 Request processed in 181us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762741.927960:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148997248 00000100:00100000:2.0:1789762741.927961:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148998016:12345-0@lo:400:kworker.0 Request processed in 197us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762741.927965:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148997248 00000100:00100000:0.0:1789762741.927991:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702148997376:12345-0@lo:400:kworker.0 Request processed in 216us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762741.927992:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789762741.928004:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789762741.928015:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789762741.928027:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148997248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762741.928028:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00002000:00000024:3.0:1789762741.928067:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762741.928068:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148998016:0@lo:400:kworker.0 00000100:00100000:1.0:1789762741.928090:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148997760:0@lo:400:kworker.0 00000100:00100000:0.0:1789762741.928121:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702148997376:0@lo:400:kworker.0 00000100:00100000:3.0:1789762741.928123:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148997248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762741.928127:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702148997632:0@lo:400:kworker.0 00000100:00100000:3.0:1789762741.928142:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789762741.928173:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d150caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148997248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762742.052312:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146525397369 time 146525468797 state 0x0 ref 1 00000100:00100000:0.0:1789762742.052350:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140623744:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:3.0:1789762742.052374:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762742.052387:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7be lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.052403:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762742.052408:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762742.052414:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.052444:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.055419:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.055430:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.055437:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.055443:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762742.055447:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.055453:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.055467:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.055472:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762742.055532:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140623744:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3205us (198025us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762742.055539:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:0.0:1789762742.055544:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146525397369 time 146525468797 state 0x2 ref 0 00000100:00100000:1.0:1789762742.057499:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762742.057545:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140623872 00000100:00100000:3.0:1789762742.057554:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140623872 00000100:00100000:3.0:1789762742.057590:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146525397369 time 146525468797 state 0x0 ref 1 00000100:00100000:3.0:1789762742.057601:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146725468797 time 146525468797 state 0x1 ref 1 00000100:00100000:3.0:1789762742.132299:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762742.132348:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762742.132354:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140624128 00000100:00100000:0.0:1789762742.132364:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140624128 00000100:00100000:3.0:1789762742.132394:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762742.132417:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140624000 00000100:00100000:1.0:1789762742.132425:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140624000 00000100:00100000:3.0:1789762742.132432:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140624256 00000100:00100000:0.0:1789762742.132439:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:3.0:1789762742.132439:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140624256 00000100:00080000:2.0:1789762742.132453:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762742.132456:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+9:2343:x1876702140624128:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762742.132477:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:3.0:1789762742.132485:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:1.0:1789762742.132494:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140624000:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762742.132501:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140624256:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762742.132529:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+9:2343:x1876702140624128:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762742.132537:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:1.0:1789762742.132543:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140624000:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 54us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762742.132552:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140624256:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762742.132565:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:3.0:1789762742.132570:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:0.0:1789762742.252412:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146725468797 time 146725567889 state 0x0 ref 1 00000100:00100000:0.0:1789762742.252444:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140623872:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762742.252491:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7c5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.252505:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762742.252509:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762742.252513:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.252524:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.255431:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.255445:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.255457:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.255466:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762742.255471:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.255478:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.255492:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762742.255497:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762742.255548:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140623872:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3119us (198050us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762742.255555:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:0.0:1789762742.255567:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146725468797 time 146725567889 state 0x2 ref 0 00000100:00100000:2.0:1789762742.257493:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762742.257547:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140624384 00000100:00100000:1.0:1789762742.257556:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140624384 00000100:00100000:1.0:1789762742.257593:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146725468797 time 146725567889 state 0x0 ref 1 00000100:00100000:1.0:1789762742.257606:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146925567889 time 146725567889 state 0x1 ref 1 00010000:00010000:0.0:1789762742.310996:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762742.439033:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148998144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762742.439096:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762742.439142:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148998144 00000100:00100000:2.0:1789762742.439152:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148998144 00000100:00100000:2.0:1789762742.439205:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789762742.439214:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148998144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762742.439247:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00100000:2.0:1789762742.439316:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148998144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762742.439324:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789762742.439345:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148998144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762742.452556:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146925567889 time 146925714935 state 0x0 ref 1 00000100:00100000:3.0:1789762742.452573:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140624384:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762742.452600:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7cc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.452614:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762742.452618:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762742.452623:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.452646:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.456125:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.456137:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.456145:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.456151:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d182041a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762742.456156:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.456163:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.456177:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.456183:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762742.456240:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140624384:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3672us (198747us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762742.456249:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:3.0:1789762742.456254:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146925567889 time 146925714935 state 0x2 ref 0 00000100:00100000:1.0:1789762742.458600:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762742.458638:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140624512 00000100:00100000:3.0:1789762742.458644:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140624512 00000100:00100000:3.0:1789762742.458670:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 146925567889 time 146925714935 state 0x0 ref 1 00000100:00100000:3.0:1789762742.458679:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147125714935 time 146925714935 state 0x1 ref 1 00000100:00100000:1.0:1789762742.652702:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147125714935 time 147125858154 state 0x0 ref 1 00000100:00100000:1.0:1789762742.652747:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140624512:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762742.652816:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c56e7d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762742.652835:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762742.652914:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762742.652920:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c56e7d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762742.652935:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c56e7d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762742.656180:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c56e7d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762742.656193:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c56e7d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762742.656202:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c56e7d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762742.656209:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762742.656214:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c56e7d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762742.656245:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c56e7d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762742.656263:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c56e7d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762742.656271:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c56e7d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762742.656349:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140624512:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3629us (197747us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762742.656360:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 170 00000100:00100000:1.0:1789762742.656382:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147125714935 time 147125858154 state 0x2 ref 0 00000100:00100000:1.0:1789762742.658564:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762742.658674:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140624640 00000100:00100000:0.0:1789762742.658684:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140624640 00000100:00100000:0.0:1789762742.658741:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147125714935 time 147125858154 state 0x0 ref 1 00000100:00100000:0.0:1789762742.658752:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147325858154 time 147125858154 state 0x1 ref 1 00000100:00100000:3.0:1789762742.852794:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147325858154 time 147325949724 state 0x0 ref 1 00000100:00100000:3.0:1789762742.852823:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140624640:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762742.852904:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7da lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.852923:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762742.852928:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762742.852934:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.852947:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.855581:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.855599:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.855606:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.855611:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d182041a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762742.855616:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.855622:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.855635:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762742.855641:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762742.855689:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140624640:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2880us (197130us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762742.855697:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:3.0:1789762742.855702:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147325858154 time 147325949724 state 0x2 ref 0 00000100:00100000:2.0:1789762742.857506:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762742.857554:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140624768 00000100:00100000:0.0:1789762742.857562:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140624768 00000100:00100000:0.0:1789762742.857591:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147325858154 time 147325949724 state 0x0 ref 1 00000100:00100000:0.0:1789762742.857599:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147525949724 time 147325949724 state 0x1 ref 1 00000100:00100000:0.0:1789762743.052907:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147525949724 time 147526060362 state 0x0 ref 1 00000100:00100000:0.0:1789762743.052944:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140624768:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762743.052986:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.053002:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762743.053006:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762743.053011:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.053023:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.056383:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.056408:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.056419:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.056429:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762743.056434:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.056446:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.056466:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.056474:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762743.056540:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140624768:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3611us (199035us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762743.056550:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:0.0:1789762743.056556:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147525949724 time 147526060362 state 0x2 ref 0 00000100:00100000:1.0:1789762743.059316:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762743.059361:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140624896 00000100:00100000:3.0:1789762743.059378:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140624896 00000100:00100000:3.0:1789762743.059411:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147525949724 time 147526060362 state 0x0 ref 1 00000100:00100000:3.0:1789762743.059420:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147726060362 time 147526060362 state 0x1 ref 1 00000100:00100000:0.0:1789762743.252981:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147726060362 time 147726134275 state 0x0 ref 1 00000100:00100000:0.0:1789762743.253023:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140624896:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762743.253060:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.253074:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762743.253077:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762743.253082:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.253093:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.255604:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.255619:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.255630:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.255639:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762743.255645:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.255656:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.255682:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762743.255692:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e7e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762743.255749:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140624896:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2735us (196433us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762743.255758:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:0.0:1789762743.255765:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147726060362 time 147726134275 state 0x2 ref 0 00000100:00100000:3.0:1789762743.257656:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762743.257707:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140625024 00000100:00100000:1.0:1789762743.257717:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140625024 00000100:00100000:1.0:1789762743.257758:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147726060362 time 147726134275 state 0x0 ref 1 00000100:00100000:1.0:1789762743.257769:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147926134275 time 147726134275 state 0x1 ref 1 00010000:00010000:2.0:1789762743.335027:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762743.453130:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147926134275 time 147926283145 state 0x0 ref 1 00000100:00100000:3.0:1789762743.453168:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140625024:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762743.453221:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7ef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762743.453241:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762743.453246:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762743.453254:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762743.453270:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762743.456062:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762743.456073:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762743.456079:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762743.456095:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d182041a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762743.456098:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762743.456106:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762743.456119:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762743.456124:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c56e7ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762743.456173:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140625024:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3023us (198517us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762743.456180:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:3.0:1789762743.456185:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147926134275 time 147926283145 state 0x2 ref 0 00000100:00100000:3.0:1789762743.458355:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762743.458401:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140625152 00000100:00100000:1.0:1789762743.458409:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140625152 00000100:00100000:1.0:1789762743.458441:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 147926134275 time 147926283145 state 0x0 ref 1 00000100:00100000:1.0:1789762743.458450:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148126283145 time 147926283145 state 0x1 ref 1 00000100:00100000:1.0:1789762743.653218:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148126283145 time 148126372118 state 0x0 ref 1 00000100:00100000:1.0:1789762743.653268:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140625152:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762743.653308:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000094fbea85/0xd08452c77c56e7f6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762743.653324:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762743.653328:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762743.653334:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094fbea85/0xd08452c77c56e7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762743.653364:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094fbea85/0xd08452c77c56e7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762743.656488:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000094fbea85/0xd08452c77c56e7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762743.656517:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094fbea85/0xd08452c77c56e7f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762743.656527:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094fbea85/0xd08452c77c56e7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762743.656536:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1741e0000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762743.656541:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094fbea85/0xd08452c77c56e7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762743.656552:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094fbea85/0xd08452c77c56e7f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762743.656571:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094fbea85/0xd08452c77c56e7f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762743.656578:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094fbea85/0xd08452c77c56e7f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762743.656630:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140625152:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3392us (198273us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762743.656640:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:2.0:1789762743.656647:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148126283145 time 148126372118 state 0x2 ref 0 00000100:00100000:3.0:1789762743.658520:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762743.658574:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140625280 00000100:00100000:0.0:1789762743.658582:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140625280 00000100:00100000:0.0:1789762743.658614:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148126283145 time 148126372118 state 0x0 ref 1 00000100:00100000:0.0:1789762743.658623:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148326372118 time 148126372118 state 0x1 ref 1 00000100:00100000:1.0:1789762743.853339:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148326372118 time 148326494995 state 0x0 ref 1 00000100:00100000:1.0:1789762743.853368:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140625280:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762743.853406:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007aeb6012/0xd08452c77c56e7fd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762743.853421:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762743.853425:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762743.853430:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aeb6012/0xd08452c77c56e7fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762743.853450:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aeb6012/0xd08452c77c56e7fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762743.856228:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007aeb6012/0xd08452c77c56e7fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762743.856236:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aeb6012/0xd08452c77c56e7fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762743.856242:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aeb6012/0xd08452c77c56e7fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762743.856246:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1741e1a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762743.856249:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aeb6012/0xd08452c77c56e7fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762743.856255:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aeb6012/0xd08452c77c56e7fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762743.856267:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aeb6012/0xd08452c77c56e7fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762743.856272:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aeb6012/0xd08452c77c56e7fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762743.856319:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140625280:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2962us (197800us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762743.856330:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:1.0:1789762743.856345:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148326372118 time 148326494995 state 0x2 ref 0 00000100:00100000:1.0:1789762743.858026:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762743.858070:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140625408 00000100:00100000:0.0:1789762743.858078:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140625408 00000100:00100000:0.0:1789762743.858112:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148326372118 time 148326494995 state 0x0 ref 1 00000100:00100000:0.0:1789762743.858125:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148526494995 time 148326494995 state 0x1 ref 1 00000100:00100000:0.0:1789762744.053390:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148526494995 time 148526545732 state 0x0 ref 1 00000100:00100000:0.0:1789762744.053423:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140625408:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:2.0:1789762744.053423:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762744.053461:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e804 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.053482:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762744.053486:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762744.053491:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e804 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.053502:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e804 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.056489:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e804 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.056499:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e804 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.056506:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e804 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.056515:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762744.056521:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e804 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.056530:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e804 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.056549:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e804 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.056568:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e804 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762744.056616:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140625408:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3212us (198590us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762744.056625:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:0.0:1789762744.056631:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148526494995 time 148526545732 state 0x2 ref 0 00000100:00100000:3.0:1789762744.058356:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762744.058405:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140625536 00000100:00100000:1.0:1789762744.058414:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140625536 00000100:00100000:1.0:1789762744.058445:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148526494995 time 148526545732 state 0x0 ref 1 00000100:00100000:1.0:1789762744.058454:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148726545732 time 148526545732 state 0x1 ref 1 00000100:00100000:0.0:1789762744.253504:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148726545732 time 148726660187 state 0x0 ref 1 00000100:00100000:0.0:1789762744.253547:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140625536:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762744.253590:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e80b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.253605:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762744.253609:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762744.253613:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e80b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.253624:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e80b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.256226:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e80b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.256254:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e80b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.256272:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.256280:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762744.256284:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.256294:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e80b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.256311:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e80b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.256319:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e80b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762744.256382:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140625536:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2859us (198025us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762744.256393:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:0.0:1789762744.256401:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148726545732 time 148726660187 state 0x2 ref 0 00000100:00100000:3.0:1789762744.258139:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762744.258193:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140625664 00000100:00100000:2.0:1789762744.258203:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140625664 00000100:00100000:2.0:1789762744.258245:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148726545732 time 148726660187 state 0x0 ref 1 00000100:00100000:2.0:1789762744.258254:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148926660187 time 148726660187 state 0x1 ref 1 00010000:00010000:1.0:1789762744.358925:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762744.453609:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148926660187 time 148926765369 state 0x0 ref 1 00000100:00100000:1.0:1789762744.453637:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140625664:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762744.453676:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000389593ed/0xd08452c77c56e812 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762744.453689:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762744.453693:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762744.453697:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389593ed/0xd08452c77c56e812 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762744.453709:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389593ed/0xd08452c77c56e812 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.456061:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000389593ed/0xd08452c77c56e812 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.456086:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000389593ed/0xd08452c77c56e812 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.456093:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000389593ed/0xd08452c77c56e812 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.456099:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588c5c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762744.456103:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000389593ed/0xd08452c77c56e812 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.456110:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000389593ed/0xd08452c77c56e812 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.456123:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000389593ed/0xd08452c77c56e812 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762744.456128:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389593ed/0xd08452c77c56e812 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762744.456182:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140625664:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2557us (198042us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762744.456190:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:0.0:1789762744.456196:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148926660187 time 148926765369 state 0x2 ref 0 00000100:00100000:1.0:1789762744.457948:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762744.457988:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140625792 00000100:00100000:3.0:1789762744.457995:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140625792 00000100:00100000:3.0:1789762744.458026:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 148926660187 time 148926765369 state 0x0 ref 1 00000100:00100000:3.0:1789762744.458050:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149126765369 time 148926765369 state 0x1 ref 1 00000100:00100000:2.0:1789762744.653708:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149126765369 time 149126864710 state 0x0 ref 1 00000100:00100000:2.0:1789762744.653734:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140625792:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762744.653773:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e819 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762744.653786:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762744.653790:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762744.653794:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e819 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762744.653806:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e819 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762744.656508:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e819 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762744.656518:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e819 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762744.656525:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e819 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762744.656542:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1744ca400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762744.656546:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e819 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762744.656553:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e819 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762744.656565:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e819 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762744.656570:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e819 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762744.656617:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140625792:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2895us (198669us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762744.656625:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:2.0:1789762744.656630:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149126765369 time 149126864710 state 0x2 ref 0 00000100:00100000:1.0:1789762744.658465:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762744.658523:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140625920 00000100:00100000:0.0:1789762744.658537:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140625920 00000100:00100000:0.0:1789762744.658569:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149126765369 time 149126864710 state 0x0 ref 1 00000100:00100000:0.0:1789762744.658578:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149326864710 time 149126864710 state 0x1 ref 1 00000100:00100000:3.0:1789762744.853903:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149326864710 time 149327059614 state 0x0 ref 1 00000100:00100000:3.0:1789762744.853930:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140625920:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762744.854032:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e820 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762744.854059:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762744.854065:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762744.854072:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e820 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762744.854107:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e820 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762744.857079:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e820 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762744.857102:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e820 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762744.857110:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e820 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762744.857116:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d182041c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762744.857120:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e820 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762744.857128:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e820 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762744.857147:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e820 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762744.857155:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e820 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762744.857238:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140625920:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3316us (198772us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762744.857265:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:1.0:1789762744.857273:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149326864710 time 149327059614 state 0x2 ref 0 00000100:00100000:1.0:1789762744.859981:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762744.860035:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140626048 00000100:00100000:0.0:1789762744.860043:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140626048 00000100:00100000:0.0:1789762744.860074:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149326864710 time 149327059614 state 0x0 ref 1 00000100:00100000:0.0:1789762744.860083:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149527059614 time 149327059614 state 0x1 ref 1 00000100:00100000:0.0:1789762745.054031:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149527059614 time 149527182889 state 0x0 ref 1 00000100:00100000:0.0:1789762745.054069:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140626048:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762745.054121:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e827 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.054161:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762745.054165:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762745.054172:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e827 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.054186:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e827 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.059600:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e827 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.059624:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e827 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.059680:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e827 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.059692:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762745.059700:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e827 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.059715:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e827 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.059758:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e827 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.059773:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e827 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762745.059946:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140626048:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5886us (199956us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762745.059981:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:0.0:1789762745.059991:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149527059614 time 149527182889 state 0x2 ref 0 00000100:00100000:3.0:1789762745.063089:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762745.063174:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140626176 00000100:00100000:1.0:1789762745.063185:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140626176 00000100:00100000:1.0:1789762745.063225:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149527059614 time 149527182889 state 0x0 ref 1 00000100:00100000:1.0:1789762745.063237:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149727182889 time 149527182889 state 0x1 ref 1 00000100:00100000:0.0:1789762745.254119:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149727182889 time 149727273740 state 0x0 ref 1 00000100:00100000:0.0:1789762745.254148:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140626176:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762745.254191:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e82e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.254222:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762745.254227:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762745.254233:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e82e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.254247:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e82e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.257749:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e82e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.257764:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e82e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.257776:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e82e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.257785:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762745.257791:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e82e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.257802:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e82e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.257884:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e82e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762745.257907:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e82e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762745.257972:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140626176:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3835us (194888us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762745.257982:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:0.0:1789762745.257989:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149727182889 time 149727273740 state 0x2 ref 0 00000100:00100000:3.0:1789762745.260930:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762745.261021:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140626304 00000100:00100000:2.0:1789762745.261036:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140626304 00000100:00100000:2.0:1789762745.261086:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149727182889 time 149727273740 state 0x0 ref 1 00000100:00100000:2.0:1789762745.261115:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149927273740 time 149727273740 state 0x1 ref 1 00010000:00010000:3.0:1789762745.383085:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762745.454254:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149927273740 time 149927407042 state 0x0 ref 1 00000100:00100000:1.0:1789762745.454290:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140626304:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762745.454337:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000adf5a08e/0xd08452c77c56e835 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762745.454357:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762745.454362:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762745.454369:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf5a08e/0xd08452c77c56e835 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762745.454385:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf5a08e/0xd08452c77c56e835 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762745.457636:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000adf5a08e/0xd08452c77c56e835 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762745.457646:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf5a08e/0xd08452c77c56e835 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762745.457653:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf5a08e/0xd08452c77c56e835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762745.457675:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d173f7f600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762745.457679:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf5a08e/0xd08452c77c56e835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762745.457686:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf5a08e/0xd08452c77c56e835 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762745.457699:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf5a08e/0xd08452c77c56e835 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762745.457705:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf5a08e/0xd08452c77c56e835 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762745.457753:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140626304:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3480us (196827us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762745.457761:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:1.0:1789762745.457767:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149927273740 time 149927407042 state 0x2 ref 0 00000100:00100000:1.0:1789762745.459815:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762745.459882:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140626432 00000100:00100000:3.0:1789762745.459890:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140626432 00000100:00100000:3.0:1789762745.459920:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 149927273740 time 149927407042 state 0x0 ref 1 00000100:00100000:3.0:1789762745.459928:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150127407042 time 149927407042 state 0x1 ref 1 00000100:00100000:2.0:1789762745.654362:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150127407042 time 150127517999 state 0x0 ref 1 00000100:00100000:2.0:1789762745.654390:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140626432:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762745.654440:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e83c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762745.654453:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762745.654457:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762745.654461:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e83c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762745.654474:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e83c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762745.657508:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e83c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762745.657519:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e83c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762745.657526:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e83c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762745.657532:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1744ca400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762745.657537:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e83c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762745.657543:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e83c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762745.657568:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e83c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762745.657575:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e83c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762745.657633:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140626432:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3256us (197820us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762745.657640:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:2.0:1789762745.657646:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150127407042 time 150127517999 state 0x2 ref 0 00000100:00100000:1.0:1789762745.659574:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762745.659636:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140626560 00000100:00100000:0.0:1789762745.659644:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140626560 00000100:00100000:0.0:1789762745.659677:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150127407042 time 150127517999 state 0x0 ref 1 00000100:00100000:0.0:1789762745.659686:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150327517999 time 150127517999 state 0x1 ref 1 00000100:00100000:3.0:1789762745.854483:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150327517999 time 150327631002 state 0x0 ref 1 00000100:00100000:3.0:1789762745.854524:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140626560:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762745.854589:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004bf2585d/0xd08452c77c56e843 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762745.854608:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762745.854612:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762745.854618:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bf2585d/0xd08452c77c56e843 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762745.854632:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bf2585d/0xd08452c77c56e843 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762745.857777:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004bf2585d/0xd08452c77c56e843 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762745.857790:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bf2585d/0xd08452c77c56e843 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762745.857797:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bf2585d/0xd08452c77c56e843 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762745.857803:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588c4200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762745.857807:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bf2585d/0xd08452c77c56e843 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762745.857825:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bf2585d/0xd08452c77c56e843 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762745.857869:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bf2585d/0xd08452c77c56e843 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762745.857875:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bf2585d/0xd08452c77c56e843 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762745.857929:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140626560:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3424us (198360us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762745.857938:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:3.0:1789762745.857949:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150327517999 time 150327631002 state 0x2 ref 0 00000100:00100000:3.0:1789762745.860086:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762745.860130:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140626688 00000100:00100000:0.0:1789762745.860143:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140626688 00000100:00100000:0.0:1789762745.860195:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150327517999 time 150327631002 state 0x0 ref 1 00000100:00100000:0.0:1789762745.860206:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150527631002 time 150327631002 state 0x1 ref 1 00000100:00100000:0.0:1789762746.054531:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150527631002 time 150527684832 state 0x0 ref 1 00000100:00100000:0.0:1789762746.054576:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140626688:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:2.0:1789762746.054595:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762746.054612:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e84a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.054626:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762746.054642:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762746.054647:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e84a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.054659:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e84a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.058096:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e84a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.058107:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e84a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.058115:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e84a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.058121:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762746.058126:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e84a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.058133:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e84a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.058150:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e84a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.058156:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e84a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762746.058231:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140626688:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3681us (198143us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762746.058243:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:0.0:1789762746.058249:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150527631002 time 150527684832 state 0x2 ref 0 00000100:00100000:1.0:1789762746.060495:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762746.060539:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140626816 00000100:00100000:0.0:1789762746.060547:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140626816 00000100:00100000:0.0:1789762746.060577:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150527631002 time 150527684832 state 0x0 ref 1 00000100:00100000:0.0:1789762746.060585:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150727684832 time 150527684832 state 0x1 ref 1 00000100:00100000:0.0:1789762746.254644:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150727684832 time 150727799914 state 0x0 ref 1 00000100:00100000:0.0:1789762746.254670:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140626816:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762746.254708:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e851 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.254723:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762746.254727:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762746.254732:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.254744:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.258301:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.258352:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e851 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.258363:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e851 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.258371:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762746.258377:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e851 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.258387:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e851 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.258407:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e851 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.258415:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e851 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762746.258492:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140626816:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3829us (198000us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762746.258511:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:0.0:1789762746.258524:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150727684832 time 150727799914 state 0x2 ref 0 00000100:00100000:3.0:1789762746.261445:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762746.261572:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140626944 00000100:00100000:2.0:1789762746.261586:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140626944 00000100:00100000:2.0:1789762746.261637:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150727684832 time 150727799914 state 0x0 ref 1 00000100:00100000:2.0:1789762746.261653:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150927799914 time 150727799914 state 0x1 ref 1 00010000:00010000:0.0:1789762746.406996:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762746.454937:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150927799914 time 150928090746 state 0x0 ref 1 00000100:00100000:0.0:1789762746.454971:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140626944:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762746.455024:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e858 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.455048:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762746.455055:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762746.455063:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e858 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.455083:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e858 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.458590:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e858 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.458608:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e858 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.458622:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e858 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.458635:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762746.458643:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e858 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.458681:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e858 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.458702:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e858 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762746.458710:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e858 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762746.458772:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140626944:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3815us (197329us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762746.458783:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:0.0:1789762746.458790:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150927799914 time 150928090746 state 0x2 ref 0 00000100:00100000:3.0:1789762746.461208:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762746.461303:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140627072 00000100:00100000:1.0:1789762746.461314:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140627072 00000100:00100000:1.0:1789762746.461371:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 150927799914 time 150928090746 state 0x0 ref 1 00000100:00100000:1.0:1789762746.461384:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151128090746 time 150928090746 state 0x1 ref 1 00000100:00100000:2.0:1789762746.655022:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151128090746 time 151128177524 state 0x0 ref 1 00000100:00100000:2.0:1789762746.655050:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140627072:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762746.655088:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e85f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762746.655103:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762746.655106:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762746.655123:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e85f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762746.655136:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e85f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762746.657927:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e85f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762746.657941:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e85f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762746.657951:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762746.657957:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1744ca400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762746.657961:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762746.657968:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e85f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762746.657980:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e85f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762746.657985:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc54b143/0xd08452c77c56e85f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762746.658044:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140627072:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3006us (196843us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762746.658051:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:2.0:1789762746.658057:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151128090746 time 151128177524 state 0x2 ref 0 00000100:00100000:3.0:1789762746.659902:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762746.659978:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140627200 00000100:00100000:0.0:1789762746.659989:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140627200 00000100:00100000:0.0:1789762746.660027:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151128090746 time 151128177524 state 0x0 ref 1 00000100:00100000:0.0:1789762746.660038:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151328177524 time 151128177524 state 0x1 ref 1 00000100:00100000:1.0:1789762746.855098:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151328177524 time 151328250824 state 0x0 ref 1 00000100:00100000:1.0:1789762746.855135:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140627200:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762746.855187:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ac69f2d1/0xd08452c77c56e866 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762746.855205:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762746.855209:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762746.855214:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac69f2d1/0xd08452c77c56e866 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762746.855228:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac69f2d1/0xd08452c77c56e866 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762746.858249:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ac69f2d1/0xd08452c77c56e866 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762746.858259:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac69f2d1/0xd08452c77c56e866 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762746.858267:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac69f2d1/0xd08452c77c56e866 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762746.858273:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f95200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762746.858277:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac69f2d1/0xd08452c77c56e866 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762746.858303:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac69f2d1/0xd08452c77c56e866 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762746.858320:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac69f2d1/0xd08452c77c56e866 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762746.858326:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac69f2d1/0xd08452c77c56e866 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762746.858380:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140627200:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3264us (198487us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762746.858389:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:3.0:1789762746.858396:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151328177524 time 151328250824 state 0x2 ref 0 00000100:00100000:3.0:1789762746.860306:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762746.860374:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140627328 00000100:00100000:0.0:1789762746.860390:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140627328 00000100:00100000:0.0:1789762746.860440:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151328177524 time 151328250824 state 0x0 ref 1 00000100:00100000:0.0:1789762746.860452:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151528250824 time 151328250824 state 0x1 ref 1 00000100:00100000:1.0:1789762747.047014:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789762747.047051:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d150cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148998272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762747.047098:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148998400:0@lo:400:kworker.0 00000100:00100000:3.0:1789762747.047123:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702148998528:0@lo:400:kworker.0 00000100:00100000:1.0:1789762747.047178:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762747.047185:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762747.047241:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762747.047278:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148999040:0@lo:400:kworker.0 00000100:00100000:1.0:1789762747.047286:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702148998656:0@lo:400:kworker.0 00000100:00100000:0.0:1789762747.047316:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702148998912:0@lo:400:kworker.0 00000100:00100000:1.0:1789762747.047343:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762747.047357:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762747.047395:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789762747.047403:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762747.047414:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148998784:0@lo:400:kworker.0 00000100:00100000:3.0:1789762747.047435:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148999040 00000100:00100000:3.0:1789762747.047443:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148999040 00000100:00100000:2.0:1789762747.047462:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148998528 00000100:00100000:1.0:1789762747.047471:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762747.047473:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148998528 00000100:00100000:0.0:1789762747.047488:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148998400 00000100:00100000:0.0:1789762747.047497:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148998400 00000100:00100000:3.0:1789762747.047534:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148998784 00000100:00100000:3.0:1789762747.047539:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148998784 00000100:00100000:2.0:1789762747.047551:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148998656 00000100:00100000:1.0:1789762747.047556:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148998912 00000100:00100000:2.0:1789762747.047556:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148998656 00000100:00100000:1.0:1789762747.047563:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148998912 00000100:00100000:0.0:1789762747.047582:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789762747.047584:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789762747.047607:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148999040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762747.047616:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702148998400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762747.047617:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789762747.047638:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789762747.047641:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148998528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762747.047658:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702148998656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762747.047713:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702148998400:12345-0@lo:400:kworker.0 Request processed in 108us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762747.047723:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789762747.047751:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702148999040:12345-0@lo:400:kworker.0 Request processed in 142us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762747.047752:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702148998528:12345-0@lo:400:kworker.0 Request processed in 114us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762747.047779:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702148998656:12345-0@lo:400:kworker.0 Request processed in 119us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762747.047787:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789762747.047789:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789762747.047796:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789762747.047820:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702148998400:0@lo:400:kworker.0 00000100:00100000:2.0:1789762747.047885:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789762747.047890:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789762747.047910:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148998784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762747.047920:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702148998912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762747.047924:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148998272 00000100:00100000:1.0:1789762747.047930:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148998272 00000100:00100000:1.0:1789762747.047983:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789762747.047994:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148998272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762747.048000:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148998784:12345-0@lo:400:kworker.0 Request processed in 99us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762747.048005:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148998784:0@lo:400:kworker.0 00000100:00100000:2.0:1789762747.048011:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702148998912:12345-0@lo:400:kworker.0 Request processed in 106us (611us total) trans 0 rc 0/0 00002000:00000024:1.0:1789762747.048028:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762747.048030:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789762747.048037:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789762747.048047:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702148998656:0@lo:400:kworker.0 00000100:00100000:1.0:1789762747.048129:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148998272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762747.048131:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702148998912:0@lo:400:kworker.0 00000100:00080000:3.0:1789762747.048135:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762747.048144:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762747.048156:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d150cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148998272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762747.048157:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789762747.048160:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762747.048239:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702148998528:0@lo:400:kworker.0 00000100:00100000:2.0:1789762747.048253:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702148999040:0@lo:400:kworker.0 00000100:00100000:0.0:1789762747.055134:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151528250824 time 151528293092 state 0x0 ref 1 00000100:00100000:0.0:1789762747.055152:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140627328:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762747.055183:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e86d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.055200:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762747.055205:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762747.055212:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e86d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.055240:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e86d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.058478:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e86d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.058493:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e86d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.058503:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e86d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.058511:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762747.058516:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e86d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.058526:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e86d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.058544:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e86d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.058553:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e86d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762747.058621:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140627328:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3473us (198313us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762747.058631:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:0.0:1789762747.058637:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151528250824 time 151528293092 state 0x2 ref 0 00000100:00100000:3.0:1789762747.060702:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762747.060785:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140627456 00000100:00100000:1.0:1789762747.060793:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140627456 00000100:00100000:1.0:1789762747.060883:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151528250824 time 151528293092 state 0x0 ref 1 00000100:00100000:1.0:1789762747.060897:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151728293092 time 151528293092 state 0x1 ref 1 00000100:00100000:2.0:1789762747.252363:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762747.252398:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762747.252430:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140627584 00000100:00100000:2.0:1789762747.252446:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762747.252448:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140627584 00000100:00100000:3.0:1789762747.252476:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140627712 00000100:00100000:3.0:1789762747.252483:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140627712 00000100:00100000:2.0:1789762747.252494:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762747.252531:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140627840 00000100:00100000:0.0:1789762747.252544:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140627840 00000100:00100000:2.0:1789762747.252550:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140627968 00000100:00100000:1.0:1789762747.252556:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:2.0:1789762747.252559:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140627968 00000100:00100000:3.0:1789762747.252564:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:1.0:1789762747.252578:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140627584:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762747.252586:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+9:2342:x1876702140627712:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762747.252617:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1789762747.252620:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1789762747.252630:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140627968:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762747.252639:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+7:2343:x1876702140627840:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762747.252681:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140627584:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 108us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762747.252682:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+9:2342:x1876702140627712:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 104us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762747.252701:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140627968:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 69us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762747.252708:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:1.0:1789762747.252709:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:0.0:1789762747.252718:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+7:2343:x1876702140627840:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762747.252735:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1789762747.252736:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00080000:3.0:1789762747.252767:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762747.255216:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151728293092 time 151728376366 state 0x0 ref 1 00000100:00100000:0.0:1789762747.255233:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140627456:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762747.255261:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e874 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.255276:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762747.255281:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762747.255287:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e874 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.255301:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e874 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.258073:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e874 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.258086:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e874 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.258097:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e874 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.258104:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762747.258109:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e874 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.258121:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e874 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.258141:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e874 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.258150:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e874 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762747.258203:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140627456:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2973us (197503us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762747.258215:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:0.0:1789762747.258227:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151728293092 time 151728376366 state 0x2 ref 0 00000100:00100000:1.0:1789762747.260015:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762747.260062:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140628096 00000100:00100000:2.0:1789762747.260068:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140628096 00000100:00100000:2.0:1789762747.260103:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151728293092 time 151728376366 state 0x0 ref 1 00000100:00100000:2.0:1789762747.260114:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151928376366 time 151728376366 state 0x1 ref 1 00010000:00010000:2.0:1789762747.431018:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762747.455301:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151928376366 time 151928453707 state 0x0 ref 1 00000100:00100000:1.0:1789762747.455342:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140628096:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762747.455416:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e87b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762747.455434:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762747.455438:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762747.455443:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e87b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762747.455455:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e87b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.458432:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e87b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.458450:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e87b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.458460:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e87b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.458468:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762747.458473:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e87b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.458482:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e87b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.458499:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e87b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762747.458507:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56e87b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762747.458595:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140628096:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3270us (198577us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762747.458607:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:0.0:1789762747.458628:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151928376366 time 151928453707 state 0x2 ref 0 00000100:00100000:3.0:1789762747.460363:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762747.460411:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140628224 00000100:00100000:2.0:1789762747.460424:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140628224 00000100:00100000:2.0:1789762747.460473:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 151928376366 time 151928453707 state 0x0 ref 1 00000100:00100000:2.0:1789762747.460484:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152128453707 time 151928453707 state 0x1 ref 1 00000100:00100000:1.0:1789762747.559053:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148999168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762747.559147:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762747.559192:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148999168 00000100:00100000:2.0:1789762747.559202:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148999168 00000100:00100000:2.0:1789762747.559287:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789762747.559304:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148999168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762747.559350:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00100000:2.0:1789762747.559405:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148999168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762747.559428:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789762747.559450:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148999168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762747.655367:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152128453707 time 152128515252 state 0x0 ref 1 00000100:00100000:2.0:1789762747.655413:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140628224:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762747.655477:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e882 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762747.655500:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762747.655506:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762747.655514:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e882 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762747.655535:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e882 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762747.658465:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e882 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762747.658483:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e882 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762747.658492:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e882 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762747.658498:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cdc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762747.658502:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e882 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762747.658527:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e882 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762747.658547:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e882 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762747.658553:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56e882 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762747.658630:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140628224:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3238us (198265us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762747.658639:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:1.0:1789762747.658646:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152128453707 time 152128515252 state 0x2 ref 0 00000100:00100000:3.0:1789762747.660630:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762747.660686:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140628352 00000100:00100000:0.0:1789762747.660694:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140628352 00000100:00100000:0.0:1789762747.660728:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152128453707 time 152128515252 state 0x0 ref 1 00000100:00100000:0.0:1789762747.660738:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152328515252 time 152128515252 state 0x1 ref 1 00000100:00100000:2.0:1789762747.855481:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152328515252 time 152328629762 state 0x0 ref 1 00000100:00100000:2.0:1789762747.855523:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140628352:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762747.855581:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e889 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762747.855602:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762747.855607:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762747.855615:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e889 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762747.855659:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e889 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762747.858763:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e889 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762747.858782:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e889 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762747.858819:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e889 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762747.858827:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762747.858851:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e889 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762747.858862:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e889 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762747.858881:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e889 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762747.858891:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029fb2412/0xd08452c77c56e889 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762747.858966:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140628352:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3459us (198331us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762747.858978:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:3.0:1789762747.858987:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152328515252 time 152328629762 state 0x2 ref 0 00000100:00100000:3.0:1789762747.860779:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762747.860865:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140628480 00000100:00100000:0.0:1789762747.860873:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140628480 00000100:00100000:0.0:1789762747.860911:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152328515252 time 152328629762 state 0x0 ref 1 00000100:00100000:0.0:1789762747.860921:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152528629762 time 152328629762 state 0x1 ref 1 00000100:00100000:0.0:1789762748.055542:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152528629762 time 152528699274 state 0x0 ref 1 00000100:00100000:0.0:1789762748.055584:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140628480:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762748.055622:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e890 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789762748.055625:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762748.055639:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762748.055643:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762748.055648:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e890 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.055658:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e890 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.058480:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e890 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.058507:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e890 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.058514:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e890 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.058520:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762748.058524:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e890 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.058531:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e890 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.058548:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e890 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.058553:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2743bfd/0xd08452c77c56e890 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762748.058606:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140628480:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3048us (197828us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762748.058615:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:0.0:1789762748.058621:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152528629762 time 152528699274 state 0x2 ref 0 00000100:00100000:1.0:1789762748.060396:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762748.060434:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140628608 00000100:00100000:0.0:1789762748.060448:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140628608 00000100:00100000:0.0:1789762748.060478:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152528629762 time 152528699274 state 0x0 ref 1 00000100:00100000:0.0:1789762748.060486:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152728699274 time 152528699274 state 0x1 ref 1 00000100:00100000:0.0:1789762748.255623:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152728699274 time 152728772762 state 0x0 ref 1 00000100:00100000:0.0:1789762748.255664:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140628608:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762748.255720:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e897 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.255737:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762748.255741:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762748.255746:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e897 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.255759:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e897 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.258890:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e897 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.258905:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e897 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.258916:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e897 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.258948:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762748.258954:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e897 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.258964:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e897 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.258983:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e897 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.258993:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e897 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762748.259062:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140628608:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3415us (198665us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762748.259073:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:0.0:1789762748.259082:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152728699274 time 152728772762 state 0x2 ref 0 00000100:00100000:1.0:1789762748.260997:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762748.261050:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140628736 00000100:00100000:2.0:1789762748.261061:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140628736 00000100:00100000:2.0:1789762748.261102:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152728699274 time 152728772762 state 0x0 ref 1 00000100:00100000:2.0:1789762748.261116:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152928772762 time 152728772762 state 0x1 ref 1 00010000:00010000:1.0:1789762748.454972:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762748.455747:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152928772762 time 152928899877 state 0x0 ref 1 00000100:00100000:0.0:1789762748.455789:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140628736:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762748.455886:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e89e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.455905:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762748.455927:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762748.455933:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e89e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.455946:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e89e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.459158:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e89e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.459180:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e89e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.459189:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e89e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.459195:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762748.459199:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e89e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.459205:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e89e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.459221:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e89e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762748.459226:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e89e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762748.459320:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140628736:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3551us (198328us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762748.459329:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:0.0:1789762748.459335:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152928772762 time 152928899877 state 0x2 ref 0 00000100:00100000:3.0:1789762748.461198:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762748.461247:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140628864 00000100:00100000:2.0:1789762748.461257:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140628864 00000100:00100000:2.0:1789762748.461305:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 152928772762 time 152928899877 state 0x0 ref 1 00000100:00100000:2.0:1789762748.461319:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153128899877 time 152928899877 state 0x1 ref 1 00000100:00100000:2.0:1789762748.655860:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153128899877 time 153128987001 state 0x0 ref 1 00000100:00100000:2.0:1789762748.655898:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140628864:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762748.655951:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006398b40c/0xd08452c77c56e8a5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762748.655969:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762748.655973:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762748.655979:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006398b40c/0xd08452c77c56e8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762748.655995:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006398b40c/0xd08452c77c56e8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762748.660664:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006398b40c/0xd08452c77c56e8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762748.660686:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006398b40c/0xd08452c77c56e8a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762748.660698:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006398b40c/0xd08452c77c56e8a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762748.660721:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1461e3200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762748.660725:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006398b40c/0xd08452c77c56e8a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762748.660732:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006398b40c/0xd08452c77c56e8a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762748.660748:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006398b40c/0xd08452c77c56e8a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762748.660753:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006398b40c/0xd08452c77c56e8a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762748.660871:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140628864:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4989us (199669us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762748.660881:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:1.0:1789762748.660887:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153128899877 time 153128987001 state 0x2 ref 0 00000100:00100000:3.0:1789762748.663338:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762748.663401:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140628992 00000100:00100000:0.0:1789762748.663413:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140628992 00000100:00100000:0.0:1789762748.663460:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153128899877 time 153128987001 state 0x0 ref 1 00000100:00100000:0.0:1789762748.663475:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153328987001 time 153128987001 state 0x1 ref 1 00000100:00100000:2.0:1789762748.855938:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153328987001 time 153329089689 state 0x0 ref 1 00000100:00100000:2.0:1789762748.855976:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140628992:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762748.856028:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ee1bd70/0xd08452c77c56e8ac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762748.856046:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762748.856050:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762748.856056:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ee1bd70/0xd08452c77c56e8ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762748.856070:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ee1bd70/0xd08452c77c56e8ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762748.859426:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ee1bd70/0xd08452c77c56e8ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762748.859456:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ee1bd70/0xd08452c77c56e8ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762748.859482:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ee1bd70/0xd08452c77c56e8ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762748.859491:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1461e2200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762748.859497:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee1bd70/0xd08452c77c56e8ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762748.859507:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee1bd70/0xd08452c77c56e8ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762748.859528:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ee1bd70/0xd08452c77c56e8ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762748.859538:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ee1bd70/0xd08452c77c56e8ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762748.859634:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140628992:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3671us (196292us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762748.859647:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:3.0:1789762748.859655:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153328987001 time 153329089689 state 0x2 ref 0 00000100:00100000:3.0:1789762748.862732:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762748.862804:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140629120 00000100:00100000:0.0:1789762748.862815:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140629120 00000100:00100000:0.0:1789762748.862877:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153328987001 time 153329089689 state 0x0 ref 1 00000100:00100000:0.0:1789762748.862888:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153529089689 time 153329089689 state 0x1 ref 1 00000100:00100000:0.0:1789762749.056001:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153529089689 time 153529150772 state 0x0 ref 1 00000100:00100000:0.0:1789762749.056029:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140629120:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762749.056066:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.056081:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762749.056084:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762749.056089:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.056114:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.058869:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.058879:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.058887:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.058892:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762749.058896:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.058903:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.058916:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.058922:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762749.058983:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140629120:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2966us (196256us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762749.058991:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 202 00000100:00100000:0.0:1789762749.059003:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153529089689 time 153529150772 state 0x2 ref 0 00000100:00100000:3.0:1789762749.060921:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762749.060964:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140629248 00000100:00100000:1.0:1789762749.060972:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140629248 00000100:00100000:1.0:1789762749.061013:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153529089689 time 153529150772 state 0x0 ref 1 00000100:00100000:1.0:1789762749.061022:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153729150772 time 153529150772 state 0x1 ref 1 00000100:00100000:0.0:1789762749.256084:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153729150772 time 153729241167 state 0x0 ref 1 00000100:00100000:0.0:1789762749.256109:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140629248:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762749.256145:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8ba lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.256159:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762749.256162:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762749.256166:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.256177:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.259025:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.259034:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.259054:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.259059:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762749.259063:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.259069:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.259084:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762749.259090:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762749.259136:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140629248:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3037us (198216us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762749.259143:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:0.0:1789762749.259148:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153729150772 time 153729241167 state 0x2 ref 0 00000100:00100000:3.0:1789762749.261026:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762749.261076:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140629376 00000100:00100000:1.0:1789762749.261084:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140629376 00000100:00100000:1.0:1789762749.261116:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153729150772 time 153729241167 state 0x0 ref 1 00000100:00100000:1.0:1789762749.261131:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153929241167 time 153729241167 state 0x1 ref 1 00000100:00100000:1.0:1789762749.456172:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153929241167 time 153929328652 state 0x0 ref 1 00000100:00100000:1.0:1789762749.456205:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140629376:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762749.456249:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762749.456264:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762749.456267:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762749.456273:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762749.456288:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762749.459101:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762749.459114:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762749.459125:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762749.459132:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762749.459137:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762749.459161:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762749.459178:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762749.459184:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762749.459236:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140629376:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3048us (198209us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762749.459245:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:1.0:1789762749.459252:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153929241167 time 153929328652 state 0x2 ref 0 00000100:00100000:1.0:1789762749.461281:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762749.461338:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140629504 00000100:00100000:3.0:1789762749.461348:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140629504 00000100:00100000:3.0:1789762749.461398:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 153929241167 time 153929328652 state 0x0 ref 1 00000100:00100000:3.0:1789762749.461408:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154129328652 time 153929328652 state 0x1 ref 1 00010000:00010000:3.0:1789762749.478986:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762749.656270:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154129328652 time 154129426572 state 0x0 ref 1 00000100:00100000:1.0:1789762749.656299:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140629504:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762749.656336:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762749.656349:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762749.656353:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762749.656357:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762749.656388:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762749.659058:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762749.659071:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762749.659081:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762749.659088:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762749.659093:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762749.659110:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762749.659129:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762749.659137:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56e8c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762749.659188:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140629504:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2903us (197908us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762749.659196:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:2.0:1789762749.659201:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154129328652 time 154129426572 state 0x2 ref 0 00000100:00100000:2.0:1789762749.661258:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762749.661308:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140629632 00000100:00100000:0.0:1789762749.661315:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140629632 00000100:00100000:0.0:1789762749.661344:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154129328652 time 154129426572 state 0x0 ref 1 00000100:00100000:0.0:1789762749.661352:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154329426572 time 154129426572 state 0x1 ref 1 00000100:00100000:3.0:1789762749.856415:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154329426572 time 154329569608 state 0x0 ref 1 00000100:00100000:3.0:1789762749.856454:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140629632:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762749.856517:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000851d9433/0xd08452c77c56e8cf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762749.856535:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762749.856540:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762749.856546:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000851d9433/0xd08452c77c56e8cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762749.856560:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000851d9433/0xd08452c77c56e8cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762749.859662:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000851d9433/0xd08452c77c56e8cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762749.859673:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000851d9433/0xd08452c77c56e8cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762749.859697:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000851d9433/0xd08452c77c56e8cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762749.859704:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f94c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762749.859708:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000851d9433/0xd08452c77c56e8cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762749.859714:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000851d9433/0xd08452c77c56e8cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762749.859729:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000851d9433/0xd08452c77c56e8cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762749.859735:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000851d9433/0xd08452c77c56e8cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762749.859783:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140629632:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3349us (198526us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762749.859807:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:3.0:1789762749.859813:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154329426572 time 154329569608 state 0x2 ref 0 00000100:00100000:3.0:1789762749.861994:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762749.862037:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140629760 00000100:00100000:0.0:1789762749.862046:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140629760 00000100:00100000:0.0:1789762749.862081:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154329426572 time 154329569608 state 0x0 ref 1 00000100:00100000:0.0:1789762749.862099:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154529569608 time 154329569608 state 0x1 ref 1 00000100:00100000:0.0:1789762750.056469:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154529569608 time 154529625259 state 0x0 ref 1 00000100:00100000:0.0:1789762750.056505:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140629760:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:3.0:1789762750.056529:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762750.056542:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8d6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.056556:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762750.056560:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762750.056565:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.056576:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.059385:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.059395:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.059403:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.059423:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762750.059428:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.059439:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.059457:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.059466:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762750.059522:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140629760:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3037us (197527us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762750.059529:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:0.0:1789762750.059534:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154529569608 time 154529625259 state 0x2 ref 0 00000100:00100000:1.0:1789762750.061602:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762750.061636:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140629888 00000100:00100000:0.0:1789762750.061644:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140629888 00000100:00100000:0.0:1789762750.061671:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154529569608 time 154529625259 state 0x0 ref 1 00000100:00100000:0.0:1789762750.061679:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154729625259 time 154529625259 state 0x1 ref 1 00000100:00100000:0.0:1789762750.256522:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154729625259 time 154729678781 state 0x0 ref 1 00000100:00100000:0.0:1789762750.256546:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140629888:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762750.256596:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8dd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.256610:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762750.256613:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762750.256618:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.256628:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.259483:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.259494:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.259502:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.259507:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762750.259511:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.259517:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.259546:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.259553:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762750.259601:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140629888:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3064us (198000us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762750.259609:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 208 00000100:00100000:0.0:1789762750.259615:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154729625259 time 154729678781 state 0x2 ref 0 00000100:00100000:1.0:1789762750.262062:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762750.262119:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140630016 00000100:00100000:2.0:1789762750.262128:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140630016 00000100:00100000:2.0:1789762750.262163:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154729625259 time 154729678781 state 0x0 ref 1 00000100:00100000:2.0:1789762750.262173:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154929678781 time 154729678781 state 0x1 ref 1 00000100:00100000:0.0:1789762750.456594:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154929678781 time 154929750607 state 0x0 ref 1 00000100:00100000:0.0:1789762750.456622:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140630016:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762750.456660:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.456674:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762750.456678:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762750.456683:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.456693:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.459402:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.459413:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.459424:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.459433:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762750.459438:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.459449:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.459468:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762750.459478:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762750.459532:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140630016:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2922us (197471us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762750.459539:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:0.0:1789762750.459551:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154929678781 time 154929750607 state 0x2 ref 0 00000100:00100000:3.0:1789762750.461579:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762750.461623:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140630144 00000100:00100000:2.0:1789762750.461630:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140630144 00000100:00100000:2.0:1789762750.461663:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 154929678781 time 154929750607 state 0x0 ref 1 00000100:00100000:2.0:1789762750.461671:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155129750607 time 154929750607 state 0x1 ref 1 00010000:00010000:0.0:1789762750.502982:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762750.656648:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155129750607 time 155129804379 state 0x0 ref 1 00000100:00100000:2.0:1789762750.656689:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140630144:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762750.656727:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027249741/0xd08452c77c56e8eb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762750.656749:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762750.656753:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762750.656758:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027249741/0xd08452c77c56e8eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762750.656771:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027249741/0xd08452c77c56e8eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762750.659517:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027249741/0xd08452c77c56e8eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762750.659528:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027249741/0xd08452c77c56e8eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762750.659536:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027249741/0xd08452c77c56e8eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762750.659542:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d173d3a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762750.659546:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027249741/0xd08452c77c56e8eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762750.659552:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027249741/0xd08452c77c56e8eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762750.659566:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027249741/0xd08452c77c56e8eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762750.659571:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027249741/0xd08452c77c56e8eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762750.659628:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140630144:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2948us (198050us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762750.659636:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:1.0:1789762750.659642:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155129750607 time 155129804379 state 0x2 ref 0 00000100:00100000:2.0:1789762750.661598:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762750.661654:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140630272 00000100:00100000:0.0:1789762750.661662:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140630272 00000100:00100000:0.0:1789762750.661693:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155129750607 time 155129804379 state 0x0 ref 1 00000100:00100000:0.0:1789762750.661701:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155329804379 time 155129804379 state 0x1 ref 1 00000100:00100000:2.0:1789762750.856734:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155329804379 time 155329889436 state 0x0 ref 1 00000100:00100000:2.0:1789762750.856764:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140630272:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762750.856819:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005d57aa03/0xd08452c77c56e8f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762750.856851:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762750.856856:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762750.856861:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d57aa03/0xd08452c77c56e8f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762750.856872:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d57aa03/0xd08452c77c56e8f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762750.860186:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005d57aa03/0xd08452c77c56e8f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762750.860219:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d57aa03/0xd08452c77c56e8f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762750.860231:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d57aa03/0xd08452c77c56e8f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762750.860240:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d173d3a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762750.860245:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d57aa03/0xd08452c77c56e8f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762750.860255:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d57aa03/0xd08452c77c56e8f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762750.860278:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d57aa03/0xd08452c77c56e8f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762750.860285:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d57aa03/0xd08452c77c56e8f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762750.860384:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140630272:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3630us (198781us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762750.860396:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:3.0:1789762750.860405:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155329804379 time 155329889436 state 0x2 ref 0 00000100:00100000:1.0:1789762750.862811:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762750.862874:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140630400 00000100:00100000:0.0:1789762750.862884:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140630400 00000100:00100000:0.0:1789762750.862924:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155329804379 time 155329889436 state 0x0 ref 1 00000100:00100000:0.0:1789762750.862934:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155529889436 time 155329889436 state 0x1 ref 1 00000100:00100000:0.0:1789762751.056893:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155529889436 time 155530031124 state 0x0 ref 1 00000100:00100000:0.0:1789762751.056938:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140630400:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762751.057011:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.057035:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762751.057042:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762751.057051:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.057069:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.060612:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.060636:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.060648:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.060658:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762751.060664:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.060676:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.060697:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.060707:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e8f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762751.060764:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140630400:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3849us (197954us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762751.060773:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:0.0:1789762751.060793:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155529889436 time 155530031124 state 0x2 ref 0 00000100:00100000:1.0:1789762751.063224:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762751.063272:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140630528 00000100:00100000:0.0:1789762751.063290:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140630528 00000100:00100000:0.0:1789762751.063348:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155529889436 time 155530031124 state 0x0 ref 1 00000100:00100000:0.0:1789762751.063359:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155730031124 time 155530031124 state 0x1 ref 1 00000100:00100000:0.0:1789762751.256965:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155730031124 time 155730113251 state 0x0 ref 1 00000100:00100000:0.0:1789762751.257004:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140630528:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762751.257060:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e900 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.257078:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762751.257082:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762751.257088:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e900 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.257102:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e900 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.260412:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e900 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.260423:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e900 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.260431:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e900 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.260448:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762751.260453:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e900 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.260461:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e900 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.260477:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e900 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.260483:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e900 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762751.260540:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140630528:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3556us (197317us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762751.260548:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:0.0:1789762751.260554:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155730031124 time 155730113251 state 0x2 ref 0 00000100:00100000:2.0:1789762751.262917:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762751.262969:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140630656 00000100:00100000:1.0:1789762751.262981:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140630656 00000100:00100000:1.0:1789762751.263024:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155730031124 time 155730113251 state 0x0 ref 1 00000100:00100000:1.0:1789762751.263035:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155930113251 time 155730113251 state 0x1 ref 1 00000100:00100000:0.0:1789762751.457082:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155930113251 time 155930231916 state 0x0 ref 1 00000100:00100000:0.0:1789762751.457134:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140630656:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762751.457193:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e907 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.457213:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762751.457239:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762751.457247:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e907 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.457264:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e907 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.461671:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e907 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.461683:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e907 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.461692:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e907 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.461697:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762751.461702:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e907 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.461710:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e907 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.461729:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e907 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762751.461734:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e907 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762751.461829:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140630656:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4724us (198911us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762751.461877:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:0.0:1789762751.461885:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155930113251 time 155930231916 state 0x2 ref 0 00000100:00100000:1.0:1789762751.464975:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762751.465019:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140630784 00000100:00100000:3.0:1789762751.465035:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140630784 00000100:00100000:3.0:1789762751.465076:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 155930113251 time 155930231916 state 0x0 ref 1 00000100:00100000:3.0:1789762751.465088:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156130231916 time 155930231916 state 0x1 ref 1 00010000:00010000:2.0:1789762751.527032:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762751.657216:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156130231916 time 156130362536 state 0x0 ref 1 00000100:00100000:1.0:1789762751.657262:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140630784:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762751.657317:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4f6d313/0xd08452c77c56e90e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762751.657336:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762751.657341:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762751.657347:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f6d313/0xd08452c77c56e90e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762751.657365:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4f6d313/0xd08452c77c56e90e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762751.662733:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4f6d313/0xd08452c77c56e90e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762751.662746:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f6d313/0xd08452c77c56e90e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762751.662753:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4f6d313/0xd08452c77c56e90e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762751.662786:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1742a8c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762751.662793:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f6d313/0xd08452c77c56e90e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762751.662804:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f6d313/0xd08452c77c56e90e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762751.662853:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4f6d313/0xd08452c77c56e90e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762751.662861:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4f6d313/0xd08452c77c56e90e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762751.662921:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140630784:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5681us (197947us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762751.662938:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:2.0:1789762751.662945:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156130231916 time 156130362536 state 0x2 ref 0 00000100:00100000:2.0:1789762751.666295:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762751.666352:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140630912 00000100:00100000:0.0:1789762751.666364:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140630912 00000100:00100000:0.0:1789762751.666410:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156130231916 time 156130362536 state 0x0 ref 1 00000100:00100000:0.0:1789762751.666422:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156330362536 time 156130362536 state 0x1 ref 1 00000100:00100000:3.0:1789762751.857310:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156330362536 time 156330463399 state 0x0 ref 1 00000100:00100000:3.0:1789762751.857342:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140630912:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762751.857379:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e915 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762751.857393:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762751.857397:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762751.857402:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e915 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762751.857415:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e915 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762751.860617:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e915 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762751.860628:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e915 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762751.860635:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762751.860657:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d173d3ce00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762751.860662:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762751.860671:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762751.860687:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e915 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762751.860693:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e915 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762751.860748:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140630912:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3418us (194453us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762751.860759:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:3.0:1789762751.860767:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156330362536 time 156330463399 state 0x2 ref 0 00000100:00100000:1.0:1789762751.862805:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762751.862864:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140631040 00000100:00100000:0.0:1789762751.862879:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140631040 00000100:00100000:0.0:1789762751.862931:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156330362536 time 156330463399 state 0x0 ref 1 00000100:00100000:0.0:1789762751.862942:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156530463399 time 156330463399 state 0x1 ref 1 00000100:00100000:0.0:1789762752.057365:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156530463399 time 156530521922 state 0x0 ref 1 00000100:00100000:0.0:1789762752.057406:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140631040:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762752.057442:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e91c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789762752.057454:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762752.057457:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762752.057462:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762752.057467:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e91c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.057495:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e91c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.060946:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e91c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.060959:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e91c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.060966:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e91c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.060972:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762752.060975:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e91c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.060982:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e91c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.060996:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e91c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.061010:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e91c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762752.061069:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140631040:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3688us (198265us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762752.061077:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:0.0:1789762752.061083:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156530463399 time 156530521922 state 0x2 ref 0 00000100:00100000:1.0:1789762752.063207:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762752.063244:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140631168 00000100:00100000:0.0:1789762752.063253:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140631168 00000100:00100000:0.0:1789762752.063289:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156530463399 time 156530521922 state 0x0 ref 1 00000100:00100000:0.0:1789762752.063300:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156730521922 time 156530521922 state 0x1 ref 1 00000100:00100000:2.0:1789762752.166998:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d14552b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148999296:0@lo:400:kworker.0 00000100:00100000:1.0:1789762752.167030:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d145528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148999808:0@lo:400:kworker.0 00000100:00100000:3.0:1789762752.167054:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d145529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702148999552:0@lo:400:kworker.0 00000100:00100000:2.0:1789762752.167072:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762752.167085:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762752.167125:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762752.167135:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d14552b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702148999936:0@lo:400:kworker.0 00000100:00100000:1.0:1789762752.167153:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148999808 00000100:00100000:1.0:1789762752.167161:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148999808 00000100:00100000:3.0:1789762752.167167:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148999424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762752.167174:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762752.167209:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762752.167224:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789762752.167236:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148999808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762752.167237:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d14552a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149000064:0@lo:400:kworker.0 00000100:00100000:2.0:1789762752.167238:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148999296 00000100:00100000:2.0:1789762752.167246:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148999296 00000100:00100000:2.0:1789762752.167290:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789762752.167296:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762752.167301:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702148999296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762752.167309:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702148999808:12345-0@lo:400:kworker.0 Request processed in 75us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762752.167319:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789762752.167332:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762752.167340:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149000064 00000100:00100000:3.0:1789762752.167344:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d14552a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702148999680:0@lo:400:kworker.0 00000100:00100000:1.0:1789762752.167345:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149000064 00000100:00100000:2.0:1789762752.167355:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702148999296:12345-0@lo:400:kworker.0 Request processed in 54us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762752.167366:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789762752.167384:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789762752.167391:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762752.167396:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149000064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762752.167423:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d14552b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702148999296:0@lo:400:kworker.0 00000100:00100000:1.0:1789762752.167443:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149000064:12345-0@lo:400:kworker.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762752.167448:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d14552a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149000064:0@lo:400:kworker.0 00000100:00100000:1.0:1789762752.167456:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789762752.167467:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148999552 00000100:00100000:2.0:1789762752.167472:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148999552 00000100:00100000:3.0:1789762752.167496:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148999424 00000100:00100000:3.0:1789762752.167502:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148999424 00000100:00100000:2.0:1789762752.167509:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148999936 00000100:00100000:1.0:1789762752.167511:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d145528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702148999808:0@lo:400:kworker.0 00000100:00100000:2.0:1789762752.167513:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148999936 00000100:00100000:3.0:1789762752.167551:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789762752.167552:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702148999680 00000100:00100000:2.0:1789762752.167557:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702148999680 00000100:00100000:3.0:1789762752.167565:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148999424:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762752.167586:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789762752.167595:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702148999552:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789762752.167595:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762752.167659:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702148999552:12345-0@lo:400:kworker.0 Request processed in 64us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762752.167671:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702148999424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762752.167677:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789762752.167689:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789762752.167690:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789762752.167698:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789762752.167700:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702148999936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762752.167711:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702148999680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762752.167753:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702148999936:12345-0@lo:400:kworker.0 Request processed in 55us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762752.167760:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789762752.167781:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d14552a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702148999680:0@lo:400:kworker.0 00000100:00100000:2.0:1789762752.167787:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702148999680:12345-0@lo:400:kworker.0 Request processed in 78us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762752.167796:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789762752.167804:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d145529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702148999552:0@lo:400:kworker.0 00000100:00080000:0.0:1789762752.167817:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762752.167825:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762752.167830:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d14552b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702148999936:0@lo:400:kworker.0 00000100:00080000:0.0:1789762752.167853:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762752.167853:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702148999424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762752.257472:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156730521922 time 156730625726 state 0x0 ref 1 00000100:00100000:0.0:1789762752.257503:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140631168:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762752.257547:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e923 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.257566:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762752.257571:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762752.257576:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e923 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.257588:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e923 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.260193:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e923 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.260204:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e923 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.260212:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e923 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.260218:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762752.260221:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e923 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.260228:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e923 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.260242:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e923 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.260248:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e923 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762752.260296:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140631168:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2805us (197090us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762752.260303:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:0.0:1789762752.260315:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156730521922 time 156730625726 state 0x2 ref 0 00000100:00100000:2.0:1789762752.262362:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762752.262408:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140631296 00000100:00100000:1.0:1789762752.262417:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140631296 00000100:00100000:1.0:1789762752.262452:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156730521922 time 156730625726 state 0x0 ref 1 00000100:00100000:1.0:1789762752.262464:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156930625726 time 156730625726 state 0x1 ref 1 00000100:00100000:1.0:1789762752.372273:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762752.372306:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762752.372317:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140631552 00000100:00100000:3.0:1789762752.372326:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140631552 00000100:00100000:1.0:1789762752.372369:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762752.372378:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140631424 00000100:00080000:2.0:1789762752.372386:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762752.372387:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140631424 00000100:00100000:1.0:1789762752.372398:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140631680 00000100:00100000:1.0:1789762752.372404:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140631680 00000100:00100000:0.0:1789762752.372451:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:3.0:1789762752.372451:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1789762752.372469:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+9:2342:x1876702140631552:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762752.372476:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140631424:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762752.372478:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:2.0:1789762752.372492:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140631680:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:1.0:1789762752.372493:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762752.372555:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140631424:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 90us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762752.372562:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140631680:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762752.372562:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+9:2342:x1876702140631552:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 91us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762752.372573:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:2.0:1789762752.372579:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:3.0:1789762752.372587:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:0.0:1789762752.457590:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156930625726 time 156930746504 state 0x0 ref 1 00000100:00100000:0.0:1789762752.457618:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140631296:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762752.457657:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e92a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.457670:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762752.457674:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762752.457679:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e92a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.457690:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e92a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.460613:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e92a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.460624:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e92a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.460645:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e92a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.460651:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762752.460655:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e92a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.460661:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e92a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.460675:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e92a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762752.460680:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e92a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762752.460730:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140631296:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3124us (198367us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762752.460738:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:0.0:1789762752.460744:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156930625726 time 156930746504 state 0x2 ref 0 00000100:00100000:1.0:1789762752.463105:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762752.463144:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140631808 00000100:00100000:3.0:1789762752.463158:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140631808 00000100:00100000:3.0:1789762752.463191:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 156930625726 time 156930746504 state 0x0 ref 1 00000100:00100000:3.0:1789762752.463201:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157130746504 time 156930746504 state 0x1 ref 1 00010000:00010000:1.0:1789762752.550915:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762752.657675:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157130746504 time 157130830679 state 0x0 ref 1 00000100:00100000:1.0:1789762752.657704:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140631808:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762752.657740:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005f2ddea9/0xd08452c77c56e931 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762752.657755:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762752.657758:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762752.657775:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f2ddea9/0xd08452c77c56e931 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762752.657788:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f2ddea9/0xd08452c77c56e931 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762752.660410:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005f2ddea9/0xd08452c77c56e931 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762752.660422:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f2ddea9/0xd08452c77c56e931 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762752.660429:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f2ddea9/0xd08452c77c56e931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762752.660436:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d173d3b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762752.660439:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f2ddea9/0xd08452c77c56e931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762752.660446:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f2ddea9/0xd08452c77c56e931 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762752.660459:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f2ddea9/0xd08452c77c56e931 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762752.660464:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f2ddea9/0xd08452c77c56e931 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762752.660510:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140631808:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2819us (197405us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762752.660517:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:1.0:1789762752.660528:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157130746504 time 157130830679 state 0x2 ref 0 00000100:00100000:1.0:1789762752.662534:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762752.662585:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140631936 00000100:00100000:0.0:1789762752.662593:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140631936 00000100:00100000:0.0:1789762752.662623:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157130746504 time 157130830679 state 0x0 ref 1 00000100:00100000:0.0:1789762752.662632:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157330830679 time 157130830679 state 0x1 ref 1 00000100:00100000:2.0:1789762752.679012:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149000192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762752.679064:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762752.679108:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149000192 00000100:00100000:1.0:1789762752.679116:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149000192 00000100:00100000:1.0:1789762752.679168:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789762752.679180:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149000192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762752.679214:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00100000:1.0:1789762752.679259:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149000192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762752.679265:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789762752.679306:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149000192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762752.857889:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157330830679 time 157331041522 state 0x0 ref 1 00000100:00100000:3.0:1789762752.857933:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140631936:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762752.857971:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e938 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762752.857984:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762752.857988:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762752.857992:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e938 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762752.858003:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e938 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762752.861054:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e938 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762752.861065:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e938 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762752.861072:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e938 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762752.861093:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d173d3ce00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762752.861098:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e938 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762752.861104:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e938 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762752.861117:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e938 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762752.861122:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e938 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762752.861175:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140631936:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3252us (198641us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762752.861181:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:3.0:1789762752.861186:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157330830679 time 157331041522 state 0x2 ref 0 00000100:00100000:1.0:1789762752.863375:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762752.863417:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140632064 00000100:00100000:0.0:1789762752.863425:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140632064 00000100:00100000:0.0:1789762752.863458:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157330830679 time 157331041522 state 0x0 ref 1 00000100:00100000:0.0:1789762752.863467:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157531041522 time 157331041522 state 0x1 ref 1 00000100:00100000:0.0:1789762753.057951:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157531041522 time 157531108852 state 0x0 ref 1 00000100:00100000:0.0:1789762753.057977:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140632064:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762753.058017:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e93f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.058035:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762753.058040:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762753.058046:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e93f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.058059:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e93f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.060871:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e93f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.060883:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e93f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.060890:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e93f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.060907:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762753.060911:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e93f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.060918:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e93f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.060932:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e93f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.060937:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e93f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762753.060985:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140632064:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3018us (197610us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762753.060994:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:0.0:1789762753.060999:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157531041522 time 157531108852 state 0x2 ref 0 00000100:00100000:1.0:1789762753.063018:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762753.063069:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140632192 00000100:00100000:0.0:1789762753.063077:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140632192 00000100:00100000:0.0:1789762753.063108:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157531041522 time 157531108852 state 0x0 ref 1 00000100:00100000:0.0:1789762753.063117:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157731108852 time 157531108852 state 0x1 ref 1 00000100:00100000:0.0:1789762753.258041:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157731108852 time 157731194197 state 0x0 ref 1 00000100:00100000:0.0:1789762753.258070:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140632192:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762753.258124:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e946 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.258141:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762753.258145:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762753.258151:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e946 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.258166:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e946 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.261013:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e946 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.261024:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e946 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.261031:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e946 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.261037:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762753.261041:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e946 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.261047:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e946 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.261073:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e946 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.261079:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e946 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762753.261125:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140632192:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3067us (198108us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762753.261134:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:0.0:1789762753.261140:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157731108852 time 157731194197 state 0x2 ref 0 00000100:00100000:2.0:1789762753.263356:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762753.263406:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140632320 00000100:00100000:1.0:1789762753.263423:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140632320 00000100:00100000:1.0:1789762753.263468:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157731108852 time 157731194197 state 0x0 ref 1 00000100:00100000:1.0:1789762753.263479:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157931194197 time 157731194197 state 0x1 ref 1 00000100:00100000:0.0:1789762753.458139:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157931194197 time 157931295821 state 0x0 ref 1 00000100:00100000:0.0:1789762753.458166:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140632320:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762753.458207:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e94d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.458226:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762753.458231:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762753.458238:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e94d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762753.458253:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e94d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.461320:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e94d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.461343:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e94d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.461354:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e94d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.461363:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762753.461375:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e94d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.461383:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e94d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.461398:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e94d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.461403:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede64e6e/0xd08452c77c56e94d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762753.461453:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140632320:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3298us (198100us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762753.461460:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:1.0:1789762753.461465:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157931194197 time 157931295821 state 0x2 ref 0 00000100:00100000:2.0:1789762753.463476:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762753.463520:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140632448 00000100:00100000:3.0:1789762753.463527:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140632448 00000100:00100000:3.0:1789762753.463558:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 157931194197 time 157931295821 state 0x0 ref 1 00000100:00100000:3.0:1789762753.463568:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158131295821 time 157931295821 state 0x1 ref 1 00010000:00010000:3.0:1789762753.574973:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762753.658231:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158131295821 time 158131387011 state 0x0 ref 1 00000100:00100000:1.0:1789762753.658259:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140632448:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762753.658297:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d0c14ae7/0xd08452c77c56e954 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.658311:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762753.658314:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762753.658319:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c14ae7/0xd08452c77c56e954 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.658345:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0c14ae7/0xd08452c77c56e954 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.661026:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d0c14ae7/0xd08452c77c56e954 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.661041:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c14ae7/0xd08452c77c56e954 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.661052:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0c14ae7/0xd08452c77c56e954 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.661058:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1519f7600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762753.661063:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c14ae7/0xd08452c77c56e954 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.661070:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c14ae7/0xd08452c77c56e954 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.661083:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0c14ae7/0xd08452c77c56e954 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762753.661088:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0c14ae7/0xd08452c77c56e954 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762753.661146:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140632448:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2898us (197670us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762753.661153:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:1.0:1789762753.661158:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158131295821 time 158131387011 state 0x2 ref 0 00000100:00100000:3.0:1789762753.662978:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762753.663020:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140632576 00000100:00100000:0.0:1789762753.663035:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140632576 00000100:00100000:0.0:1789762753.663067:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158131295821 time 158131387011 state 0x0 ref 1 00000100:00100000:0.0:1789762753.663075:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158331387011 time 158131387011 state 0x1 ref 1 00000100:00100000:3.0:1789762753.858325:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158331387011 time 158331481154 state 0x0 ref 1 00000100:00100000:3.0:1789762753.858367:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140632576:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762753.858406:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e95b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762753.858422:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762753.858428:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762753.858435:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e95b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762753.858450:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e95b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762753.861114:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e95b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762753.861127:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e95b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762753.861135:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e95b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762753.861147:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d173d3ce00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762753.861152:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e95b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762753.861159:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e95b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762753.861174:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e95b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762753.861180:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db712388/0xd08452c77c56e95b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762753.861228:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140632576:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2875us (198252us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762753.861237:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:2.0:1789762753.861243:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158331387011 time 158331481154 state 0x2 ref 0 00000100:00100000:3.0:1789762753.863095:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762753.863140:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140632704 00000100:00100000:0.0:1789762753.863155:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140632704 00000100:00100000:0.0:1789762753.863189:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158331387011 time 158331481154 state 0x0 ref 1 00000100:00100000:0.0:1789762753.863198:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158531481154 time 158331481154 state 0x1 ref 1 00000100:00100000:0.0:1789762754.058400:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158531481154 time 158531556769 state 0x0 ref 1 00000100:00100000:0.0:1789762754.058437:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140632704:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762754.058473:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e962 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789762754.058474:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762754.058488:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762754.058491:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762754.058496:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e962 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.058507:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e962 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.061270:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e962 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.061288:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e962 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.061296:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e962 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.061302:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d151b45e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762754.061305:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e962 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.061312:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e962 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.061325:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e962 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.061330:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e962 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762754.061379:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140632704:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2964us (198284us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762754.061387:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:0.0:1789762754.061392:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158531481154 time 158531556769 state 0x2 ref 0 00000100:00100000:3.0:1789762754.063313:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762754.063358:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140632832 00000100:00100000:1.0:1789762754.063367:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140632832 00000100:00100000:1.0:1789762754.063406:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158531481154 time 158531556769 state 0x0 ref 1 00000100:00100000:1.0:1789762754.063415:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158731556769 time 158531556769 state 0x1 ref 1 00000100:00100000:0.0:1789762754.258524:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158731556769 time 158731656702 state 0x0 ref 1 00000100:00100000:0.0:1789762754.258605:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140632832:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762754.258658:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e969 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.258706:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762754.258711:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762754.258718:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e969 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.258732:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e969 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.262584:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e969 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.262603:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e969 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.262615:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e969 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.262625:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d151b45e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762754.262631:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e969 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.262642:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e969 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.262677:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e969 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.262687:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048b92a06/0xd08452c77c56e969 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762754.262782:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140632832:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4189us (199466us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762754.262811:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 228 00000100:00100000:0.0:1789762754.262818:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158731556769 time 158731656702 state 0x2 ref 0 00000100:00100000:3.0:1789762754.265559:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762754.265623:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140632960 00000100:00100000:1.0:1789762754.265635:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140632960 00000100:00100000:1.0:1789762754.265673:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158731556769 time 158731656702 state 0x0 ref 1 00000100:00100000:1.0:1789762754.265685:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158931656702 time 158731656702 state 0x1 ref 1 00000100:00100000:1.0:1789762754.458599:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158931656702 time 158931749532 state 0x0 ref 1 00000100:00100000:1.0:1789762754.458643:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140632960:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762754.458713:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56e970 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762754.458735:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762754.458741:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762754.458749:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56e970 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762754.458806:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56e970 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.463786:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56e970 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.463817:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56e970 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.463919:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56e970 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.463940:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762754.463951:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56e970 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.463972:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56e970 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.464027:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56e970 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.464046:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56e970 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762754.464187:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140632960:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5558us (198625us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762754.464207:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:0.0:1789762754.464220:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158931656702 time 158931749532 state 0x2 ref 0 00000100:00100000:3.0:1789762754.467654:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762754.467808:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140633088 00000100:00100000:2.0:1789762754.467820:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140633088 00000100:00100000:2.0:1789762754.467964:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 158931656702 time 158931749532 state 0x0 ref 1 00000100:00100000:2.0:1789762754.467994:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159131749532 time 158931749532 state 0x1 ref 1 00010000:00010000:0.0:1789762754.599046:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762754.658733:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159131749532 time 159131886449 state 0x0 ref 1 00000100:00100000:1.0:1789762754.658816:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140633088:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762754.658891:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e977 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762754.658912:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762754.658917:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762754.658924:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e977 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762754.658938:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e977 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762754.662473:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e977 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762754.662496:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e977 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762754.662512:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e977 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762754.662565:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762754.662572:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e977 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762754.662585:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e977 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762754.662607:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e977 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762754.662617:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56e977 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762754.662710:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140633088:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3932us (195063us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762754.662727:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 230 00000100:00100000:1.0:1789762754.662736:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159131749532 time 159131886449 state 0x2 ref 0 00000100:00100000:3.0:1789762754.665588:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762754.665684:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140633216 00000100:00100000:0.0:1789762754.665702:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140633216 00000100:00100000:0.0:1789762754.665776:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159131749532 time 159131886449 state 0x0 ref 1 00000100:00100000:0.0:1789762754.665792:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159331886449 time 159131886449 state 0x1 ref 1 00000100:00100000:2.0:1789762754.858967:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159331886449 time 159332115300 state 0x0 ref 1 00000100:00100000:2.0:1789762754.859011:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140633216:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762754.859136:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56e97e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762754.859159:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762754.859165:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762754.859173:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56e97e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762754.859194:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56e97e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.863065:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56e97e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.863090:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56e97e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.863105:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56e97e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.863138:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762754.863156:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56e97e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.863187:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56e97e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.863211:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56e97e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762754.863225:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56e97e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762754.863345:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140633216:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4333us (197743us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762754.863365:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:0.0:1789762754.863388:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159331886449 time 159332115300 state 0x2 ref 0 00000100:00100000:3.0:1789762754.866774:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762754.866864:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140633344 00000100:00100000:0.0:1789762754.866876:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140633344 00000100:00100000:0.0:1789762754.866942:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159331886449 time 159332115300 state 0x0 ref 1 00000100:00100000:0.0:1789762754.866957:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159532115300 time 159332115300 state 0x1 ref 1 00000100:00100000:0.0:1789762755.059086:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159532115300 time 159532237649 state 0x0 ref 1 00000100:00100000:0.0:1789762755.059143:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140633344:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762755.059227:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e985 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762755.059255:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762755.059263:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762755.059274:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e985 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762755.059298:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e985 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762755.064119:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e985 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762755.064140:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e985 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762755.064154:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e985 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762755.064164:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d182041c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762755.064171:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e985 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762755.064183:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e985 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762755.064247:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e985 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762755.064263:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e985 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762755.064351:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140633344:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5240us (197602us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762755.064364:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 232 00000100:00100000:0.0:1789762755.064373:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159532115300 time 159532237649 state 0x2 ref 0 00000100:00100000:2.0:1789762755.067719:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762755.067894:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140633472 00000100:00100000:1.0:1789762755.067909:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140633472 00000100:00100000:1.0:1789762755.067964:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159532115300 time 159532237649 state 0x0 ref 1 00000100:00100000:1.0:1789762755.067980:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159732237649 time 159532237649 state 0x1 ref 1 00000100:00100000:0.0:1789762755.259179:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159732237649 time 159732334603 state 0x0 ref 1 00000100:00100000:0.0:1789762755.259207:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140633472:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762755.259250:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e98c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762755.259267:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762755.259272:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762755.259279:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e98c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762755.259296:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e98c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.262238:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e98c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.262250:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e98c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.262257:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e98c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.262273:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d182041c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762755.262278:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e98c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.262285:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e98c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.262299:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e98c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.262305:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c56e98c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762755.262356:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140633472:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3157us (194661us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762755.262365:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:3.0:1789762755.262371:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159732237649 time 159732334603 state 0x2 ref 0 00000100:00100000:2.0:1789762755.264219:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762755.264299:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140633600 00000100:00100000:1.0:1789762755.264307:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140633600 00000100:00100000:1.0:1789762755.264340:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159732237649 time 159732334603 state 0x0 ref 1 00000100:00100000:1.0:1789762755.264356:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159932334603 time 159732334603 state 0x1 ref 1 00000100:00100000:1.0:1789762755.459255:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159932334603 time 159932412096 state 0x0 ref 1 00000100:00100000:1.0:1789762755.459283:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140633600:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762755.459320:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e993 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.459334:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762755.459337:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762755.459341:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e993 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.459352:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e993 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.462080:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e993 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.462091:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e993 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.462098:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e993 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.462104:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762755.462107:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e993 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.462122:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e993 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.462136:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e993 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.462142:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e993 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762755.462192:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140633600:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2922us (197973us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762755.462199:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:1.0:1789762755.462205:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159932334603 time 159932412096 state 0x2 ref 0 00000100:00100000:1.0:1789762755.464008:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762755.464049:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140633728 00000100:00100000:0.0:1789762755.464057:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140633728 00000100:00100000:0.0:1789762755.464089:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 159932334603 time 159932412096 state 0x0 ref 1 00000100:00100000:0.0:1789762755.464098:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 160132412096 time 159932412096 state 0x1 ref 1 00010000:00010000:2.0:1789762755.622974:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762755.659363:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 160132412096 time 160132519769 state 0x0 ref 1 00000100:00100000:1.0:1789762755.659391:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140633728:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762755.659429:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e99a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.659443:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762755.659447:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762755.659451:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e99a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.659490:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e99a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.663089:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e99a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.663104:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e99a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.663114:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e99a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.663122:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762755.663127:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e99a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.663152:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e99a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.663170:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e99a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.663176:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006258da0a/0xd08452c77c56e99a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762755.663228:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140633728:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3849us (199220us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762755.663237:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:2.0:1789762755.663244:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 160132412096 time 160132519769 state 0x2 ref 0 00000100:00100000:1.0:1789762755.664892:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762755.664935:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140633984 00000100:00100000:0.0:1789762755.664944:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140633984 00000100:00080000:1.0:1789762755.664985:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762755.665004:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1789762755.665015:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+9:10517:x1876702140633984:12345-192.168.203.31@tcp:35:dd.500 00000100:00100000:0.0:1789762755.665298:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+10:10517:x1876702140633984:12345-192.168.203.31@tcp:35:dd.500 Request processed in 286us (407us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789762755.665305:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1789762755.691678:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762755.691724:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140634112 00000100:00100000:0.0:1789762755.691733:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140634112 00000100:00100000:0.0:1789762755.691800:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1789762755.691811:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+6:10500:x1876702140634112:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762755.691826:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762755.691886:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56e6de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5ff expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762755.691908:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762755.691956:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+5:10500:x1876702140634112:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 147us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762755.691965:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1789762755.701351:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762755.701403:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140634240 00000100:00100000:3.0:1789762755.701411:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140634240 00000100:00100000:3.0:1789762755.701451:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:3.0:1789762755.701462:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+10:10188:x1876702140634240:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1789762755.701482:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762755.701496:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e9a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e606 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.701569:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56e9a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.701583:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56e9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.701595:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56e9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762755.701624:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00000004:00200000:3.0:1789762755.701628:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762755.701645:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56e9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.701667:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e9a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e606 expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.701684:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56e9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e606 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.701693:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:3.0:1789762755.701696:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762755.701700:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030e00, rc 0) 00000100:00100000:3.0:1789762755.701739:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+11:10188:x1876702140634240:12345-192.168.203.31@tcp:101:bash.0 Request processed in 280us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762755.701761:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:1.0:1789762755.706574:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762755.706623:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140634496 00000100:00100000:2.0:1789762755.706628:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140634496 00000100:00100000:2.0:1789762755.706658:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:2.0:1789762755.706664:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+11:10532:x1876702140634496:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789762755.706672:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762755.706681:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56e9af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e60d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762755.706725:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00010000:00010000:2.0:1789762755.706817:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56e9af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e60d expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.706852:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:2.0:1789762755.706855:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789762755.706860:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56e9af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e60d expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.706868:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148888c00, rc 0) 00000100:00100000:2.0:1789762755.706897:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+12:10532:x1876702140634496:12345-192.168.203.31@tcp:101:rm.0 Request processed in 233us (324us total) trans 4294967355 rc 301/301 00000100:00100000:2.0:1789762755.706903:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:1.0:1789762755.708537:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762755.708574:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140634624 00000100:00100000:2.0:1789762755.708579:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140634624 00000100:00100000:2.0:1789762755.708605:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1789762755.708610:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+12:10532:x1876702140634624:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:2.0:1789762755.710485:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+12:10532:x1876702140634624:12345-192.168.203.31@tcp:37:rm.0 Request processed in 1871us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762755.710493:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1789762755.711728:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762755.711773:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140634880 00000100:00100000:0.0:1789762755.711779:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140634880 00000100:00100000:0.0:1789762755.711812:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1789762755.711823:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1517c1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+12:10532:x1876702140634880:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:0.0:1789762755.711948:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1517c1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+13:10532:x1876702140634880:12345-192.168.203.31@tcp:35:rm.0 Request processed in 130us (220us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789762755.711954:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1789762755.712915:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762755.712956:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140635136 00000100:00100000:3.0:1789762755.712961:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140635136 00000100:00100000:3.0:1789762755.712996:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:3.0:1789762755.713004:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+13:10532:x1876702140635136:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1789762755.713016:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762755.713028:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e9bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e614 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.713081:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56e9c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.713094:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56e9c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.713104:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56e9c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762755.713114:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00010000:00010000:3.0:1789762755.713178:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56e9bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e614 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.713190:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56e9c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e614 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.713196:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:3.0:1789762755.713198:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789762755.713200:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030c00, rc 0) 00000100:00100000:3.0:1789762755.713229:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+15:10532:x1876702140635136:12345-192.168.203.31@tcp:101:rm.0 Request processed in 226us (313us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1789762755.713236:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:2.0:1789762755.714392:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762755.714443:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140635264 00000100:00100000:3.0:1789762755.714455:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140635264 00000100:00100000:3.0:1789762755.714489:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:3.0:1789762755.714498:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+15:10532:x1876702140635264:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:3.0:1789762755.714535:0:6681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7614758912 avail 7610564608 00000100:00100000:3.0:1789762755.714580:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+15:10532:x1876702140635264:12345-192.168.203.31@tcp:41:rm.0 Request processed in 82us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762755.714588:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:1.0:1789762755.715563:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762755.715602:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140635520 00000100:00100000:2.0:1789762755.715607:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140635520 00000100:00100000:2.0:1789762755.715633:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:2.0:1789762755.715638:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+15:10532:x1876702140635520:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762755.715659:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762755.715671:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f5800/0xd08452c77c56e6d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5f8 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.715694:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc800/0xd08452c77c56e37a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5d5 expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.715702:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:2.0:1789762755.715709:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56e9a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e606 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.715716:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:2.0:1789762755.715718:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762755.715727:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56e9d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.715733:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56e9d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.715739:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56e9d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.715762:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56e9d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.715767:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56e9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.715772:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56e9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.716051:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56e9e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.716065:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56e9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.716070:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56e9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762755.716881:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789762755.716889:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 160190054655ns, next at 161190053115ns, rc = 0 00010000:00010000:2.0:1789762755.716921:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56e9e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.716928:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56e9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.716934:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56e9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.716939:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56e9e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.716944:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56e9e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.716948:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56e9e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.716962:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762755.716970:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56e9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.716974:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56e9e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.716984:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56e9e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.716988:0:6671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762755.716989:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762755.716996:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56e9e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.716998:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56e9e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717004:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56e9e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.717009:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762755.717016:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d143e3f100) 00010000:00010000:1.0:1789762755.717017:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56e9e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717023:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762755.717028:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56e9e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.717030:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56e9e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717041:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56e9e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.717047:0:6671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d143e3f100) 00010000:00010000:1.0:1789762755.717051:0:6671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789762755.717054:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56e9e7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717054:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56e9d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.717072:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56e9e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717073:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56e9d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717078:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56e9d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717083:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762755.717087:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56e9d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717107:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56e9d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762755.717109:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762755.717113:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762755.717114:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:1.0:1789762755.717115:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762755.717118:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762755.717122:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56e9d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717126:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56e9d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762755.717134:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081b5a500 reply state 00000000912641a5 transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56e9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762755.717139:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762755.717173:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+14:10532:x1876702140635520:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1535us (1611us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1789762755.717179:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00010000:00010000:2.0:1789762755.717818:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56e9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717824:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56e9d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717829:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56e9d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717851:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762755.717854:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56e9d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717868:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56e9d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717875:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff95d143e3f900) 00010000:00010000:2.0:1789762755.717877:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762755.717879:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56e9d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.717883:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56e9d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762755.718395:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762755.718428:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140635776 00000100:00100000:2.0:1789762755.718432:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140635776 00000100:00100000:2.0:1789762755.718455:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1789762755.718460:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+13:10532:x1876702140635776:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:2.0:1789762755.718541:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+14:10532:x1876702140635776:12345-192.168.203.31@tcp:35:rm.0 Request processed in 81us (147us total) trans 4294967359 rc 0/0 00000100:00100000:2.0:1789762755.718546:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1789762755.719245:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762755.719279:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140636032 00000100:00100000:3.0:1789762755.719286:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140636032 00000100:00100000:3.0:1789762755.719319:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:3.0:1789762755.719330:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+14:10532:x1876702140636032:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:3.0:1789762755.719356:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789762755.719370:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56e9c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e614 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.719388:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1588cc600/0xd08452c77c56e349 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5c7 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.719398:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:3.0:1789762755.719410:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747f4c00/0xd08452c77c56e2e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e5b2 expref: 12 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.719419:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:3.0:1789762755.719425:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762755.719439:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56e9ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.719448:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56e9ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.719463:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56e9ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.719475:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56e9f5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.719483:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56e9f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.719490:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56e9f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.719735:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56e9fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.719763:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56e9fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.719772:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56e9fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762755.720264:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00010000:00010000:3.0:1789762755.720275:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56e9fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.720283:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56e9fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.720290:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56e9fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.720295:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762755.720304:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56e9fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.720311:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56e9fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.720321:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d15055d100) 00010000:00010000:3.0:1789762755.720324:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789762755.720327:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56e9fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.720334:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56e9fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.720351:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56e9ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.720358:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56e9ee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.720364:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56e9ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.720370:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762755.720372:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56e9ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.720379:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56e9ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.720387:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d700) 00010000:00010000:3.0:1789762755.720390:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762755.720400:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56e9ee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762755.720406:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56e9ee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762755.720421:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ceb81d64 reply state 00000000872b9ee1 transno 4294967360 ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56e9f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762755.720428:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762755.720477:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+13:10532:x1876702140636032:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1149us (1231us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1789762755.720484:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 89 00010000:00010000:2.0:1789762755.721018:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56e9f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.721026:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56e9f5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.721031:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56e9f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.721035:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762755.721037:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56e9f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.721048:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56e9f5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.721056:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d15055da00) 00010000:00010000:2.0:1789762755.721057:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762755.721060:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56e9f5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762755.721064:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56e9f5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789762756.637096:0:11897:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 161110259486ns, next at 161190053115ns, rc = 0 00000001:00080000:0.0:1789762756.645136:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1789762756.645147:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:0.0:1789762756.645162:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967359 is committed 00000004:00080000:0.0:1789762756.645166:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:0.0:1789762756.645173:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967360 is committed 00000100:00100000:1.0:1789762756.645275:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1461e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149000320:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762756.645333:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762756.645367:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149000320 00000100:00100000:2.0:1789762756.645375:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149000320 00000100:00080000:1.0:1789762756.645406:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762756.645427:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789762756.645437:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16fbfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149000320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789762756.645458:0:10283:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1789762756.645481:0:10283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 104857600, mtime: 0x6aad9cae, atime: 0x6aad9c9b, ctime: 0x6aad9cae, blocks: 0x3200b 00010000:00010000:2.0:1789762756.645488:0:10283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56ea03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762756.645501:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=161s v=(0 0) 00010000:00010000:2.0:1789762756.645505:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762756.645510:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56ea03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762756.645522:0:10283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56ea03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762756.645539:0:10283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56ea03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762756.645544:0:10283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56ea03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762756.645558:0:10283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762756.645568:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762756.645575:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56ea03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762756.645584:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762756.645588:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56ea03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762756.645597:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56ea03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762756.645611:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56ea03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762756.645618:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56ea03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762756.645640:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762756.645642:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762756.645643:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762756.646021:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16fbfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149000320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 585us (686us total) trans 4294967427 rc 0/0 00000100:00100000:2.0:1789762756.646028:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:1.0:1789762756.646046:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d1461e3800/2, rc 0, transno 4294967427 00000100:00100000:1.0:1789762756.646059:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1461e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149000320:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789762756.646201:0:11897:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 161119366235ns, next at 132040115768ns, rc = 0 00000004:00080000:2.0:1789762756.646960:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:1.0:1789762756.646991:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762757.287033:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789762757.287055:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149000576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762757.287059:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789762757.287062:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d151b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149000448:0@lo:400:kworker.0 00000100:00100000:2.0:1789762757.287078:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d151b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149000960:0@lo:400:kworker.0 00000100:00100000:3.0:1789762757.287121:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d151b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149000704:0@lo:400:kworker.0 00000100:00100000:1.0:1789762757.287147:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762757.287148:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762757.287155:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762757.287211:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762757.287226:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d151b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149000832:0@lo:400:kworker.0 00000100:00100000:0.0:1789762757.287243:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d151b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149001088:0@lo:400:kworker.0 00000100:00100000:1.0:1789762757.287249:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149000448 00000100:00100000:1.0:1789762757.287257:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149000448 00000100:00100000:2.0:1789762757.287272:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762757.287289:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762757.287302:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149000960 00000100:00100000:3.0:1789762757.287309:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149000960 00000100:00100000:1.0:1789762757.287319:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789762757.287326:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149000704 00000100:00100000:1.0:1789762757.287332:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149000448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762757.287332:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149000704 00000100:00100000:2.0:1789762757.287393:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149000832 00000100:00100000:2.0:1789762757.287399:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149000832 00000100:00100000:0.0:1789762757.287403:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789762757.287414:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789762757.287425:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149000960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762757.287425:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149000448:12345-0@lo:400:kworker.0 Request processed in 84us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762757.287439:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149000704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762757.287448:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789762757.287449:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789762757.287468:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149000832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762757.287480:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149000960:12345-0@lo:400:kworker.0 Request processed in 66us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762757.287491:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789762757.287513:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149001088 00000100:00100000:1.0:1789762757.287518:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149001088 00000100:00100000:3.0:1789762757.287534:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149000704:12345-0@lo:400:kworker.0 Request processed in 101us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762757.287536:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149000576 00000100:00100000:0.0:1789762757.287545:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149000576 00000100:00100000:2.0:1789762757.287551:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149000832:12345-0@lo:400:kworker.0 Request processed in 81us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762757.287557:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789762757.287569:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789762757.287577:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789762757.287587:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149001088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762757.287589:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789762757.287605:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149000576:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762757.287628:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d151b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149000704:0@lo:400:kworker.0 00002000:00000024:0.0:1789762757.287650:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762757.287652:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149001088:12345-0@lo:400:kworker.0 Request processed in 71us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762757.287662:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1789762757.287680:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762757.287681:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d151b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149000960:0@lo:400:kworker.0 00000100:00080000:3.0:1789762757.287691:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762757.287713:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d151b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149000832:0@lo:400:kworker.0 00000100:00100000:0.0:1789762757.287726:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149000576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762757.287750:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789762757.287754:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d151b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149001088:0@lo:400:kworker.0 00000100:00100000:1.0:1789762757.287776:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149000576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762757.287785:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d151b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149000448:0@lo:400:kworker.0 00000100:00100000:1.0:1789762757.492476:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762757.492508:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762757.492534:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762757.492548:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140636160 00000100:00100000:0.0:1789762757.492561:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140636160 00000100:00100000:2.0:1789762757.492567:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140636416 00000100:00100000:2.0:1789762757.492574:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140636416 00000100:00100000:1.0:1789762757.492587:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762757.492602:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140636288 00000100:00100000:3.0:1789762757.492609:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140636288 00000100:00100000:0.0:1789762757.492620:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:1.0:1789762757.492627:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140636544 00000100:00100000:1.0:1789762757.492634:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140636544 00000100:00100000:0.0:1789762757.492636:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140636160:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762757.492636:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1789762757.492653:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140636416:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762757.492658:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:3.0:1789762757.492670:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140636288:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762757.492685:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:1.0:1789762757.492696:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140636544:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762757.492704:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140636160:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 74us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762757.492706:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140636416:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 57us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762757.492715:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140636288:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 45us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762757.492719:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:2.0:1789762757.492724:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:1.0:1789762757.492749:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140636544:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 38us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762757.492749:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:1.0:1789762757.492770:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00080000:3.0:1789762757.492791:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762757.492797:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762757.670947:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762757.799021:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149001216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762757.799081:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762757.799119:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149001216 00000100:00100000:1.0:1789762757.799129:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149001216 00000100:00100000:1.0:1789762757.799185:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789762757.799194:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149001216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762757.799226:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00100000:1.0:1789762757.799289:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149001216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762757.799296:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789762757.799326:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149001216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789762758.694926:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762759.718946:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762760.742912:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789762761.414900:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967427 is committed 00010000:00010000:2.0:1789762761.767002:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762762.407075:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149001344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762762.407199:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762762.407228:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149001728:0@lo:400:kworker.0 00000100:00100000:1.0:1789762762.407315:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149001856:0@lo:400:kworker.0 00000100:00100000:3.0:1789762762.407353:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762762.407407:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762762.407434:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149001600:0@lo:400:kworker.0 00000100:00100000:1.0:1789762762.407491:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789762762.407512:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149001472:0@lo:400:kworker.0 00000100:00100000:0.0:1789762762.407525:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762762.407597:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149002112:0@lo:400:kworker.0 00000100:00100000:1.0:1789762762.407598:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762762.407666:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149001984:0@lo:400:kworker.0 00000100:00100000:0.0:1789762762.407667:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762762.407770:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762762.407778:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149001344 00000100:00100000:0.0:1789762762.407791:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149001344 00000100:00100000:1.0:1789762762.407939:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149001856 00000100:00100000:1.0:1789762762.407949:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149001856 00000100:00100000:0.0:1789762762.407998:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789762762.408026:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149001344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762762.408030:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149002112 00000100:00100000:1.0:1789762762.408040:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149002112 00000100:00100000:3.0:1789762762.408067:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149001728 00000100:00100000:3.0:1789762762.408078:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149001728 00002000:00000024:0.0:1789762762.408097:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762762.408108:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789762762.408130:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149001856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762762.408161:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149001600 00000100:00100000:3.0:1789762762.408167:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149001600 00000100:00100000:3.0:1789762762.408221:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149001984 00000100:00100000:0.0:1789762762.408226:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149001344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 204us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762762.408228:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149001984 00000100:00100000:1.0:1789762762.408245:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149001856:12345-0@lo:400:kworker.0 Request processed in 117us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762762.408256:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789762762.408269:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789762762.408278:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789762762.408298:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149001728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762762.408339:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789762762.408340:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789762762.408364:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149001600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762762.408378:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149002112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762762.408394:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149001728:12345-0@lo:400:kworker.0 Request processed in 100us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762762.408412:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789762762.408456:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789762762.408469:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149001984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762762.408507:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149001600:12345-0@lo:400:kworker.0 Request processed in 149us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762762.408529:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149002112:12345-0@lo:400:kworker.0 Request processed in 161us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762762.408531:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789762762.408549:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149001984:12345-0@lo:400:kworker.0 Request processed in 75us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762762.408564:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789762762.408576:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1789762762.408603:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762762.408614:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762762.408618:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762762.408645:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149001472 00000100:00100000:1.0:1789762762.408654:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149001472 00000100:00100000:1.0:1789762762.408772:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789762762.408802:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149001472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762762.408971:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149001728:0@lo:400:kworker.0 00000100:00100000:1.0:1789762762.408994:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149001472:12345-0@lo:400:kworker.0 Request processed in 199us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762762.409013:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789762762.409064:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149001600:0@lo:400:kworker.0 00000100:00100000:0.0:1789762762.409128:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149002112:0@lo:400:kworker.0 00000100:00100000:1.0:1789762762.409226:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149001472:0@lo:400:kworker.0 00000100:00100000:1.0:1789762762.409255:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149001984:0@lo:400:kworker.0 00000100:00100000:1.0:1789762762.409282:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967427 gen 2 00000004:00080000:1.0:1789762762.409288:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d1461e3800, transno 4294967427 00000100:00100000:1.0:1789762762.409316:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149001856:0@lo:400:kworker.0 00000100:00100000:1.0:1789762762.409346:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149001344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762762.612528:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762762.612565:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762762.612593:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762762.612596:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140636672 00000100:00100000:2.0:1789762762.612607:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140636672 00000100:00100000:0.0:1789762762.612619:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762762.612659:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140636928 00000100:00100000:0.0:1789762762.612660:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140636800 00000100:00100000:0.0:1789762762.612666:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140636800 00000100:00100000:1.0:1789762762.612670:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140637056 00000100:00100000:2.0:1789762762.612676:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 237 00000100:00100000:3.0:1789762762.612677:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140636928 00000100:00100000:1.0:1789762762.612680:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140637056 00000100:00100000:2.0:1789762762.612712:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140636672:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762762.612750:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1789762762.612763:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:1.0:1789762762.612767:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:0.0:1789762762.612768:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140636800:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762762.612781:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140636928:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762762.612788:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140637056:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762762.612802:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140636672:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 110us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762762.612813:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 237 00000100:00100000:0.0:1789762762.612818:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140636800:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 58us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762762.612828:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1789762762.612874:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140636928:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 97us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762762.612883:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140637056:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 102us (261us total) trans 0 rc 0/0 00000100:00080000:0.0:1789762762.612885:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762762.612888:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00080000:0.0:1789762762.612901:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762762.612901:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00010000:00010000:1.0:1789762762.790950:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762762.919004:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149002240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762762.919070:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762762.919127:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149002240 00000100:00100000:1.0:1789762762.919137:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149002240 00000100:00100000:1.0:1789762762.919190:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789762762.919202:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149002240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762762.919232:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762762.919275:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149002240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762762.919294:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789762762.919318:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149002240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762763.814992:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762764.838974:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762765.862960:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762766.886951:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762767.527121:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149002368:0@lo:400:kworker.0 00000100:00100000:2.0:1789762767.527135:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149002496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762767.527159:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149002624:0@lo:400:kworker.0 00000100:00100000:0.0:1789762767.527257:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149002752:0@lo:400:kworker.0 00000100:00100000:3.0:1789762767.527287:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762767.527306:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762767.527323:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762767.527364:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149002496 00000100:00100000:0.0:1789762767.527377:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149002496 00000100:00100000:3.0:1789762767.527391:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149002880:0@lo:400:kworker.0 00000100:00100000:2.0:1789762767.527406:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149003008:0@lo:400:kworker.0 00000100:00100000:1.0:1789762767.527416:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149003136:0@lo:400:kworker.0 00000100:00100000:3.0:1789762767.527460:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762767.527484:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789762767.527514:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149002496:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762767.527515:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762767.527528:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149002368 00000100:00100000:1.0:1789762767.527537:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149002368 00002000:00000024:0.0:1789762767.527598:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762767.527601:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149002880 00000100:00100000:3.0:1789762767.527612:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149002880 00000100:00100000:1.0:1789762767.527638:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789762767.527682:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149002624 00000100:00100000:1.0:1789762767.527704:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149002368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762767.527712:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149002624 00000100:00100000:0.0:1789762767.527745:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149002496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 244us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762767.527759:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789762767.527762:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789762767.527793:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149002880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762767.527801:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149003008 00000100:00100000:1.0:1789762767.527812:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149002368:12345-0@lo:400:kworker.0 Request processed in 153us (523us total) trans 0 rc 0/0 00000100:00080000:0.0:1789762767.527814:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762767.527815:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149003008 00000100:00080000:0.0:1789762767.527828:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762767.527836:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:0.0:1789762767.527840:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762767.527919:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149002880:12345-0@lo:400:kworker.0 Request processed in 136us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762767.527921:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762767.527932:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789762767.527941:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789762767.527974:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149002624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762767.527982:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149002752 00000100:00100000:1.0:1789762767.527995:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149002752 00000100:00100000:3.0:1789762767.528020:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762767.528041:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789762767.528062:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149003008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762767.528092:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789762767.528103:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149002624:12345-0@lo:400:kworker.0 Request processed in 147us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762767.528115:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149002624:0@lo:400:kworker.0 00000100:00100000:1.0:1789762767.528125:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149002752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762767.528135:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789762767.528146:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149003008:12345-0@lo:400:kworker.0 Request processed in 83us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762767.528167:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789762767.528249:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149002752:12345-0@lo:400:kworker.0 Request processed in 137us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762767.528261:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789762767.528273:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149003008:0@lo:400:kworker.0 00000100:00100000:3.0:1789762767.528291:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149003136 00000100:00100000:3.0:1789762767.528300:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149003136 00000100:00100000:0.0:1789762767.528320:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149002496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762767.528360:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149002752:0@lo:400:kworker.0 00000100:00100000:2.0:1789762767.528363:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149002880:0@lo:400:kworker.0 00000100:00100000:3.0:1789762767.528367:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789762767.528397:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149003136:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789762767.528408:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762767.528410:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149002368:0@lo:400:kworker.0 00000100:00100000:3.0:1789762767.528473:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149003136:12345-0@lo:400:kworker.0 Request processed in 79us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762767.528485:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789762767.528517:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149003136:0@lo:400:kworker.0 00000100:00100000:2.0:1789762767.732647:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762767.732726:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762767.732746:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140637184 00000100:00100000:0.0:1789762767.732759:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140637184 00000100:00100000:2.0:1789762767.732799:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762767.732802:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140637312 00000100:00100000:3.0:1789762767.732812:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140637312 00000100:00100000:0.0:1789762767.732888:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 239 00000100:00100000:0.0:1789762767.732913:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140637184:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762767.732922:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762767.732923:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00080000:1.0:1789762767.732928:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762767.732944:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140637312:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762767.732982:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140637440 00000100:00100000:2.0:1789762767.732990:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140637440 00000100:00100000:1.0:1789762767.733003:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140637568 00000100:00100000:0.0:1789762767.733017:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140637184:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 107us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762767.733018:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140637568 00000100:00100000:3.0:1789762767.733018:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140637312:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762767.733039:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 239 00000100:00100000:2.0:1789762767.733049:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1789762767.733055:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:2.0:1789762767.733068:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140637440:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762767.733104:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:3.0:1789762767.733120:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140637568:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:1.0:1789762767.733125:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762767.733130:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140637440:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 64us (331us total) trans 0 rc 0/0 00000100:00080000:1.0:1789762767.733135:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762767.733153:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1789762767.733200:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140637568:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 81us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762767.733210:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00010000:00010000:2.0:1789762767.911036:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762768.039114:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762768.039143:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149003264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762768.039219:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762768.039306:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149003264 00000100:00100000:2.0:1789762768.039320:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149003264 00000100:00100000:2.0:1789762768.039398:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789762768.039409:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149003264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762768.039463:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762768.039527:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149003264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762768.039535:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789762768.039591:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149003264:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789762768.935040:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762769.959009:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762770.982909:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762772.007055:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762772.647085:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1461e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149003520:0@lo:400:kworker.0 00000100:00100000:0.0:1789762772.647197:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762772.647204:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149003776:0@lo:400:kworker.0 00000100:00100000:1.0:1789762772.647219:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149003648:0@lo:400:kworker.0 00000100:00100000:2.0:1789762772.647317:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762772.647338:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149003392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762772.647341:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149004032:0@lo:400:kworker.0 00000100:00100000:2.0:1789762772.647415:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762772.647439:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762772.647465:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149003520 00000100:00100000:0.0:1789762772.647479:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149003520 00000100:00100000:2.0:1789762772.647494:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17414d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149004160:0@lo:400:kworker.0 00000100:00100000:1.0:1789762772.647510:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149003904:0@lo:400:kworker.0 00000100:00100000:2.0:1789762772.647576:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762772.647610:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149003776 00000100:00100000:0.0:1789762772.647649:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789762772.647652:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149003776 00000100:00100000:0.0:1789762772.647667:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149003520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762772.647679:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149003648 00000100:00100000:2.0:1789762772.647686:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149003648 00000100:00100000:1.0:1789762772.647728:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789762772.647732:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149003520:12345-0@lo:400:kworker.0 Request processed in 70us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762772.647740:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789762772.647746:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789762772.647749:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149003776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762772.647753:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149003648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762772.647791:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149003392 00000100:00100000:0.0:1789762772.647797:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149003392 00000100:00100000:2.0:1789762772.647830:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149003648:12345-0@lo:400:kworker.0 Request processed in 71us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762772.647866:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789762772.647866:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789762772.647878:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149003776:12345-0@lo:400:kworker.0 Request processed in 137us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762772.647882:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149003392:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762772.647899:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789762772.647900:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149004160 00000100:00100000:2.0:1789762772.647906:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149004160 00002000:00000024:0.0:1789762772.647916:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789762772.647933:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762772.647942:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762772.647956:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789762772.647965:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149003392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762772.647973:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149004160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762772.647977:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789762772.647991:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149003776:0@lo:400:kworker.0 00000100:00100000:0.0:1789762772.648025:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762772.648035:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149004160:12345-0@lo:400:kworker.0 Request processed in 69us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762772.648044:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789762772.648047:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149004032 00000100:00100000:1.0:1789762772.648054:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149004032 00000100:00100000:0.0:1789762772.648079:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1461e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149003520:0@lo:400:kworker.0 00000100:00100000:2.0:1789762772.648093:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149003648:0@lo:400:kworker.0 00000100:00100000:1.0:1789762772.648108:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789762772.648121:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149004032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762772.648124:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17414d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149004160:0@lo:400:kworker.0 00000100:00100000:0.0:1789762772.648134:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762772.648179:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149003904 00000100:00100000:2.0:1789762772.648183:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149003904 00000100:00100000:0.0:1789762772.648186:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149003392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762772.648206:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149004032:12345-0@lo:400:kworker.0 Request processed in 86us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762772.648218:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789762772.648228:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789762772.648231:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149004032:0@lo:400:kworker.0 00000100:00100000:2.0:1789762772.648243:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149003904:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762772.648249:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789762772.648255:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762772.648287:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149003904:12345-0@lo:400:kworker.0 Request processed in 50us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762772.648294:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789762772.648326:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149003904:0@lo:400:kworker.0 00000100:00100000:0.0:1789762772.852484:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762772.852518:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762772.852537:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762772.852563:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762772.852566:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140637824 00000100:00100000:1.0:1789762772.852579:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140637824 00000100:00100000:2.0:1789762772.852586:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140637696 00000100:00100000:3.0:1789762772.852589:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140637952 00000100:00100000:0.0:1789762772.852593:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140638080 00000100:00100000:2.0:1789762772.852593:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140637696 00000100:00100000:3.0:1789762772.852596:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140637952 00000100:00100000:0.0:1789762772.852610:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140638080 00000100:00100000:2.0:1789762772.852675:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:3.0:1789762772.852676:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1789762772.852677:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:0.0:1789762772.852689:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:2.0:1789762772.852697:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140637696:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762772.852702:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140637824:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762772.852703:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140637952:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762772.852704:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140638080:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762772.852790:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140637952:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762772.852793:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140638080:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 87us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762772.852793:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140637824:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 94us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762772.852794:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140637696:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 94us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762772.852803:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1789762772.852814:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:2.0:1789762772.852819:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:1.0:1789762772.852825:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00080000:1.0:1789762772.852880:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789762772.852886:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789762773.030912:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762773.158970:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d150cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149004288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762773.159034:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762773.159075:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149004288 00000100:00100000:2.0:1789762773.159083:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149004288 00000100:00100000:2.0:1789762773.159124:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789762773.159132:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149004288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762773.159162:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762773.159206:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149004288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762773.159214:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789762773.159241:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d150cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149004288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762773.997396:0:12363:0:(nrs_tbf.c:670:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff95d158361e00 key uid={500} rule@0xffff95d143031300 gen 0 rate 5 depth 3 token 0 deadline 160132412096 time 160132519769 state 0x6 ref 0 00000100:00100000:1.0:1789762773.997412:0:12363:0:(nrs_tbf.c:670:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff95d174132800 key uid={0} rule@0xffff95d150d2d100 gen 0 rate 10000 depth 3 token 2 deadline 118263729893 time 119904071683 state 0x6 ref 0 00010000:00010000:1.0:1789762774.054978:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762775.079111:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762776.103061:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762777.127104:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762777.473094:0:12412:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:1.0:1789762777.473112:0:12412:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d150482e00 rate 10000 gen 0 00000100:00100000:1.0:1789762777.473163:0:12412:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:1.0:1789762777.473166:0:12412:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d150482500 rate 10000 gen 0 00000100:00100000:1.0:1789762777.473297:0:12412:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X10, dynamic 0, field: gid, str: 500 00000100:00100000:1.0:1789762777.473312:0:12412:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:1.0:1789762777.473317:0:12412:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X10, dynamic 0, field: gid, str: 500 00000100:00100000:1.0:1789762777.473320:0:12412:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d150482000 rate 5 gen 0 00000100:00100000:1.0:1789762777.473324:0:12412:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:1.0:1789762777.473327:0:12412:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X10, dynamic 0, field: gid, str: 500 00000100:00100000:1.0:1789762777.473330:0:12412:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d150482400 rate 5 gen 0 00000100:00100000:2.0:1789762777.483669:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762777.483715:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140638208 00000100:00100000:3.0:1789762777.483729:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140638208 00000100:00080000:0.0:1789762777.483793:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762777.483815:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:3.0:1789762777.483827:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+5:11035:x1876702140638208:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:3.0:1789762777.483890:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762777.483919:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e61b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.484015:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56ea11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.484047:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56ea11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.484062:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56ea11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762777.484100:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789762777.484104:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762777.484123:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56ea11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.484150:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e61b expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.484167:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56ea11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e61b expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.484174:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055df00) 00010000:00010000:3.0:1789762777.484178:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762777.484181:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030200, rc 0) 00000100:00100000:3.0:1789762777.484268:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+6:11035:x1876702140638208:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 444us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762777.484280:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:1.0:1789762777.485688:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762777.485748:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140638336 00000100:00100000:2.0:1789762777.485762:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140638336 00000100:00100000:1.0:1789762777.485766:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762777.485799:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140638592 00000100:00100000:2.0:1789762777.485803:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140638592 00000100:00100000:1.0:1789762777.485844:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:2.0:1789762777.485923:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:1.0:1789762777.485929:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140638336:12345-192.168.203.31@tcp:41:mkdir.0 00000100:00100000:2.0:1789762777.485937:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+7:11035:x1876702140638592:12345-192.168.203.31@tcp:36:mkdir.0 00000004:00000024:1.0:1789762777.485974:0:7603:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00010000:00010000:2.0:1789762777.485975:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762777.485995:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56ea11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e61b expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.486026:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055df00) 00010000:00010000:2.0:1789762777.486037:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762777.486052:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140638336:12345-192.168.203.31@tcp:41:mkdir.0 Request processed in 127us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762777.486061:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00010000:00010000:2.0:1789762777.486253:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ea18 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.486278:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ea18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.486285:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ea18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.486294:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ea1f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.486299:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ea1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.486304:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ea1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762777.487503:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00010000:00010000:2.0:1789762777.487530:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ea18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.487543:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ea18 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.487549:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ea18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.487554:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762777.487559:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ea18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.487565:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ea18 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.487573:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3fa00) 00010000:00010000:2.0:1789762777.487575:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762777.487592:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ea18 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.487601:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ea18 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762777.487617:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c6a1472 reply state 00000000d9a33f6a transno 4294967361 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ea1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762777.487625:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762777.487674:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+7:11035:x1876702140638592:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 1743us (1912us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1789762777.487697:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00010000:00010000:2.0:1789762777.488246:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ea1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.488283:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ea1f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.488288:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ea1f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.488292:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762777.488295:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ea1f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.488300:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ea1f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.488308:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d143e3f900) 00010000:00010000:2.0:1789762777.488310:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762777.488312:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ea1f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.488317:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ea1f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762777.492458:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762777.492488:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140638720 00000100:00100000:3.0:1789762777.492528:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140638720 00000100:00100000:3.0:1789762777.492562:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:3.0:1789762777.492569:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+6:11036:x1876702140638720:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762777.492594:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762777.492605:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e622 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.492637:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56ea2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.492645:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56ea2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.492652:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56ea2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762777.492668:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789762777.492670:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762777.492681:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56ea2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.492694:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e622 expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.492704:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56ea2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e622 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.492719:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d200) 00010000:00010000:3.0:1789762777.492722:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762777.492724:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030600, rc 0) 00000100:00100000:3.0:1789762777.492755:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+7:11036:x1876702140638720:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 187us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762777.492760:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:1.0:1789762777.493604:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762777.493650:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140638976 00000100:00100000:2.0:1789762777.493656:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140638976 00000100:00100000:2.0:1789762777.493691:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:2.0:1789762777.493699:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+7:11036:x1876702140638976:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762777.493709:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762777.493711:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789762777.493723:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56ea2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e622 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493743:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d200) 00010000:00010000:2.0:1789762777.493749:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762777.493756:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ea34 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e629 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493853:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ea3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493862:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ea3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493869:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ea3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493878:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ea42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493883:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ea42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493888:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ea42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493932:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ea49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493938:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ea49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493943:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ea49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762777.493956:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00010000:00010000:2.0:1789762777.493967:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ea49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493971:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ea49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493977:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ea49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493981:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762777.493983:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ea49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493988:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ea49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.493995:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:2.0:1789762777.493997:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762777.494000:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ea49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494004:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ea49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494017:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ea3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494022:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ea3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494026:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ea3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494036:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762777.494039:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ea3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494044:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ea3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494050:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3fa00) 00010000:00010000:2.0:1789762777.494051:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762777.494053:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ea3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494058:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ea3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494064:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ea42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494069:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ea42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494074:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ea42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494078:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762777.494080:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ea42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494084:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ea42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494098:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d143e3f700) 00010000:00010000:2.0:1789762777.494100:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762777.494103:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ea42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494123:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ea42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494146:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ea34 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e629 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494154:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3fa00) 00010000:00010000:2.0:1789762777.494156:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762777.494160:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ea34 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e629 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.494171:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148888a00, rc 0) 00000100:00100000:2.0:1789762777.494208:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+6:11036:x1876702140638976:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 509us (605us total) trans 0 rc 301/301 00000100:00100000:2.0:1789762777.494215:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:1.0:1789762777.494964:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762777.494994:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140639104 00000100:00100000:2.0:1789762777.494999:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140639104 00000100:00100000:2.0:1789762777.495029:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:2.0:1789762777.495038:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+6:11036:x1876702140639104:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762777.495046:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762777.495055:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56ea50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e630 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.495092:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889a00/0xd08452c77c56ea57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.495100:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889a00/0xd08452c77c56ea57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.495107:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889a00/0xd08452c77c56ea57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762777.495119:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762777.495122:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762777.495132:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889a00/0xd08452c77c56ea57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.495143:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56ea50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e630 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.495154:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889a00/0xd08452c77c56ea57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e630 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.495159:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:2.0:1789762777.495161:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762777.495163:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148889a00, rc 0) 00000100:00100000:2.0:1789762777.495193:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+7:11036:x1876702140639104:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 158us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762777.495199:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:3.0:1789762777.496087:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.496116:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140639360 00000100:00100000:1.0:1789762777.496122:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140639360 00000100:00100000:1.0:1789762777.496152:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:1.0:1789762777.496160:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+7:11036:x1876702140639360:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789762777.496168:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762777.496178:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56ea5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e637 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496209:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496224:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496230:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496240:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496246:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496250:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762777.496298:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00010000:00010000:1.0:1789762777.496353:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496360:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496367:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496373:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762777.496378:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496385:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496406:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:1.0:1789762777.496408:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762777.496411:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496415:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496439:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496446:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496452:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496456:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762777.496459:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496465:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496473:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d14abf2100) 00010000:00010000:1.0:1789762777.496476:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762777.496478:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496483:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496551:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56ea5e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e637 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496563:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:1.0:1789762777.496566:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789762777.496571:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56ea5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e637 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.496595:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51600, rc 0) 00000100:00100000:1.0:1789762777.496628:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+8:11036:x1876702140639360:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 469us (542us total) trans 4294967362 rc 301/301 00000100:00100000:1.0:1789762777.496637:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:1.0:1789762777.497489:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.497513:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140639616 00000100:00100000:0.0:1789762777.497519:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140639616 00000100:00100000:0.0:1789762777.497553:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:0.0:1789762777.497562:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+8:11036:x1876702140639616:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:0.0:1789762777.497621:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5e000/0xd08452c77c56ea7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.497635:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5e000/0xd08452c77c56ea7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.497647:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5e000/0xd08452c77c56ea7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762777.497770:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025a6df8d reply state 0000000052735d8f transno 4294967363 ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5e000/0xd08452c77c56ea7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762777.497777:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789762777.497782:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00000100:00100000:0.0:1789762777.497829:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+10:11036:x1876702140639616:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 269us (342us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789762777.497856:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00010000:00010000:1.0:1789762777.498485:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5e000/0xd08452c77c56ea7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.498494:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5e000/0xd08452c77c56ea7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762777.498503:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:1.0:1789762777.498508:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5e000/0xd08452c77c56ea7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.498517:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d173f5e000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762777.498522:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5e000/0xd08452c77c56ea7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.498529:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5e000/0xd08452c77c56ea7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.498554:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d151e90100) 00010000:00010000:1.0:1789762777.498557:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789762777.498561:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5e000/0xd08452c77c56ea7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.498565:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5e000/0xd08452c77c56ea7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762777.498594:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140639872 00000100:00100000:0.0:1789762777.498609:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140639872 00000100:00100000:0.0:1789762777.498652:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1789762777.498664:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+9:11036:x1876702140639872:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1789762777.498790:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+10:11036:x1876702140639872:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 130us (292us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789762777.498796:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:3.0:1789762777.502211:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.502249:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140640000 00000100:00100000:1.0:1789762777.502254:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140640000 00000100:00100000:1.0:1789762777.502287:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:1.0:1789762777.502296:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+10:11037:x1876702140640000:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:1.0:1789762777.502306:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762777.502313:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56ea81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e63e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502344:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502351:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502357:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502366:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502371:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502386:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502428:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ea96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502434:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ea96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502439:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ea96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762777.502453:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00000004:00200000:1.0:1789762777.502455:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762777.502467:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ea96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502473:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502478:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502483:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502487:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762777.502490:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502494:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502511:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:1.0:1789762777.502514:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762777.502518:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502525:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ea88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502538:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502546:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502553:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502559:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762777.502562:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502567:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502573:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d14abf2100) 00010000:00010000:1.0:1789762777.502575:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762777.502591:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502597:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ea8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502629:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56ea81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e63e expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502642:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ea96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e63e expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.502650:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:1.0:1789762777.502652:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762777.502655:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50c00, rc 0) 00000100:00100000:1.0:1789762777.502692:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+11:11037:x1876702140640000:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 398us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762777.502698:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:1.0:1789762777.503734:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762777.503768:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140640256 00000100:00100000:3.0:1789762777.503774:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140640256 00000100:00100000:3.0:1789762777.503806:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:3.0:1789762777.503814:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+11:11037:x1876702140640256:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:3.0:1789762777.504109:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762777.504122:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ea96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e63e expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.504134:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:3.0:1789762777.504140:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762777.504154:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.504161:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.504167:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762777.504285:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033ae40d4 reply state 00000000b353d66a transno 4294967365 ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762777.504291:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762777.504294:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00000100:00100000:3.0:1789762777.504336:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+12:11037:x1876702140640256:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 524us (602us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789762777.504342:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00010000:00010000:0.0:1789762777.504913:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.504922:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.504927:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.504931:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762777.504933:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.504937:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.504946:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055dc00) 00010000:00010000:0.0:1789762777.504948:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789762777.504951:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.504955:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56ea9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762777.518326:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762777.518436:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140640384 00000100:00100000:3.0:1789762777.518444:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140640384 00000100:00100000:3.0:1789762777.518564:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:3.0:1789762777.518576:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+11:11041:x1876702140640384:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:3.0:1789762777.518618:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762777.518632:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56eaa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e645 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.518747:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56eaab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.518757:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56eaab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.518765:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56eaab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.518778:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56eab2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.518783:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56eab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.518796:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56eab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.518955:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56eab9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.518966:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56eab9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.518975:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56eab9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762777.518991:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00000004:00200000:3.0:1789762777.518994:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762777.519030:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56eab9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519050:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56eaab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519056:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56eaab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519064:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56eaab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519071:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762777.519075:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56eaab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519081:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56eaab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519104:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:3.0:1789762777.519108:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762777.519112:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56eaab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519119:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56eaab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519135:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56eab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519141:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56eab2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519148:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56eab2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519154:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762777.519159:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56eab2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519165:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56eab2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519177:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d15055de00) 00010000:00010000:3.0:1789762777.519180:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762777.519183:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56eab2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519189:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56eab2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519249:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56eaa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e645 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519266:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56eab9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e645 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.519273:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:3.0:1789762777.519275:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789762777.519277:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030800, rc 0) 00000100:00100000:3.0:1789762777.519322:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+12:11041:x1876702140640384:12345-192.168.203.31@tcp:101:touch.500 Request processed in 750us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762777.519328:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:3.0:1789762777.520237:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.521118:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140640640 00000100:00100000:1.0:1789762777.521125:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140640640 00000100:00100000:1.0:1789762777.521171:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:1.0:1789762777.521182:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+12:11041:x1876702140640640:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:1.0:1789762777.521209:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762777.521222:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56eac0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e64c expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.521313:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eac7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.521322:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eac7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.521336:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eac7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.521351:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56eace lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.521357:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56eace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.521363:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56eace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789762777.522248:0:6681:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00000004:00080000:1.0:1789762777.522266:0:6681:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789762777.522463:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ead5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.522474:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ead5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.522481:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ead5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.522515:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eac7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.522525:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eac7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.522549:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eac7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.522569:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762777.522574:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eac7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.522596:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eac7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.522626:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:1.0:1789762777.522629:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762777.522634:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eac7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.522642:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eac7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762777.522654:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004cd60b40 reply state 0000000034eabdd1 transno 4294967366 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56eace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762777.522660:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789762777.522681:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56eac0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e64c expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.522691:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ead5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e64c expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.522697:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:1.0:1789762777.522698:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762777.522700:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51c00, rc 0) 00000100:00100000:1.0:1789762777.522733:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+15:11041:x1876702140640640:12345-192.168.203.31@tcp:101:touch.500 Request processed in 1555us (2497us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789762777.522745:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 101 00010000:00010000:2.0:1789762777.523304:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56eace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.523320:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56eace lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.523325:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56eace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.523329:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762777.523332:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56eace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.523337:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56eace lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.523348:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0xf4d4877e (ffff95d14abf2100) 00010000:00010000:2.0:1789762777.523351:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762777.523355:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56eace lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.523361:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56eace lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762777.523754:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762777.523780:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140640896 00000100:00100000:3.0:1789762777.523816:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140640896 00000100:00100000:3.0:1789762777.523900:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:3.0:1789762777.523928:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+14:11041:x1876702140640896:12345-192.168.203.31@tcp:36:touch.500 00010000:00010000:3.0:1789762777.523961:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762777.523978:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ead5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e64c expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.523993:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:3.0:1789762777.524025:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762777.524054:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eae3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.524076:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.524085:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762777.524196:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9f56396 reply state 00000000173e15d1 transno 4294967367 ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762777.524202:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762777.524267:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+15:11041:x1876702140640896:12345-192.168.203.31@tcp:36:touch.500 Request processed in 359us (514us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789762777.524275:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00010000:00010000:3.0:1789762777.524776:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.524783:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eae3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.524788:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eae3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.524792:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762777.524795:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eae3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.524799:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eae3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.524809:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d15055d900) 00010000:00010000:3.0:1789762777.524892:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762777.524896:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eae3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.524904:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eae3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762777.525013:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.525047:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140641024 00000100:00100000:0.0:1789762777.525059:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140641024 00000100:00100000:0.0:1789762777.525091:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:0.0:1789762777.525098:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+14:11041:x1876702140641024:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:0.0:1789762777.525126:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762777.525139:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5ee00/0xd08452c77c56eaea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e653 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.525174:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5ee00/0xd08452c77c56eaea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e653 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.525186:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5ee00/0xd08452c77c56eaea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e653 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.525202:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d151e90b00) 00010000:00010000:0.0:1789762777.525205:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789762777.525208:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d173f5ee00, rc 0) 00000100:00100000:0.0:1789762777.525249:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+15:11041:x1876702140641024:12345-192.168.203.31@tcp:101:touch.500 Request processed in 149us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762777.525274:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:3.0:1789762777.526031:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.526065:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140641152 00000100:00100000:0.0:1789762777.526070:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140641152 00000100:00100000:3.0:1789762777.526079:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00080000:1.0:1789762777.526108:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762777.526113:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140641280 00000100:00100000:0.0:1789762777.526116:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140641280 00000100:00100000:1.0:1789762777.526129:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1789762777.526136:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:1.0:1789762777.526141:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140641152:12345-192.168.203.31@tcp:2:touch.500 00000100:00100000:0.0:1789762777.526146:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1876702140641280:12345-192.168.203.31@tcp:8:touch.500 00010000:00080000:0.0:1789762777.526171:0:8803:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:0.0:1789762777.526223:0:8803:0:(genops.c:1385:class_connect()) connect: client 77777931-b235-4c03-82d2-4b1d12553008, cookie 0xd08452c77c56eaf1 00002000:00100000:0.0:1789762777.526242:0:8803:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 77777931-b235-4c03-82d2-4b1d12553008/ffff95d148e74000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 30670848 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789762777.526269:0:8803:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789762777.526484:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140641152:12345-192.168.203.31@tcp:2:touch.500 Request processed in 343us (449us total) trans 4294967428 rc 0/0 00000100:00100000:1.0:1789762777.526494:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00002000:00080000:0.0:1789762777.526566:0:8803:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789762777.526610:0:8803:0:(import.c:65:import_set_state_nolock()) ffff95d148e77000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789762777.526665:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2341:x1876702140641280:12345-192.168.203.31@tcp:8:touch.500 Request processed in 521us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762777.526672:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1789762777.527174:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.527280:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140641408 00000100:00100000:1.0:1789762777.527288:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140641408 00000100:00080000:3.0:1789762777.527330:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762777.527363:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:1.0:1789762777.527373:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+6:0:x1876702140641408:12345-192.168.203.31@tcp:2:touch.500 00000100:00100000:1.0:1789762777.539137:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+7:0:x1876702140641408:12345-192.168.203.31@tcp:2:touch.500 Request processed in 11762us (11963us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789762777.539148:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000001:00100000:1.0:1789762777.539174:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000001:00080000:1.0:1789762777.539186:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:3.0:1789762777.539970:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.540002:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140641664 00000100:00100000:0.0:1789762777.540010:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140641664 00000100:00100000:0.0:1789762777.540045:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1789762777.540054:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+15:11041:x1876702140641664:12345-192.168.203.31@tcp:35:touch.500 00000100:00100000:0.0:1789762777.540262:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+16:11041:x1876702140641664:12345-192.168.203.31@tcp:35:touch.500 Request processed in 208us (292us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1789762777.540271:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1789762777.557349:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.557396:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140641920 00000100:00100000:1.0:1789762777.557403:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140641920 00000100:00100000:1.0:1789762777.557437:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:1.0:1789762777.557444:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+16:11045:x1876702140641920:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:1.0:1789762777.557460:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762777.557478:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56eaf8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e65a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.557600:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eaff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.557622:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eaff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.557634:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eaff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.557646:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56eb06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.557651:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56eb06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.557655:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56eb06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789762777.558143:0:6681:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00000004:00080000:1.0:1789762777.558148:0:6681:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7:0x0], index 0: 0 00010000:00010000:1.0:1789762777.558270:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.558278:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.558284:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.558314:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eaff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.558319:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eaff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.558333:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eaff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.558338:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762777.558342:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eaff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.558348:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eaff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.558358:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:1.0:1789762777.558360:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762777.558363:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eaff lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.558368:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eaff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762777.558377:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fefaf68c reply state 0000000035e64f50 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56eb06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762777.558383:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789762777.558403:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56eaf8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e65a expref: 19 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.558414:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e65a expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.558420:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d14abf2300) 00010000:00010000:1.0:1789762777.558422:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762777.558428:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50e00, rc 0) 00000100:00100000:1.0:1789762777.558468:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+19:11045:x1876702140641920:12345-192.168.203.31@tcp:101:touch.500 Request processed in 1026us (1123us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1789762777.558474:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 104 00010000:00010000:2.0:1789762777.559029:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56eb06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.559038:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56eb06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.559043:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56eb06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.559047:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762777.559055:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56eb06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.559060:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56eb06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.559068:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x636661f9 (ffff95d14abf2b00) 00010000:00010000:2.0:1789762777.559070:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762777.559072:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56eb06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.559076:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c56eb06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762777.559634:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762777.559683:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140642176 00000100:00100000:2.0:1789762777.559689:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140642176 00000100:00100000:2.0:1789762777.559730:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:2.0:1789762777.559740:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+18:11045:x1876702140642176:12345-192.168.203.31@tcp:36:touch.500 00010000:00010000:2.0:1789762777.559771:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762777.559785:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e65a expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.559797:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d14abf2300) 00010000:00010000:2.0:1789762777.559803:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762777.559829:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56eb1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.559886:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56eb1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.559893:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56eb1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762777.559958:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ca4c812 reply state 000000005b002131 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56eb1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762777.559964:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762777.560024:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+19:11045:x1876702140642176:12345-192.168.203.31@tcp:36:touch.500 Request processed in 287us (395us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789762777.560030:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 105 00010000:00010000:0.0:1789762777.560556:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56eb1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.560564:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56eb1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.560570:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56eb1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.560574:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762777.560576:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56eb1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.560596:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56eb1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.560615:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:0.0:1789762777.560619:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762777.560623:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56eb1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.560630:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56eb1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762777.560764:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.560804:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140642304 00000100:00100000:0.0:1789762777.560809:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140642304 00000100:00100000:3.0:1789762777.560879:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:3.0:1789762777.560890:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+18:11045:x1876702140642304:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:3.0:1789762777.560900:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762777.560910:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eb22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e661 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.560937:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eb22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e661 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.560964:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eb22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e661 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762777.560977:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d15055d900) 00010000:00010000:3.0:1789762777.560986:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789762777.560988:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030c00, rc 0) 00000100:00100000:3.0:1789762777.561017:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+19:11045:x1876702140642304:12345-192.168.203.31@tcp:101:touch.500 Request processed in 132us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762777.561040:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:3.0:1789762777.561957:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762777.561994:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.562021:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140642432 00000100:00100000:0.0:1789762777.562026:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140642432 00000100:00100000:1.0:1789762777.562046:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140642560 00000100:00100000:1.0:1789762777.562052:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140642560 00000100:00100000:0.0:1789762777.562065:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:0.0:1789762777.562092:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140642432:12345-192.168.203.31@tcp:2:touch.500 00000100:00100000:2.0:1789762777.562109:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:2.0:1789762777.562122:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140642560:12345-192.168.203.31@tcp:2:touch.500 00000100:00100000:0.0:1789762777.562349:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140642432:12345-192.168.203.31@tcp:2:touch.500 Request processed in 256us (407us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789762777.562351:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140642560:12345-192.168.203.31@tcp:2:touch.500 Request processed in 228us (351us total) trans 4294967429 rc 0/0 00000100:00100000:0.0:1789762777.562360:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:2.0:1789762777.562371:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1789762777.563277:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.563310:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140642816 00000100:00100000:0.0:1789762777.563315:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140642816 00000100:00100000:0.0:1789762777.563340:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1789762777.563345:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+19:11045:x1876702140642816:12345-192.168.203.31@tcp:35:touch.500 00000100:00100000:0.0:1789762777.563470:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+20:11045:x1876702140642816:12345-192.168.203.31@tcp:35:touch.500 Request processed in 125us (193us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789762777.563476:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:3.0:1789762777.577063:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.577108:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140643072 00000100:00100000:1.0:1789762777.577113:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140643072 00000100:00100000:1.0:1789762777.577142:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:1.0:1789762777.577148:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+20:11049:x1876702140643072:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1789762777.577159:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762777.577169:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56eb29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e668 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.577213:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eb30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.577222:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eb30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.577231:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eb30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762777.577241:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00010000:00010000:1.0:1789762777.577305:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51600/0xd08452c77c56eb29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e668 expref: 23 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.577316:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eb30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e668 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.577332:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:1.0:1789762777.577335:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789762777.577338:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50000, rc 0) 00000100:00100000:1.0:1789762777.577375:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+22:11049:x1876702140643072:12345-192.168.203.31@tcp:101:bash.0 Request processed in 225us (311us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789762777.577383:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:3.0:1789762777.578310:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762777.578385:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140643200 00000100:00100000:2.0:1789762777.578391:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140643200 00000100:00100000:2.0:1789762777.578419:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:2.0:1789762777.578426:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+22:11049:x1876702140643200:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1789762777.578436:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762777.578444:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56eb3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e66f expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.578497:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56eb45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.578508:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56eb45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.578516:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56eb45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762777.578544:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00000004:00200000:2.0:1789762777.578548:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762777.578560:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56eb45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.578614:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56eb3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e66f expref: 24 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.578631:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56eb45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e66f expref: 23 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.578640:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:2.0:1789762777.578643:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762777.578646:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148889200, rc 0) 00000100:00100000:2.0:1789762777.578674:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+23:11049:x1876702140643200:12345-192.168.203.31@tcp:101:bash.0 Request processed in 249us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762777.578679:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:3.0:1789762777.579916:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.579955:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140643328 00000100:00100000:0.0:1789762777.579960:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140643328 00000100:00100000:0.0:1789762777.579983:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1789762777.579996:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+23:11049:x1876702140643328:12345-192.168.203.31@tcp:37:bash.0 00000100:00100000:0.0:1789762777.581684:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+23:11049:x1876702140643328:12345-192.168.203.31@tcp:37:bash.0 Request processed in 1689us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762777.581690:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:3.0:1789762777.585905:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.585946:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140643456 00000100:00100000:1.0:1789762777.585953:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140643456 00000100:00100000:1.0:1789762777.585988:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:1.0:1789762777.585996:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+23:11049:x1876702140643456:12345-192.168.203.31@tcp:101:chmod.500 00010000:00010000:1.0:1789762777.586005:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762777.586013:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56eb4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e676 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586049:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56eb53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586058:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56eb53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586064:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56eb53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586073:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56eb5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586078:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56eb5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586093:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56eb5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586141:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56eb61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586147:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56eb61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586152:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56eb61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762777.586168:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xf:0x0]: returning size 0 00000004:00200000:1.0:1789762777.586171:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762777.586195:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56eb61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586202:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56eb61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586208:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56eb53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586212:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56eb53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586217:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56eb53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586220:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762777.586223:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56eb53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586233:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56eb53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586240:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:1.0:1789762777.586242:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762777.586244:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56eb53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586248:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56eb53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586256:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56eb5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586260:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56eb5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586264:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56eb5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586268:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762777.586270:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56eb5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586273:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56eb5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586277:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0xf4d4877e (ffff95d14abf2800) 00010000:00010000:1.0:1789762777.586279:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762777.586280:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56eb5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586290:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56eb5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586309:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56eb4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e676 expref: 25 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586316:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56eb61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e676 expref: 24 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.586322:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d151e90b00) 00010000:00010000:1.0:1789762777.586324:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762777.586325:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51a00, rc 0) 00000100:00100000:1.0:1789762777.586356:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+24:11049:x1876702140643456:12345-192.168.203.31@tcp:101:chmod.500 Request processed in 361us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762777.586363:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:3.0:1789762777.587557:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762777.587625:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.587645:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140643584 00000100:00100000:1.0:1789762777.587653:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140643584 00000100:00100000:0.0:1789762777.587663:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140643712 00000100:00100000:0.0:1789762777.587670:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140643712 00000100:00100000:1.0:1789762777.587716:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:1.0:1789762777.587729:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+7:2345:x1876702140643584:12345-192.168.203.31@tcp:101:chmod.500 00000100:00100000:0.0:1789762777.587739:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00010000:00010000:1.0:1789762777.587741:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789762777.587756:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140643712:12345-192.168.203.31@tcp:101:chmod.500 00010000:00010000:1.0:1789762777.587760:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56eb68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e67d expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.587768:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762777.587789:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008034d957/0xd08452c77c56eb6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e684 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762777.587792:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x6aad9cd9, atime: 0x6aad9cd9, ctime: 0x6aad9cd9, blocks: 0x1 00002000:00010000:0.0:1789762777.587834:0:10283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x6aad9cd9, atime: 0x6aad9cd9, ctime: 0x6aad9cd9, blocks: 0x1 00010000:00010000:1.0:1789762777.587838:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=182s v=(0 0) 00010000:00010000:0.0:1789762777.587864:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=182s v=(0 0) 00010000:00010000:0.0:1789762777.587869:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762777.587876:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762777.587880:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008034d957/0xd08452c77c56eb6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e684 expref: 7 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.587899:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56eb68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e67d expref: 8 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.587910:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008034d957/0xd08452c77c56eb6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e684 expref: 7 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.587923:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56eb68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e67d expref: 8 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.587926:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d173f5f000, rc 0) 00010000:00010000:1.0:1789762777.587942:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51600, rc 0) 00000100:00100000:0.0:1789762777.587962:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+7:2345:x1876702140643712:12345-192.168.203.31@tcp:101:chmod.500 Request processed in 214us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762777.587969:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1789762777.587978:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140643584:12345-192.168.203.31@tcp:101:chmod.500 Request processed in 250us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762777.587988:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:3.0:1789762777.589057:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.589086:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140643968 00000100:00100000:1.0:1789762777.589091:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140643968 00000100:00100000:1.0:1789762777.589117:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:1.0:1789762777.589123:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+24:11049:x1876702140643968:12345-192.168.203.31@tcp:36:chmod.500 00010000:00010000:1.0:1789762777.589146:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762777.589156:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56eb61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e676 expref: 24 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.589166:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d151e90b00) 00010000:00010000:1.0:1789762777.589168:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762777.589181:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.589188:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.589193:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762777.589316:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2f2bf09 reply state 000000005eaa580c transno 4294967373 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762777.589323:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762777.589373:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+25:11049:x1876702140643968:12345-192.168.203.31@tcp:36:chmod.500 Request processed in 249us (317us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789762777.589382:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 110 00010000:00010000:2.0:1789762777.590005:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.590014:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.590019:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.590023:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762777.590025:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.590037:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.590047:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d151e90b00) 00010000:00010000:2.0:1789762777.590049:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789762777.590052:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.590057:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56eb76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762777.590098:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762777.590150:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140644096 00000100:00100000:2.0:1789762777.590158:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140644096 00000100:00100000:2.0:1789762777.590209:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:2.0:1789762777.590225:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140644096:12345-192.168.203.31@tcp:2:chmod.500 00000100:00100000:1.0:1789762777.590317:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.590353:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140644224 00000100:00100000:0.0:1789762777.590359:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140644224 00002000:00010000:2.0:1789762777.590381:0:8803:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789762777.590385:0:8803:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789762777 -> 1789762777 00002000:00010000:2.0:1789762777.590388:0:8803:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1789762777 -> 1789762777 00002000:00010000:2.0:1789762777.590392:0:8803:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789762777 -> 1789762777 00000100:00100000:0.0:1789762777.590393:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00002000:00010000:2.0:1789762777.590397:0:8803:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789762777.590405:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140644224:12345-192.168.203.31@tcp:2:chmod.500 00000100:00100000:2.0:1789762777.590453:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+9:2345:x1876702140644096:12345-192.168.203.31@tcp:2:chmod.500 Request processed in 232us (354us total) trans 4294967430 rc 0/0 00000100:00100000:2.0:1789762777.590463:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00002000:00010000:0.0:1789762777.590561:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789762777.590565:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789762777 -> 1789762777 00002000:00010000:0.0:1789762777.590567:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789762777 -> 1789762777 00002000:00010000:0.0:1789762777.590570:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789762777 -> 1789762777 00002000:00010000:0.0:1789762777.590572:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789762777.590646:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140644224:12345-192.168.203.31@tcp:2:chmod.500 Request processed in 241us (329us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789762777.590655:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:1.0:1789762777.591442:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762777.591507:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140644352 00000100:00100000:2.0:1789762777.591513:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140644352 00000100:00100000:2.0:1789762777.591550:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:2.0:1789762777.591563:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+24:11049:x1876702140644352:12345-192.168.203.31@tcp:101:chmod.500 00010000:00010000:2.0:1789762777.591600:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762777.591611:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56eb7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e68b expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591659:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56eb84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591669:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56eb84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591677:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56eb84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591688:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56eb8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591694:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56eb8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591700:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56eb8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591746:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56eb92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591753:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56eb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591759:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56eb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762777.591775:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x10:0x0]: returning size 0 00000004:00200000:2.0:1789762777.591785:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762777.591800:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56eb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591824:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56eb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591829:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56eb84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591834:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56eb84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591838:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56eb84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591841:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762777.591843:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56eb84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591849:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56eb84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591858:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:2.0:1789762777.591899:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762777.591904:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56eb84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591910:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56eb84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591921:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56eb8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591937:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56eb8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591943:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56eb8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591947:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762777.591950:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56eb8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591955:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56eb8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591962:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x636661f9 (ffff95d143e3f900) 00010000:00010000:2.0:1789762777.591964:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762777.591967:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56eb8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.591989:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56eb8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.592007:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56eb7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e68b expref: 26 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.592014:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56eb92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e68b expref: 25 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.592020:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d15055d900) 00010000:00010000:2.0:1789762777.592022:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762777.592027:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148888600, rc 0) 00000100:00100000:2.0:1789762777.592076:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+25:11049:x1876702140644352:12345-192.168.203.31@tcp:101:chmod.500 Request processed in 518us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762777.592083:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:3.0:1789762777.593241:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.593319:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140644480 00000100:00100000:1.0:1789762777.593327:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140644480 00000100:00100000:3.0:1789762777.593358:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.593426:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140644608 00000100:00100000:1.0:1789762777.593432:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140644608 00000100:00100000:2.0:1789762777.593446:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:2.0:1789762777.593478:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2342:x1876702140644480:12345-192.168.203.31@tcp:101:chmod.500 00000100:00100000:0.0:1789762777.593484:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00010000:00010000:2.0:1789762777.593494:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789762777.593500:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+9:2343:x1876702140644608:12345-192.168.203.31@tcp:101:chmod.500 00010000:00010000:2.0:1789762777.593511:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cd70fa7/0xd08452c77c56eb99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e692 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.593512:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762777.593529:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8165d6b/0xd08452c77c56eba0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e699 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762777.593538:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x6aad9cd9, atime: 0x6aad9cd9, ctime: 0x6aad9cd9, blocks: 0x1 00002000:00010000:0.0:1789762777.593549:0:10283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x6aad9cd9, atime: 0x6aad9cd9, ctime: 0x6aad9cd9, blocks: 0x1 00010000:00010000:2.0:1789762777.593557:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=182s v=(0 0) 00010000:00010000:0.0:1789762777.593565:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=182s v=(0 0) 00010000:00010000:2.0:1789762777.593566:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762777.593574:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762777.593619:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8165d6b/0xd08452c77c56eba0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e699 expref: 10 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.593619:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cd70fa7/0xd08452c77c56eb99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e692 expref: 9 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.593658:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008cd70fa7/0xd08452c77c56eb99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e692 expref: 9 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.593660:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8165d6b/0xd08452c77c56eba0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e699 expref: 10 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.593701:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148888e00, rc 0) 00010000:00010000:0.0:1789762777.593720:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d173f5e400, rc 0) 00000100:00100000:2.0:1789762777.593744:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+9:2342:x1876702140644480:12345-192.168.203.31@tcp:101:chmod.500 Request processed in 272us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762777.593754:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+10:2343:x1876702140644608:12345-192.168.203.31@tcp:101:chmod.500 Request processed in 258us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762777.593757:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1789762777.593770:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:3.0:1789762777.594897:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.594960:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140644864 00000100:00100000:1.0:1789762777.594966:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140644864 00000100:00100000:1.0:1789762777.595002:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:1.0:1789762777.595010:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+25:11049:x1876702140644864:12345-192.168.203.31@tcp:36:chmod.500 00010000:00010000:1.0:1789762777.595051:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762777.595065:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56eb92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e68b expref: 25 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.595078:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d15055d900) 00010000:00010000:1.0:1789762777.595081:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762777.595093:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56eba7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.595102:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56eba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.595122:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56eba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762777.595219:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ea35cf7 reply state 000000007752137e transno 4294967374 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56eba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762777.595231:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762777.595302:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+26:11049:x1876702140644864:12345-192.168.203.31@tcp:36:chmod.500 Request processed in 292us (408us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789762777.595308:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00010000:00010000:0.0:1789762777.596125:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56eba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.596141:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56eba7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.596151:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56eba7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.596158:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762777.596162:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56eba7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.596169:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56eba7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.596180:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d15055d900) 00010000:00010000:0.0:1789762777.596183:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789762777.596186:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56eba7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.596192:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56eba7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762777.596231:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762777.596272:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.596291:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140644992 00000100:00100000:1.0:1789762777.596303:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140645120 00000100:00100000:0.0:1789762777.596306:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140644992 00000100:00100000:1.0:1789762777.596309:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140645120 00000100:00100000:0.0:1789762777.596346:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:0.0:1789762777.596358:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+9:2345:x1876702140644992:12345-192.168.203.31@tcp:2:chmod.500 00000100:00100000:1.0:1789762777.596361:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:1.0:1789762777.596377:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+10:2344:x1876702140645120:12345-192.168.203.31@tcp:2:chmod.500 00002000:00010000:0.0:1789762777.596484:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789762777.596489:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789762777 -> 1789762777 00002000:00010000:0.0:1789762777.596492:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789762777 -> 1789762777 00002000:00010000:0.0:1789762777.596494:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789762777 -> 1789762777 00002000:00010000:0.0:1789762777.596497:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1789762777.596525:0:6655:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789762777.596530:0:6655:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762777 -> 1789762777 00002000:00010000:1.0:1789762777.596533:0:6655:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb atime from disk: 1789762777 -> 1789762777 00002000:00010000:1.0:1789762777.596535:0:6655:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762777 -> 1789762777 00002000:00010000:1.0:1789762777.596538:0:6655:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789762777.596543:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+10:2345:x1876702140644992:12345-192.168.203.31@tcp:2:chmod.500 Request processed in 186us (311us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789762777.596554:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:1.0:1789762777.596599:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+11:2344:x1876702140645120:12345-192.168.203.31@tcp:2:chmod.500 Request processed in 204us (302us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1789762777.596626:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:1.0:1789762777.613169:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762777.613231:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140645376 00000100:00100000:2.0:1789762777.613242:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140645376 00000100:00100000:2.0:1789762777.613303:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:2.0:1789762777.613314:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+25:11053:x1876702140645376:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:2.0:1789762777.613335:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762777.613338:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789762777.613352:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56eb45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e66f expref: 25 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613365:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:2.0:1789762777.613368:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762777.613375:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ebae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6a0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613503:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ebb5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613514:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ebb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613522:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ebb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613533:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613539:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613545:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613632:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613647:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613653:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762777.613661:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xf:0x0]: returning size 0 00010000:00010000:2.0:1789762777.613742:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ebb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613749:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ebb5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613755:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ebb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613760:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762777.613763:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ebb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613770:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ebb5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613777:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:2.0:1789762777.613780:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762777.613782:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ebb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613788:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ebb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613796:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613824:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613829:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613832:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762777.613834:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613838:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613843:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0xf4d4877e (ffff95d143e3f900) 00010000:00010000:2.0:1789762777.613845:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762777.613846:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613850:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613890:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ebae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6a0 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613937:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6a0 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.613967:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d151e90b00) 00010000:00010000:2.0:1789762777.613969:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762777.613976:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148888a00, rc 0) 00000100:00100000:2.0:1789762777.614030:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+26:11053:x1876702140645376:12345-192.168.203.31@tcp:101:dd.500 Request processed in 718us (864us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789762777.614038:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:3.0:1789762777.615179:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762777.615276:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140645632 00000100:00100000:2.0:1789762777.615283:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140645632 00000100:00100000:2.0:1789762777.615319:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:2.0:1789762777.615326:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+26:11053:x1876702140645632:12345-192.168.203.31@tcp:36:dd.500 00010000:00010000:2.0:1789762777.615347:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762777.615357:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6a0 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.615370:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d151e90b00) 00010000:00010000:2.0:1789762777.615373:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762777.615505:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ebd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.615516:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ebd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.615523:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ebd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762777.615560:0:7603:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967376 00000004:00010000:2.0:1789762777.615603:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdb300f8 reply state 00000000fc19f2ce transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ebd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762777.615611:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762777.615675:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+28:11053:x1876702140645632:12345-192.168.203.31@tcp:36:dd.500 Request processed in 348us (499us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789762777.615706:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000020:00080000:2.0:1789762777.615712:0:7603:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789762777.616296:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ebd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.616308:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ebd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.616315:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ebd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.616320:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762777.616323:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ebd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.616328:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ebd1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.616336:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d151e90b00) 00010000:00010000:2.0:1789762777.616338:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762777.616341:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ebd1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.616345:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ebd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762777.616469:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.616575:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140645760 00000100:00100000:0.0:1789762777.616610:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140645760 00000100:00100000:0.0:1789762777.616674:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:0.0:1789762777.616685:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+11:11053:x1876702140645760:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762777.616712:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762777.616726:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff7398fd/0xd08452c77c56ebd8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6a7 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.616772:0:10283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56eb68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e67d expref: 12 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.616783:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762777.616788:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762777.616792:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff7398fd/0xd08452c77c56ebd8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6a7 expref: 12 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.616852:0:10283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56eb68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e67d expref: 12 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.616912:0:10283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56eb68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e67d expref: 12 pid: 6655 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762777.616930:0:10283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d150cadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10283:1876702149004416:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789762777.617044:0:10283:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d180dd5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789762777.617788:0:10283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d150cadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10283:1876702149004416:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762777.617828:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff7398fd/0xd08452c77c56ebd8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6a7 expref: 12 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762777.617840:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d173f5f400, rc 0) 00000100:00100000:0.0:1789762777.617909:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+12:11053:x1876702140645760:12345-192.168.203.31@tcp:101:dd.500 Request processed in 1226us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762777.617916:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:1.0:1789762777.618225:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762777.618290:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140645888 00000100:00100000:2.0:1789762777.618295:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140645888 00010000:00010000:2.0:1789762777.618316:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56eb68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e67d expref: 12 pid: 6655 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762777.618355:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:2.0:1789762777.618362:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140645888:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762777.618372:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762777.618376:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56eb68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e67d expref: 12 pid: 6655 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.618386:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56eb68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e67d expref: 12 pid: 6655 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.618399:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56eb68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e67d expref: 12 pid: 6655 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.618425:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762777.618429:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762777.618434:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff7398fd/0xd08452c77c56ebd8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6a7 expref: 11 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.618443:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff7398fd/0xd08452c77c56ebd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6a7 expref: 11 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.618467:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ff7398fd/0xd08452c77c56ebd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6a7 expref: 11 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762777.618490:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043212d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5798:1876702149004544:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762777.618537:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b0d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789762777.619348:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043212d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5798:1876702149004544:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762777.619360:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762777.619404:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77777931-b235-4c03-82d2-4b1d12553008+11:2345:x1876702140645888:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1041us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762777.619412:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1789762777.619473:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762777.619514:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140646016 00000100:00100000:2.0:1789762777.619520:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140646016 00000100:00100000:2.0:1789762777.619561:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1789762777.619572:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+10:11053:x1876702140646016:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:2.0:1789762777.619596:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762777.619608:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc0a6631/0xd08452c77c56ebdf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6ae expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.619644:0:6654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008034d957/0xd08452c77c56eb6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e684 expref: 11 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.619651:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762777.619655:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762777.619659:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc0a6631/0xd08452c77c56ebdf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ae expref: 11 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.619673:0:6654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008034d957/0xd08452c77c56eb6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e684 expref: 11 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.619707:0:6654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008034d957/0xd08452c77c56eb6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e684 expref: 11 pid: 10283 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762777.619718:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6654:1876702149004672:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789762777.619762:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b0d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789762777.620425:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6654:1876702149004672:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789762777.620441:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc0a6631/0xd08452c77c56ebdf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ae expref: 11 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762777.620452:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148888400, rc 0) 00000100:00100000:2.0:1789762777.620483:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+11:11053:x1876702140646016:12345-192.168.203.31@tcp:101:dd.500 Request processed in 915us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762777.620489:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:3.0:1789762777.620643:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.620694:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140646144 00000100:00100000:1.0:1789762777.620715:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140646144 00010000:00010000:1.0:1789762777.620739:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008034d957/0xd08452c77c56eb6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e684 expref: 11 pid: 10283 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762777.620785:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:1.0:1789762777.620814:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+11:2344:x1876702140646144:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762777.620825:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762777.620831:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008034d957/0xd08452c77c56eb6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e684 expref: 11 pid: 10283 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.620846:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008034d957/0xd08452c77c56eb6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e684 expref: 11 pid: 10283 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.620888:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008034d957/0xd08452c77c56eb6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e684 expref: 11 pid: 10283 timeout: 282 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.620897:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762777.620900:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762777.620904:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc0a6631/0xd08452c77c56ebdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ae expref: 10 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.620911:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc0a6631/0xd08452c77c56ebdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ae expref: 10 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762777.620932:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bc0a6631/0xd08452c77c56ebdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ae expref: 10 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762777.620959:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149004800:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762777.621002:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151e23840 going to sleep for 11 seconds 00000100:00100000:1.0:1789762777.621774:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149004800:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762777.621787:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762777.621862:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+10:2344:x1876702140646144:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1067us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762777.621870:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1789762777.622017:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762777.622086:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.622119:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140646272 00000100:00100000:2.0:1789762777.622126:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140646400 00000100:00100000:0.0:1789762777.622127:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140646272 00000100:00100000:2.0:1789762777.622134:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140646400 00002000:00010000:2.0:1789762777.622162:0:11722:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00010000:0.0:1789762777.622163:0:6661:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:2.0:1789762777.622168:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147270e00 with x1876702140646400 ext(0->18446744073709551615) 00002000:00100000:0.0:1789762777.622173:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147270380 with x1876702140646272 ext(0->18446744073709551615) 00002000:00010000:2.0:1789762777.622179:0:11722:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d147270e00. 00002000:00010000:0.0:1789762777.622185:0:6661:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147270380. 00000100:00100000:0.0:1789762777.622212:0:6661:0:(nrs_tbf.c:670:nrs_tbf_cli_fini()) unknown.0 NRS: TBF class fini: class@ffff95d17417c400 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 3 deadline 0 time 182095368311 state 0x4 ref 0 00000100:00100000:2.0:1789762777.622213:0:11722:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 3 deadline 0 time 182095367441 state 0x0 ref 1 00000100:00100000:0.0:1789762777.622234:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 3 deadline 182295367441 time 182095367441 state 0x1 ref 2 00000100:00100000:2.0:1789762777.622267:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 3 deadline 182295367441 time 182095367441 state 0x1 ref 2 00000100:00100000:0.0:1789762777.622287:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 2 deadline 182295448900 time 182095448900 state 0x1 ref 2 00000100:00100000:2.0:1789762777.622296:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 1 deadline 182295448900 time 182095459440 state 0x0 ref 2 00000100:00100000:0.0:1789762777.622303:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+11:2345:x1876702140646272:12345-192.168.203.31@tcp:10:dd.500 00000100:00100000:2.0:1789762777.622315:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+10:2344:x1876702140646400:12345-192.168.203.31@tcp:10:dd.500 00002000:00010000:0.0:1789762777.622608:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789762777.622612:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789762777 -> 1789762777 00002000:00010000:0.0:1789762777.622614:0:6661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1789762777 -> 1789762777 00002000:00010000:0.0:1789762777.622616:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789762777 -> 1789762777 00002000:00010000:0.0:1789762777.622618:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1789762777.622625:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789762777.622629:0:11722:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789762777 -> 1789762777 00002000:00010000:2.0:1789762777.622632:0:11722:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789762777 -> 1789762777 00002000:00010000:2.0:1789762777.622650:0:11722:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789762777 -> 1789762777 00002000:00010000:2.0:1789762777.622653:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789762777.622674:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140646272:12345-192.168.203.31@tcp:10:dd.500 Request processed in 375us (670us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1789762777.622684:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1789762777.622690:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+11:2344:x1876702140646400:12345-192.168.203.31@tcp:10:dd.500 Request processed in 377us (600us total) trans 4294967326 rc 0/0 00002000:00010000:0.0:1789762777.622691:0:6661:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:0.0:1789762777.622698:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147270380 with x1876702140646272 ext(0->18446744073709551615) 00002000:00010000:0.0:1789762777.622706:0:6661:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147270380. 00000100:00100000:2.0:1789762777.622706:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:2.0:1789762777.622716:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 1 deadline 182295448900 time 182095459440 state 0x2 ref 0 00002000:00010000:2.0:1789762777.622722:0:11722:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:2.0:1789762777.622726:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147270e00 with x1876702140646400 ext(0->18446744073709551615) 00002000:00010000:2.0:1789762777.622733:0:11722:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d147270e00. 00000100:00100000:1.0:1789762777.631397:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.631453:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140646528 00000100:00100000:0.0:1789762777.631460:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140646528 00002000:00100000:0.0:1789762777.631490:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x6:0x0] (0->1048575) req@ffff95d16ffe0a80 x1876702140646528/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1789762788 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762777.631500:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe0a80 with x1876702140646528 ext(0->1048575) 00002000:00010000:0.0:1789762777.631505:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffe0a80 00000100:00100000:0.0:1789762777.631512:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 1 deadline 182295448900 time 182095459440 state 0x0 ref 1 00000100:00100000:0.0:1789762777.631535:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 1 deadline 182295459440 time 182095459440 state 0x1 ref 1 00000100:00100000:0.0:1789762777.631554:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 182295459440 time 182104719117 state 0x0 ref 1 00000100:00100000:0.0:1789762777.631572:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+12:2344:x1876702140646528:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:3.0:1789762777.638247:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.638297:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140646656 00000100:00100000:1.0:1789762777.638303:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140646656 00002000:00100000:1.0:1789762777.638329:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1048576->2097151) req@ffff95d147272a00 x1876702140646656/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1789762788 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762777.638340:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147272a00 with x1876702140646656 ext(1048576->2097151) 00002000:00010000:1.0:1789762777.638345:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147272a00 00000100:00100000:1.0:1789762777.638357:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 182304719117 time 182104719117 state 0x1 ref 2 00000100:00100000:0.0:1789762777.639495:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+15:2344:x1876702140646528:12345-192.168.203.31@tcp:4:dd.500 Request processed in 7922us (8098us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1789762777.639502:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 2 00002000:00100000:0.0:1789762777.639509:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x6:0x0] (0->1048575) req@ffff95d16ffe0a80 x1876702140646528/t4294967433(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1789762788 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762777.639516:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe0a80 with x1876702140646528 ext(0->1048575) 00002000:00010000:0.0:1789762777.639520:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffe0a80 00000100:00100000:1.0:1789762777.644687:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762777.644738:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140646784 00000100:00100000:2.0:1789762777.644746:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140646784 00002000:00100000:2.0:1789762777.644772:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (2097152->3145727) req@ffff95d16ffe3800 x1876702140646784/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1789762788 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762777.644782:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe3800 with x1876702140646784 ext(2097152->3145727) 00002000:00010000:2.0:1789762777.644786:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffe3800 00000100:00100000:2.0:1789762777.644795:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 182304719117 time 182104719117 state 0x1 ref 2 00000100:00100000:3.0:1789762777.651157:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762777.651244:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140646912 00000100:00100000:1.0:1789762777.651251:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140646912 00002000:00100000:1.0:1789762777.651276:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3145728->4194303) req@ffff95d147273100 x1876702140646912/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1789762788 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762777.651286:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147273100 with x1876702140646912 ext(3145728->4194303) 00002000:00010000:1.0:1789762777.651290:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147273100 00000100:00100000:1.0:1789762777.651297:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 182304719117 time 182104719117 state 0x1 ref 3 00000100:00100000:3.0:1789762777.657496:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.657554:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140647040 00000100:00100000:0.0:1789762777.657561:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140647040 00002000:00100000:0.0:1789762777.657604:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x4:0x0] (0->1048575) req@ffff95d147272d80 x1876702140647040/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1789762788 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762777.657619:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147272d80 with x1876702140647040 ext(0->1048575) 00002000:00010000:0.0:1789762777.657625:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d147272d80 00000100:00100000:0.0:1789762777.657636:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 182304719117 time 182104719117 state 0x1 ref 4 00000100:00100000:1.0:1789762777.664231:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762777.664322:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140647168 00000100:00100000:3.0:1789762777.664328:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140647168 00002000:00100000:3.0:1789762777.664371:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (1048576->2097151) req@ffff95d145f07100 x1876702140647168/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1789762788 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762777.664381:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f07100 with x1876702140647168 ext(1048576->2097151) 00002000:00010000:3.0:1789762777.664384:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d145f07100 00000100:00100000:3.0:1789762777.664392:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 182304719117 time 182104719117 state 0x1 ref 5 00000100:00100000:1.0:1789762777.767100:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d150cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149004928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762777.767141:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149005056:0@lo:400:kworker.0 00000100:00100000:0.0:1789762777.767161:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149005184:0@lo:400:kworker.0 00000100:00100000:3.0:1789762777.767266:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149005312:0@lo:400:kworker.0 00000100:00100000:1.0:1789762777.767273:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762777.767273:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762777.767275:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762777.767386:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762777.767406:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149005696:0@lo:400:kworker.0 00000100:00100000:1.0:1789762777.767414:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149005440:0@lo:400:kworker.0 00000100:00100000:2.0:1789762777.767416:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149005568:0@lo:400:kworker.0 00000100:00100000:0.0:1789762777.767468:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762777.767483:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149004928 00000100:00100000:3.0:1789762777.767496:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149004928 00000100:00100000:1.0:1789762777.767515:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149005184 00000100:00100000:1.0:1789762777.767524:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149005184 00000100:00100000:2.0:1789762777.767540:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762777.767575:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762777.767635:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789762777.767645:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149005312 00000100:00100000:1.0:1789762777.767654:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149005312 00000100:00100000:3.0:1789762777.767658:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149004928:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762777.767668:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149005568 00000100:00100000:2.0:1789762777.767679:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149005568 00000100:00100000:0.0:1789762777.767696:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00002000:00000024:3.0:1789762777.767701:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762777.767716:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149005184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762777.767725:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789762777.767744:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149005312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762777.767757:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789762777.767778:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149005568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762777.767831:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149004928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762777.767835:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149005184:12345-0@lo:400:kworker.0 Request processed in 125us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762777.767899:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789762777.767906:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789762777.767939:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149005312:12345-0@lo:400:kworker.0 Request processed in 195us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762777.767958:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789762777.767965:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149005056 00000100:00100000:3.0:1789762777.767975:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149005056 00000100:00100000:2.0:1789762777.767988:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149005568:12345-0@lo:400:kworker.0 Request processed in 213us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762777.768001:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789762777.768018:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149005184:0@lo:400:kworker.0 00000100:00100000:1.0:1789762777.768040:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149005312:0@lo:400:kworker.0 00000100:00100000:3.0:1789762777.768051:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789762777.768071:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149005056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762777.768084:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149005568:0@lo:400:kworker.0 00000100:00100000:1.0:1789762777.768094:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149005696 00000100:00100000:1.0:1789762777.768102:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149005696 00000100:00100000:0.0:1789762777.768161:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d150cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149004928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762777.768177:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149005056:12345-0@lo:400:kworker.0 Request processed in 107us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762777.768178:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149005440 00000100:00100000:1.0:1789762777.768186:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149005440 00000100:00100000:2.0:1789762777.768191:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149005056:0@lo:400:kworker.0 00000100:00100000:3.0:1789762777.768203:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789762777.768223:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789762777.768249:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789762777.768250:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149005696:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789762777.768269:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762777.768278:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149005440:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789762777.768281:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789762777.768291:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762777.768347:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149005696:12345-0@lo:400:kworker.0 Request processed in 109us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762777.768358:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789762777.768391:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149005440:12345-0@lo:400:kworker.0 Request processed in 121us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762777.768408:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789762777.768417:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149005440:0@lo:400:kworker.0 00000100:00100000:0.0:1789762777.768425:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149005696:0@lo:400:kworker.0 00000100:00100000:3.0:1789762777.831794:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 182504941210 time 182304941210 state 0x1 ref 5 00000100:00100000:3.0:1789762777.831900:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147272a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+16:2344:x1876702140646656:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762777.836357:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147272a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+18:2344:x1876702140646656:12345-192.168.203.31@tcp:4:dd.500 Request processed in 4506us (198109us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789762777.836372:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 3 00002000:00100000:0.0:1789762777.836389:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (1048576->2097151) req@ffff95d147272a00 x1876702140646656/t4294967434(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1789762788 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762777.836402:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147272a00 with x1876702140646656 ext(1048576->2097151) 00002000:00010000:0.0:1789762777.836411:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147272a00 00000100:00100000:3.0:1789762777.972531:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762777.972649:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762777.972655:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140647424 00000100:00100000:0.0:1789762777.972675:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140647424 00000100:00100000:2.0:1789762777.972761:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140647296 00000100:00100000:2.0:1789762777.972773:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140647296 00000100:00080000:3.0:1789762777.972787:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762777.972829:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:3.0:1789762777.972907:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:0.0:1789762777.972931:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140647424:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762777.972939:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140647296:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762777.973076:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140647296:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 154us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762777.973093:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:0.0:1789762777.973094:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140647424:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 165us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762777.973115:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:0.0:1789762778.031883:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 182705029279 time 182505029279 state 0x1 ref 4 00000100:00100000:0.0:1789762778.031921:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+17:2345:x1876702140646784:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762778.035434:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+19:2345:x1876702140646784:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3529us (390747us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1789762778.035444:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 4 00002000:00100000:0.0:1789762778.035456:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x6:0x0] (2097152->3145727) req@ffff95d16ffe3800 x1876702140646784/t4294967435(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1789762788 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762778.035465:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe3800 with x1876702140646784 ext(2097152->3145727) 00002000:00010000:0.0:1789762778.035492:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffe3800 00010000:00010000:1.0:1789762778.150957:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762778.232015:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 182905167292 time 182705167292 state 0x1 ref 3 00000100:00100000:2.0:1789762778.232067:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+18:2345:x1876702140646912:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762778.234780:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+20:2345:x1876702140646912:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2741us (583624us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789762778.234790:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 5 00002000:00100000:2.0:1789762778.234801:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3145728->4194303) req@ffff95d147273100 x1876702140646912/t4294967436(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1789762788 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762778.234810:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147273100 with x1876702140646912 ext(3145728->4194303) 00002000:00010000:2.0:1789762778.234817:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147273100 00000100:00100000:1.0:1789762778.279024:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149005824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762778.279086:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762778.279135:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149005824 00000100:00100000:2.0:1789762778.279144:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149005824 00000100:00100000:2.0:1789762778.279199:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789762778.279208:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149005824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762778.279230:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 255524864 pending 6815744 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762778.279285:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149005824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762778.279293:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789762778.279331:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149005824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762778.432201:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183105347058 time 182905347058 state 0x1 ref 2 00000100:00100000:3.0:1789762778.432262:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140647040:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:3.0:1789762778.438705:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+14:2345:x1876702140647040:12345-192.168.203.31@tcp:4:dd.500 Request processed in 6479us (781209us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1789762778.438714:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 6 00002000:00100000:3.0:1789762778.438725:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->1048575) req@ffff95d147272d80 x1876702140647040/t4294967327(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1789762788 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762778.438735:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147272d80 with x1876702140647040 ext(0->1048575) 00002000:00010000:3.0:1789762778.438743:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d147272d80 00000100:00100000:0.0:1789762778.440807:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762778.440866:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140647552 00000100:00100000:1.0:1789762778.440879:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140647552 00002000:00100000:1.0:1789762778.440946:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (2097152->3145727) req@ffff95d173d32680 x1876702140647552/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762778.440957:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173d32680 with x1876702140647552 ext(2097152->3145727) 00002000:00010000:1.0:1789762778.440961:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d173d32680 00000100:00100000:1.0:1789762778.440993:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183105347058 time 182905347058 state 0x1 ref 2 00000100:00100000:1.0:1789762778.448392:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762778.448454:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140647680 00000100:00100000:0.0:1789762778.448461:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140647680 00002000:00100000:0.0:1789762778.448487:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x4:0x0] (3145728->4194303) req@ffff95d145f05f80 x1876702140647680/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762778.448497:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f05f80 with x1876702140647680 ext(3145728->4194303) 00002000:00010000:0.0:1789762778.448501:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d145f05f80 00000100:00100000:0.0:1789762778.448509:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183105347058 time 182905347058 state 0x1 ref 3 00000100:00100000:1.0:1789762778.455042:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762778.455109:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140647808 00000100:00100000:3.0:1789762778.455116:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140647808 00002000:00100000:3.0:1789762778.455158:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (4194304->5242879) req@ffff95d145f05180 x1876702140647808/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762778.455194:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f05180 with x1876702140647808 ext(4194304->5242879) 00002000:00010000:3.0:1789762778.455200:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f05180 00000100:00100000:3.0:1789762778.455210:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183105347058 time 182905347058 state 0x1 ref 4 00000100:00100000:0.0:1789762778.461659:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762778.461772:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140647936 00000100:00100000:3.0:1789762778.461780:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140647936 00002000:00100000:3.0:1789762778.461807:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (5242880->6291455) req@ffff95d173d30700 x1876702140647936/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762778.461818:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173d30700 with x1876702140647936 ext(5242880->6291455) 00002000:00010000:3.0:1789762778.461821:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d173d30700 00000100:00100000:3.0:1789762778.461830:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183105347058 time 182905347058 state 0x1 ref 5 00000100:00100000:1.0:1789762778.468290:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762778.468359:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140648064 00000100:00100000:2.0:1789762778.468367:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140648064 00002000:00100000:2.0:1789762778.468392:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (6291456->7340031) req@ffff95d145f05500 x1876702140648064/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762778.468402:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f05500 with x1876702140648064 ext(6291456->7340031) 00002000:00010000:2.0:1789762778.468405:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f05500 00000100:00100000:2.0:1789762778.468413:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183105347058 time 182905347058 state 0x1 ref 6 00000100:00100000:1.0:1789762778.479097:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762778.479149:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140648192 00000100:00100000:0.0:1789762778.479155:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140648192 00002000:00100000:0.0:1789762778.479197:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (7340032->8388607) req@ffff95d145f05880 x1876702140648192/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762778.479206:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f05880 with x1876702140648192 ext(7340032->8388607) 00002000:00010000:0.0:1789762778.479217:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f05880 00000100:00100000:0.0:1789762778.479225:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183105347058 time 182905347058 state 0x1 ref 7 00000100:00100000:0.0:1789762778.632347:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183305490727 time 183105490727 state 0x1 ref 7 00000100:00100000:0.0:1789762778.632385:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+15:2345:x1876702140647168:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762778.635518:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+17:2345:x1876702140647168:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3151us (971288us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789762778.635526:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 7 00002000:00100000:0.0:1789762778.635537:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x4:0x0] (1048576->2097151) req@ffff95d145f07100 x1876702140647168/t4294967328(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1789762788 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762778.635546:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f07100 with x1876702140647168 ext(1048576->2097151) 00002000:00010000:0.0:1789762778.635552:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d145f07100 00000100:00100000:3.0:1789762778.637483:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762778.637544:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140648320 00000100:00100000:2.0:1789762778.637553:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140648320 00002000:00100000:2.0:1789762778.637604:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (4194304->5242879) req@ffff95d147271c00 x1876702140648320/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762778.637612:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147271c00 with x1876702140648320 ext(4194304->5242879) 00002000:00010000:2.0:1789762778.637616:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d147271c00 00000100:00100000:2.0:1789762778.637628:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183305490727 time 183105490727 state 0x1 ref 7 00000100:00100000:1.0:1789762778.644216:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762778.644295:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140648448 00000100:00100000:0.0:1789762778.644301:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140648448 00002000:00100000:0.0:1789762778.644324:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (5242880->6291455) req@ffff95d145f04a80 x1876702140648448/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762778.644332:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f04a80 with x1876702140648448 ext(5242880->6291455) 00002000:00010000:0.0:1789762778.644335:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d145f04a80 00000100:00100000:0.0:1789762778.644342:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183305490727 time 183105490727 state 0x1 ref 8 00000100:00100000:0.0:1789762778.832433:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183505584162 time 183305584162 state 0x1 ref 8 00000100:00100000:0.0:1789762778.832473:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+18:2344:x1876702140647552:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762778.835909:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+20:2344:x1876702140647552:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3456us (395101us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789762778.835930:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 8 00002000:00100000:0.0:1789762778.835947:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x4:0x0] (2097152->3145727) req@ffff95d173d32680 x1876702140647552/t4294967329(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762778.835958:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173d32680 with x1876702140647552 ext(2097152->3145727) 00002000:00010000:0.0:1789762778.835965:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d173d32680 00000100:00100000:3.0:1789762778.837883:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762778.837942:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140648576 00000100:00100000:2.0:1789762778.837959:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140648576 00002000:00100000:2.0:1789762778.837997:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (6291456->7340031) req@ffff95d147272680 x1876702140648576/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762778.838016:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147272680 with x1876702140648576 ext(6291456->7340031) 00002000:00010000:2.0:1789762778.838019:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d147272680 00000100:00100000:2.0:1789762778.838033:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183505584162 time 183305584162 state 0x1 ref 8 00000100:00100000:1.0:1789762778.844081:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762778.844115:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762778.844150:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140648704 00000100:00100000:0.0:1789762778.844157:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140648704 00000100:00100000:3.0:1789762778.844158:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140648960 00000100:00100000:3.0:1789762778.844165:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140648960 00002000:00100000:0.0:1789762778.844194:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (7340032->8388607) req@ffff95d145f04000 x1876702140648704/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00000100:00100000:3.0:1789762778.844207:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00002000:00100000:0.0:1789762778.844210:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f04000 with x1876702140648704 ext(7340032->8388607) 00002000:00010000:0.0:1789762778.844217:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d145f04000 00000100:00100000:3.0:1789762778.844218:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1517c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+27:11053:x1876702140648960:12345-192.168.203.31@tcp:35:dd.500 00000100:00100000:0.0:1789762778.844234:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183505584162 time 183305584162 state 0x1 ref 9 00000001:00080000:3.0:1789762778.844439:0:8160:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967378 00000100:00100000:3.0:1789762778.844512:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1517c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+29:11053:x1876702140648960:12345-192.168.203.31@tcp:35:dd.500 Request processed in 297us (395us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789762778.844520:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000020:00080000:3.0:1789762778.844525:0:8160:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789762778.872461:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762778.872549:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140649216 00000100:00100000:2.0:1789762778.872561:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140649216 00000100:00100000:2.0:1789762778.872654:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:2.0:1789762778.872669:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+29:11064:x1876702140649216:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762778.872705:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762778.872727:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ebe6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6b5 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.872920:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.872939:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.872952:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.872965:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ebf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.872971:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ebf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.872975:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ebf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873065:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873075:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873083:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762778.873095:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x10:0x0]: returning size 0 00010000:00010000:2.0:1789762778.873205:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873211:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873217:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873222:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762778.873225:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873230:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873241:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:2.0:1789762778.873243:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762778.873247:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873259:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ebed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873269:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ebf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873273:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ebf4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873277:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ebf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873280:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762778.873282:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ebf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873286:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ebf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873290:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x636661f9 (ffff95d143e3f900) 00010000:00010000:2.0:1789762778.873292:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762778.873293:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ebf4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873297:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ebf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873329:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ebe6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6b5 expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873339:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6b5 expref: 31 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.873350:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d15055d900) 00010000:00010000:2.0:1789762778.873351:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762778.873354:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148889600, rc 0) 00000100:00100000:2.0:1789762778.873411:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+31:11064:x1876702140649216:12345-192.168.203.31@tcp:101:dd.0 Request processed in 748us (964us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789762778.873417:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:1.0:1789762778.881730:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762778.881803:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140649344 00000100:00100000:2.0:1789762778.881814:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140649344 00000100:00100000:2.0:1789762778.881886:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:2.0:1789762778.881897:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+22:11065:x1876702140649344:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762778.881914:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762778.881931:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6bc expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.881965:0:6654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008cd70fa7/0xd08452c77c56eb99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e692 expref: 23 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.881973:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762778.881978:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762778.881984:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 23 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.882034:0:6654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008cd70fa7/0xd08452c77c56eb99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e692 expref: 23 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.882070:0:6654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008cd70fa7/0xd08452c77c56eb99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e692 expref: 23 pid: 6654 timeout: 283 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762778.882088:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6654:1876702149005952:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789762778.882203:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b0d4240 going to sleep for 11 seconds 00000100:00100000:1.0:1789762778.882562:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762778.882626:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140649472 00000100:00100000:3.0:1789762778.882634:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140649472 00000100:00100000:3.0:1789762778.882681:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1789762778.882691:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+24:11064:x1876702140649472:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762778.882701:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762778.882712:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56ec10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6c3 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.882731:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762778.882736:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762778.882743:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56ec10 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6c3 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.882755:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56ec10 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6c3 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.882771:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030600, rc 0) 00000100:00100000:3.0:1789762778.882813:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+25:11064:x1876702140649472:12345-192.168.203.31@tcp:101:dd.0 Request processed in 124us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762778.882822:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1789762778.883218:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762778.883260:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6654:1876702149005952:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789762778.883291:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 24 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762778.883293:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140649600 00000100:00100000:0.0:1789762778.883302:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140649600 00010000:00010000:2.0:1789762778.883312:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148889000, rc 0) 00010000:00010000:0.0:1789762778.883339:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008cd70fa7/0xd08452c77c56eb99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e692 expref: 25 pid: 6654 timeout: 283 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762778.883353:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+25:11065:x1876702140649344:12345-192.168.203.31@tcp:101:dd.0 Request processed in 1456us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762778.883366:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1789762778.883392:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1789762778.883407:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147273480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+24:2342:x1876702140649600:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762778.883421:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762778.883448:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008cd70fa7/0xd08452c77c56eb99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e692 expref: 24 pid: 6654 timeout: 283 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.883468:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008cd70fa7/0xd08452c77c56eb99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e692 expref: 24 pid: 6654 timeout: 283 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762778.883494:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:0.0:1789762778.883512:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cd70fa7/0xd08452c77c56eb99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e692 expref: 24 pid: 6654 timeout: 283 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.883531:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762778.883536:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1789762778.883541:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140649728 00010000:00010000:0.0:1789762778.883549:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 23 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762778.883550:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140649728 00010000:00010000:0.0:1789762778.883565:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 24 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.883589:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762778.883592:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762778.883598:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56ec10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6c3 expref: 24 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762778.883606:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:2.0:1789762778.883621:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+24:11066:x1876702140649728:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762778.883629:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56ec10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6c3 expref: 24 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.883635:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762778.883648:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd3730ad/0xd08452c77c56ec17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6ca expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.883667:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56ec10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6c3 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.883677:0:6655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 6 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 25 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.883705:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762778.883710:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789762778.883716:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd3730ad/0xd08452c77c56ec17 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ca expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762778.883733:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d33800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149006080:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762778.883745:0:6655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 25 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.883761:0:6655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70080400020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 25 pid: 6654 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762778.883775:0:6655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6655:1876702149006208:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762778.883810:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 25 pid: 6654 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762778.883815:0:6655:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b0d4240 going to sleep for 11 seconds 00010000:00010000:0.0:1789762778.883861:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 25 pid: 6654 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762778.883872:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d33480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149006336:192.168.203.31@tcp:105: 00000100:00100000:0.0:1789762778.883910:0:5799:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d180dd5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789762778.884735:0:6655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6655:1876702149006208:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789762778.884739:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d33800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149006080:192.168.203.31@tcp:105: 00000100:00100000:0.0:1789762778.884762:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d33480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149006336:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762778.884774:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd3730ad/0xd08452c77c56ec17 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ca expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.884784:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762778.884793:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148888c00, rc 0) 00000100:00100000:0.0:1789762778.884828:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147273480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+25:2342:x1876702140649600:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1424us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762778.884890:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1789762778.884890:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+25:11066:x1876702140649728:12345-192.168.203.31@tcp:101:dd.0 Request processed in 1264us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762778.884926:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:3.0:1789762778.889215:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762778.889268:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140649856 00000100:00100000:0.0:1789762778.889276:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140649856 00000100:00100000:0.0:1789762778.889319:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:0.0:1789762778.889330:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+24:11069:x1876702140649856:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762778.889344:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762778.889359:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065fbb66f/0xd08452c77c56ec1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6d1 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.889383:0:8803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8165d6b/0xd08452c77c56eba0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e699 expref: 25 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.889394:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762778.889406:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762778.889411:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065fbb66f/0xd08452c77c56ec1e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6d1 expref: 25 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.889444:0:8803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8165d6b/0xd08452c77c56eba0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e699 expref: 25 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.889457:0:8803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8165d6b/0xd08452c77c56eba0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e699 expref: 25 pid: 10283 timeout: 283 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762778.889470:0:8803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8803:1876702149006464:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789762778.889525:0:8803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d180dd5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789762778.890269:0:8803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8803:1876702149006464:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762778.890287:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065fbb66f/0xd08452c77c56ec1e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6d1 expref: 25 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.890299:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d173f5ea00, rc 0) 00000100:00100000:0.0:1789762778.890332:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+25:11069:x1876702140649856:12345-192.168.203.31@tcp:101:dd.0 Request processed in 1004us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762778.890339:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:3.0:1789762778.890446:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762778.890474:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140649984 00000100:00100000:2.0:1789762778.890481:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140649984 00010000:00010000:2.0:1789762778.890506:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8165d6b/0xd08452c77c56eba0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e699 expref: 25 pid: 10283 timeout: 283 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762778.890539:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1789762778.890549:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147271500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77777931-b235-4c03-82d2-4b1d12553008+25:2343:x1876702140649984:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762778.890560:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762778.890596:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8165d6b/0xd08452c77c56eba0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e699 expref: 25 pid: 10283 timeout: 283 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.890625:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8165d6b/0xd08452c77c56eba0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e699 expref: 25 pid: 10283 timeout: 283 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.890647:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8165d6b/0xd08452c77c56eba0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e699 expref: 25 pid: 10283 timeout: 283 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.890660:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762778.890664:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762778.890671:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065fbb66f/0xd08452c77c56ec1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6d1 expref: 24 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.890682:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065fbb66f/0xd08452c77c56ec1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6d1 expref: 24 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.890707:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000065fbb66f/0xd08452c77c56ec1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6d1 expref: 24 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762778.890720:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043211f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5798:1876702149006592:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762778.890767:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b0d4240 going to sleep for 11 seconds 00000100:00100000:1.0:1789762778.891583:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043211f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5798:1876702149006592:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762778.891600:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762778.891640:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147271500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77777931-b235-4c03-82d2-4b1d12553008+24:2343:x1876702140649984:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1092us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762778.891651:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:3.0:1789762778.895644:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762778.895692:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140650112 00000100:00100000:2.0:1789762778.895699:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140650112 00000100:00100000:2.0:1789762778.895743:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:2.0:1789762778.895753:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+24:11075:x1876702140650112:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762778.895767:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762778.895790:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000540d88e/0xd08452c77c56ec25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6d8 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.895814:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789762778.895818:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789762778.895825:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000540d88e/0xd08452c77c56ec25 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6d8 expref: 25 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.895863:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000540d88e/0xd08452c77c56ec25 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6d8 expref: 25 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.895876:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148889800, rc 0) 00000100:00100000:2.0:1789762778.895915:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+25:11075:x1876702140650112:12345-192.168.203.31@tcp:101:dd.0 Request processed in 164us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762778.895921:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1789762778.905540:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762778.905623:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140650240 00000100:00100000:1.0:1789762778.905636:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140650240 00000100:00100000:1.0:1789762778.905692:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:1.0:1789762778.905701:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+25:11074:x1876702140650240:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762778.905716:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762778.905731:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56ec2c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6df expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762778.905756:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1789762778.905760:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1789762778.905765:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56ec2c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6df expref: 26 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762778.905774:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56ec2c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6df expref: 26 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762778.905784:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50e00, rc 0) 00000100:00100000:1.0:1789762778.905869:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+26:11074:x1876702140650240:12345-192.168.203.31@tcp:101:dd.0 Request processed in 167us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762778.905897:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:1.0:1789762778.906457:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762778.906532:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140650368 00000100:00100000:0.0:1789762778.906544:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140650368 00000100:00100000:0.0:1789762778.906622:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:0.0:1789762778.906634:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+26:11067:x1876702140650368:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762778.906652:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762778.906680:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef8605ce/0xd08452c77c56ec33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6e6 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.906710:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1789762778.906715:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(4 0) 00010000:00010000:0.0:1789762778.906722:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef8605ce/0xd08452c77c56ec33 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6e6 expref: 27 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.906735:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef8605ce/0xd08452c77c56ec33 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6e6 expref: 27 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.906750:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d173f5fc00, rc 0) 00000100:00100000:0.0:1789762778.906804:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+27:11067:x1876702140650368:12345-192.168.203.31@tcp:101:dd.0 Request processed in 173us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762778.906813:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:3.0:1789762778.910882:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762778.910956:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140650496 00000100:00100000:2.0:1789762778.910963:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140650496 00000100:00100000:2.0:1789762778.910996:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:2.0:1789762778.911004:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+27:11072:x1876702140650496:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762778.911014:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762778.911025:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008838c734/0xd08452c77c56ec3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6ed expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.911043:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789762778.911046:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(5 0) 00010000:00010000:2.0:1789762778.911050:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008838c734/0xd08452c77c56ec3a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ed expref: 28 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.911073:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008838c734/0xd08452c77c56ec3a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ed expref: 28 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.911089:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148889200, rc 0) 00000100:00100000:2.0:1789762778.911124:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+28:11072:x1876702140650496:12345-192.168.203.31@tcp:101:dd.0 Request processed in 121us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762778.911129:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:3.0:1789762778.927087:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762778.927160:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140650624 00000100:00100000:0.0:1789762778.927173:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140650624 00002000:00100000:0.0:1789762778.927224:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7:0x0] (1048576->2097151) req@ffff95d147271f80 x1876702140650624/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762778.927235:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147271f80 with x1876702140650624 ext(1048576->2097151) 00002000:00010000:0.0:1789762778.927241:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147271f80 00000100:00100000:0.0:1789762778.927263:0:11723:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 3 deadline 0 time 183400423670 state 0x0 ref 1 00000100:00100000:0.0:1789762778.927280:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 3 deadline 183400523670 time 183400423670 state 0x1 ref 1 00000100:00100000:3.0:1789762778.927425:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183400523670 time 183400585443 state 0x0 ref 1 00000100:00100000:3.0:1789762778.927461:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+24:2342:x1876702140650624:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762778.932971:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+26:2342:x1876702140650624:12345-192.168.203.31@tcp:4:dd.0 Request processed in 5511us (5890us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789762778.932990:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1789762778.932997:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183400523670 time 183400585443 state 0x2 ref 0 00002000:00100000:0.0:1789762778.933008:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7:0x0] (1048576->2097151) req@ffff95d147271f80 x1876702140650624/t4294967437(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762778.933015:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147271f80 with x1876702140650624 ext(1048576->2097151) 00002000:00010000:0.0:1789762778.933020:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147271f80 00000100:00100000:1.0:1789762778.934202:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762778.934269:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140650752 00000100:00100000:2.0:1789762778.934280:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140650752 00000100:00100000:2.0:1789762778.934323:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:2.0:1789762778.934332:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+28:11073:x1876702140650752:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762778.934347:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762778.934363:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002809c665/0xd08452c77c56ec41 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6f4 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.934389:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(5 0) 00010000:00010000:2.0:1789762778.934394:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(6 0) 00010000:00010000:2.0:1789762778.934398:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002809c665/0xd08452c77c56ec41 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6f4 expref: 29 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.934408:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002809c665/0xd08452c77c56ec41 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6f4 expref: 29 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.934420:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148889400, rc 0) 00000100:00100000:2.0:1789762778.934463:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+29:11073:x1876702140650752:12345-192.168.203.31@tcp:101:dd.0 Request processed in 133us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762778.934478:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:1.0:1789762778.939331:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762778.939398:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140650880 00000100:00100000:0.0:1789762778.939408:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140650880 00002000:00100000:0.0:1789762778.939446:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x7:0x0] (0->1048575) req@ffff95d145f06300 x1876702140650880/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762778.939457:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f06300 with x1876702140650880 ext(0->1048575) 00002000:00010000:0.0:1789762778.939463:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f06300 00000100:00100000:0.0:1789762778.939473:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183400523670 time 183400585443 state 0x0 ref 1 00000100:00100000:0.0:1789762778.939510:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183400685443 time 183400585443 state 0x1 ref 1 00000100:00100000:0.0:1789762778.939538:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183400685443 time 183412700998 state 0x0 ref 1 00000100:00100000:0.0:1789762778.939557:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+26:2345:x1876702140650880:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762778.942504:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+28:2345:x1876702140650880:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2954us (3173us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789762778.942511:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1789762778.942517:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183400685443 time 183412700998 state 0x2 ref 0 00002000:00100000:0.0:1789762778.942525:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x7:0x0] (0->1048575) req@ffff95d145f06300 x1876702140650880/t4294967438(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762778.942540:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f06300 with x1876702140650880 ext(0->1048575) 00002000:00010000:0.0:1789762778.942543:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f06300 00000100:00100000:3.0:1789762778.947907:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762778.947955:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140651008 00000100:00100000:2.0:1789762778.947969:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140651008 00002000:00100000:2.0:1789762778.948002:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x7:0x0] (7340032->8388607) req@ffff95d148880700 x1876702140651008/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762778.948010:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148880700 with x1876702140651008 ext(7340032->8388607) 00002000:00010000:2.0:1789762778.948015:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148880700 00000100:00100000:2.0:1789762778.948025:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183400685443 time 183412700998 state 0x0 ref 1 00000100:00100000:2.0:1789762778.948051:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183412800998 time 183412700998 state 0x1 ref 1 00000100:00100000:2.0:1789762778.948066:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183412800998 time 183421230294 state 0x0 ref 1 00000100:00100000:2.0:1789762778.948078:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+28:2343:x1876702140651008:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762778.951009:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+30:2343:x1876702140651008:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2932us (3102us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789762778.951018:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1789762778.951025:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183412800998 time 183421230294 state 0x2 ref 0 00002000:00100000:2.0:1789762778.951037:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x7:0x0] (7340032->8388607) req@ffff95d148880700 x1876702140651008/t4294967439(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762778.951048:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148880700 with x1876702140651008 ext(7340032->8388607) 00002000:00010000:2.0:1789762778.951053:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148880700 00000100:00100000:3.0:1789762778.968876:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762778.968929:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140651136 00000100:00100000:2.0:1789762778.968936:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140651136 00002000:00100000:2.0:1789762778.968970:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7:0x0] (4194304->5242879) req@ffff95d16ffe5500 x1876702140651136/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762778.968979:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe5500 with x1876702140651136 ext(4194304->5242879) 00002000:00010000:2.0:1789762778.968983:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffe5500 00000100:00100000:2.0:1789762778.968989:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183412800998 time 183421230294 state 0x0 ref 1 00000100:00100000:2.0:1789762778.969015:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183421330294 time 183421230294 state 0x1 ref 1 00000100:00100000:2.0:1789762778.969035:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183421330294 time 183442198814 state 0x0 ref 1 00000100:00100000:2.0:1789762778.969044:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+30:2344:x1876702140651136:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762778.971922:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+32:2344:x1876702140651136:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2871us (3042us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789762778.971938:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1789762778.971952:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183421330294 time 183442198814 state 0x2 ref 0 00002000:00100000:2.0:1789762778.971967:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7:0x0] (4194304->5242879) req@ffff95d16ffe5500 x1876702140651136/t4294967440(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762778.971976:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe5500 with x1876702140651136 ext(4194304->5242879) 00002000:00010000:2.0:1789762778.971981:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffe5500 00000100:00100000:1.0:1789762778.981224:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762778.981261:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762778.981275:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140651264 00000100:00100000:3.0:1789762778.981281:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140651264 00000100:00100000:1.0:1789762778.981297:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00002000:00100000:3.0:1789762778.981315:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x7:0x0] (5242880->6291455) req@ffff95d145f04380 x1876702140651264/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789762778.981325:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140651520 00002000:00100000:3.0:1789762778.981326:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f04380 with x1876702140651264 ext(5242880->6291455) 00002000:00010000:3.0:1789762778.981336:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f04380 00000100:00100000:2.0:1789762778.981339:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140651520 00000100:00100000:3.0:1789762778.981345:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183421330294 time 183442198814 state 0x0 ref 1 00000100:00100000:1.0:1789762778.981353:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00002000:00100000:2.0:1789762778.981378:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x7:0x0] (3145728->4194303) req@ffff95d145f04e00 x1876702140651520/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1789762778.981381:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183442298814 time 183442198814 state 0x1 ref 1 00000100:00100000:0.0:1789762778.981396:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140651392 00000100:00100000:0.0:1789762778.981407:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140651392 00000100:00100000:1.0:1789762778.981416:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140651648 00002000:00100000:2.0:1789762778.981420:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f04e00 with x1876702140651520 ext(3145728->4194303) 00000100:00100000:1.0:1789762778.981428:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140651648 00000100:00100000:3.0:1789762778.981432:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183442298814 time 183454590816 state 0x0 ref 1 00002000:00010000:2.0:1789762778.981433:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f04e00 00002000:00100000:0.0:1789762778.981443:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x7:0x0] (6291456->7340031) req@ffff95d145f06a00 x1876702140651392/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1789762778.981453:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+35:2342:x1876702140651264:12345-192.168.203.31@tcp:4:dd.0 00002000:00100000:1.0:1789762778.981464:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7:0x0] (2097152->3145727) req@ffff95d148cd6300 x1876702140651648/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1789762789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789762778.981464:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183454690816 time 183454590816 state 0x1 ref 2 00002000:00100000:0.0:1789762778.981495:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f06a00 with x1876702140651392 ext(6291456->7340031) 00002000:00010000:0.0:1789762778.981500:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f06a00 00000100:00100000:2.0:1789762778.981513:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 1 deadline 183454690816 time 183454676473 state 0x0 ref 3 00002000:00100000:1.0:1789762778.981545:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148cd6300 with x1876702140651648 ext(2097152->3145727) 00000100:00100000:0.0:1789762778.981546:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 1 deadline 183454776473 time 183454676473 state 0x1 ref 3 00000100:00100000:2.0:1789762778.981546:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+36:2342:x1876702140651520:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762778.981565:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148cd6300 00000100:00100000:1.0:1789762778.981590:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 1 deadline 183454776473 time 183454676473 state 0x1 ref 4 00000100:00100000:0.0:1789762778.981605:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 0 deadline 183454866903 time 183454766903 state 0x1 ref 4 00000100:00100000:0.0:1789762778.981624:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+36:2342:x1876702140651392:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762778.986097:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+39:2342:x1876702140651264:12345-192.168.203.31@tcp:4:dd.0 Request processed in 4646us (4872us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789762778.986156:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 22 00002000:00100000:3.0:1789762778.986165:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x7:0x0] (5242880->6291455) req@ffff95d145f04380 x1876702140651264/t4294967441(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762778.986173:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f04380 with x1876702140651264 ext(5242880->6291455) 00002000:00010000:3.0:1789762778.986178:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f04380 00000100:00100000:3.0:1789762778.986211:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183454866903 time 183459373378 state 0x0 ref 3 00000100:00100000:1.0:1789762778.986265:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+39:2342:x1876702140651520:12345-192.168.203.31@tcp:4:dd.0 Request processed in 4726us (5003us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1789762778.986273:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 23 00002000:00100000:1.0:1789762778.986280:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x7:0x0] (3145728->4194303) req@ffff95d145f04e00 x1876702140651520/t4294967442(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762778.986290:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f04e00 with x1876702140651520 ext(3145728->4194303) 00000100:00100000:3.0:1789762778.986291:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+39:2342:x1876702140651648:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762778.986295:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f04e00 00000100:00100000:1.0:1789762778.988751:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+40:2342:x1876702140651392:12345-192.168.203.31@tcp:4:dd.0 Request processed in 7130us (7455us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789762778.988771:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 24 00002000:00100000:1.0:1789762778.988780:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x7:0x0] (6291456->7340031) req@ffff95d145f06a00 x1876702140651392/t4294967443(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762778.988787:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f06a00 with x1876702140651392 ext(6291456->7340031) 00002000:00010000:1.0:1789762778.988791:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f06a00 00000100:00100000:0.0:1789762778.990218:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+40:2342:x1876702140651648:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3982us (8863us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789762778.990226:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1789762778.990232:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183454866903 time 183459373378 state 0x2 ref 0 00002000:00100000:0.0:1789762778.990242:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x7:0x0] (2097152->3145727) req@ffff95d148cd6300 x1876702140651648/t4294967444(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762778.990249:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148cd6300 with x1876702140651648 ext(2097152->3145727) 00002000:00010000:0.0:1789762778.990254:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148cd6300 00000100:00100000:3.0:1789762779.032520:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183705674084 time 183505674084 state 0x1 ref 9 00000100:00100000:3.0:1789762779.032559:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+28:2345:x1876702140647680:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:2.0:1789762779.032610:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762779.035496:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+30:2345:x1876702140647680:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2958us (587104us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789762779.035504:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 9 00002000:00100000:2.0:1789762779.035514:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x4:0x0] (3145728->4194303) req@ffff95d145f05f80 x1876702140647680/t4294967330(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762779.035521:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f05f80 with x1876702140647680 ext(3145728->4194303) 00002000:00010000:2.0:1789762779.035526:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d145f05f80 00000100:00100000:3.0:1789762779.040127:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762779.040163:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762779.040181:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140651776 00000100:00100000:1.0:1789762779.040192:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140651776 00002000:00100000:1.0:1789762779.040229:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (1048576->2097151) req@ffff95d1742bfb80 x1876702140651776/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1789762790 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762779.040240:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1742bfb80 with x1876702140651776 ext(1048576->2097151) 00000100:00100000:2.0:1789762779.040243:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140651904 00010000:00010000:1.0:1789762779.040250:0:6660:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 30 pid: 6654 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.040250:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140651904 00010000:00010000:1.0:1789762779.040266:0:6660:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 31 pid: 6654 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762779.040273:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d1742bfb80 00002000:00100000:2.0:1789762779.040275:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (0->1048575) req@ffff95d1526ce300 x1876702140651904/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1789762790 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762779.040285:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526ce300 with x1876702140651904 ext(0->1048575) 00002000:00010000:2.0:1789762779.040288:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526ce300 00000100:00100000:1.0:1789762779.040291:0:6660:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff95d041355800 key gid={0} rule@0xffff95d150482500 gen 0 rate 10000 depth 3 token 3 deadline 0 time 183513452625 state 0x0 ref 1 00000100:00100000:2.0:1789762779.040297:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183454866903 time 183459373378 state 0x0 ref 1 00000100:00100000:1.0:1789762779.040303:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d041355800 key gid={0} rule@0xffff95d150482500 gen 0 rate 10000 depth 3 token 3 deadline 183513552625 time 183513452625 state 0x1 ref 1 00000100:00100000:2.0:1789762779.040335:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183459473378 time 183459373378 state 0x1 ref 1 00000100:00100000:1.0:1789762779.040343:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d041355800 key gid={0} rule@0xffff95d150482500 gen 0 rate 10000 depth 3 token 2 deadline 183513552625 time 183513506809 state 0x0 ref 1 00000100:00100000:1.0:1789762779.040355:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+31:2344:x1876702140651776:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762779.040368:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183459473378 time 183513531352 state 0x0 ref 1 00000100:00100000:2.0:1789762779.040383:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+31:2344:x1876702140651904:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762779.049774:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+36:2344:x1876702140651776:12345-192.168.203.31@tcp:4:dd.0 Request processed in 9416us (9644us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789762779.049784:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1789762779.049790:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d041355800 key gid={0} rule@0xffff95d150482500 gen 0 rate 10000 depth 3 token 2 deadline 183513552625 time 183513506809 state 0x2 ref 0 00002000:00100000:2.0:1789762779.049800:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (1048576->2097151) req@ffff95d1742bfb80 x1876702140651776/t4294967332(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1789762790 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762779.049808:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1742bfb80 with x1876702140651776 ext(1048576->2097151) 00000100:00100000:1.0:1789762779.049812:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+35:2344:x1876702140651904:12345-192.168.203.31@tcp:4:dd.0 Request processed in 9432us (9648us total) trans 4294967331 rc 0/0 00010000:00010000:2.0:1789762779.049819:0:6660:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 35 pid: 6654 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.049859:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 26 00010000:00010000:2.0:1789762779.049861:0:6660:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 35 pid: 6654 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.049868:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183459473378 time 183513531352 state 0x2 ref 0 00002000:00010000:2.0:1789762779.049873:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d1742bfb80 00002000:00100000:1.0:1789762779.049889:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (0->1048575) req@ffff95d1526ce300 x1876702140651904/t4294967331(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1789762790 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762779.049900:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526ce300 with x1876702140651904 ext(0->1048575) 00002000:00010000:1.0:1789762779.049906:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526ce300 00000100:00100000:0.0:1789762779.051403:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762779.051457:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140652032 00000100:00100000:1.0:1789762779.051464:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140652032 00010000:00010000:1.0:1789762779.051487:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 34 pid: 6654 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.051512:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1789762779.051518:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+34:2345:x1876702140652032:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762779.051529:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789762779.051541:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1789762779.051546:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789762777 -> 1789762778 00002000:00010000:1.0:1789762779.051550:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789762777 -> 1789762778 00010000:00010000:1.0:1789762779.051556:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 10 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 34 pid: 6654 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051584:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 10 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 34 pid: 6654 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051608:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b4f8c2f/0xd08452c77c56ec09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 10 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6bc expref: 34 pid: 6654 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051628:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762779.051632:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762779.051638:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd3730ad/0xd08452c77c56ec17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ca expref: 33 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051646:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd3730ad/0xd08452c77c56ec17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ca expref: 33 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051653:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762779.051655:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762779.051659:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000540d88e/0xd08452c77c56ec25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6d8 expref: 33 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051665:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000540d88e/0xd08452c77c56ec25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6d8 expref: 33 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051670:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762779.051671:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762779.051674:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56ec2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6df expref: 33 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051679:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56ec2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6df expref: 33 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051683:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762779.051688:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762779.051693:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef8605ce/0xd08452c77c56ec33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6e6 expref: 33 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051698:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef8605ce/0xd08452c77c56ec33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6e6 expref: 33 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051703:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762779.051704:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762779.051707:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008838c734/0xd08452c77c56ec3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ed expref: 33 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051712:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008838c734/0xd08452c77c56ec3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ed expref: 33 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051716:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762779.051717:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762779.051720:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002809c665/0xd08452c77c56ec41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6f4 expref: 33 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051725:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002809c665/0xd08452c77c56ec41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6f4 expref: 33 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.051750:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002809c665/0xd08452c77c56ec41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6f4 expref: 33 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.051760:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149006720:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762779.051887:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008838c734/0xd08452c77c56ec3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ed expref: 33 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.051897:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149006848:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762779.051934:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef8605ce/0xd08452c77c56ec33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6e6 expref: 33 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.051942:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149006976:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762779.051968:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56ec2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6df expref: 33 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.051975:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149007104:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762779.051993:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000540d88e/0xd08452c77c56ec25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6d8 expref: 33 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.052000:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149007232:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762779.052018:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bd3730ad/0xd08452c77c56ec17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ca expref: 33 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.052024:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149007360:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762779.052040:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151e23840 going to sleep for 11 seconds 00000100:00100000:1.0:1789762779.067070:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149006720:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762779.067085:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149006848:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762779.067106:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149006976:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762779.067115:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149007104:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762779.067124:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149007232:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762779.067134:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:6672:1876702149007360:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762779.067165:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762779.067203:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+33:2345:x1876702140652032:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 15683us (15808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762779.067213:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:3.0:1789762779.088279:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762779.088390:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140652160 00000100:00100000:0.0:1789762779.088417:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140652160 00002000:00100000:0.0:1789762779.088470:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (5242880->6291455) req@ffff95d148de3800 x1876702140652160/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1789762790 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762779.088480:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de3800 with x1876702140652160 ext(5242880->6291455) 00002000:00010000:0.0:1789762779.088485:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de3800 00000100:00100000:0.0:1789762779.088499:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183459473378 time 183513531352 state 0x0 ref 1 00000100:00100000:0.0:1789762779.088537:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183513631352 time 183513531352 state 0x1 ref 1 00000100:00100000:0.0:1789762779.088560:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183513631352 time 183561723644 state 0x0 ref 1 00000100:00100000:0.0:1789762779.088586:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+33:2344:x1876702140652160:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762779.091427:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+35:2344:x1876702140652160:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2843us (3149us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789762779.091436:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1789762779.091442:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183513631352 time 183561723644 state 0x2 ref 0 00002000:00100000:0.0:1789762779.091451:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (5242880->6291455) req@ffff95d148de3800 x1876702140652160/t4294967333(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1789762790 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762779.091458:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de3800 with x1876702140652160 ext(5242880->6291455) 00002000:00010000:0.0:1789762779.091462:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de3800 00000100:00100000:2.0:1789762779.095680:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762779.095739:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140652288 00000100:00100000:1.0:1789762779.095749:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140652288 00002000:00100000:1.0:1789762779.095799:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (3145728->4194303) req@ffff95d043212300 x1876702140652288/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1789762790 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762779.095811:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d043212300 with x1876702140652288 ext(3145728->4194303) 00002000:00010000:1.0:1789762779.095816:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d043212300 00000100:00100000:1.0:1789762779.095828:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183513631352 time 183561723644 state 0x0 ref 1 00000100:00100000:1.0:1789762779.095880:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183561823644 time 183561723644 state 0x1 ref 1 00000100:00100000:2.0:1789762779.095909:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183561823644 time 183569070720 state 0x0 ref 1 00000100:00100000:2.0:1789762779.095923:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+35:2342:x1876702140652288:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762779.098769:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+37:2342:x1876702140652288:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2846us (3087us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1789762779.098781:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:1.0:1789762779.098788:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183561823644 time 183569070720 state 0x2 ref 0 00002000:00100000:1.0:1789762779.098798:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (3145728->4194303) req@ffff95d043212300 x1876702140652288/t4294967334(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1789762790 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762779.098822:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d043212300 with x1876702140652288 ext(3145728->4194303) 00002000:00010000:1.0:1789762779.098827:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d043212300 00000100:00100000:3.0:1789762779.101775:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762779.101937:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140652416 00000100:00100000:2.0:1789762779.101946:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140652416 00002000:00100000:2.0:1789762779.101977:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x5:0x0] (4194304->5242879) req@ffff95d148de1c00 x1876702140652416/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1789762790 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762779.101988:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de1c00 with x1876702140652416 ext(4194304->5242879) 00002000:00010000:2.0:1789762779.101993:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de1c00 00000100:00100000:2.0:1789762779.102011:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183561823644 time 183569070720 state 0x0 ref 1 00000100:00100000:2.0:1789762779.102051:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183569170720 time 183569070720 state 0x1 ref 1 00000100:00100000:2.0:1789762779.102089:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183569170720 time 183575251819 state 0x0 ref 1 00000100:00100000:2.0:1789762779.102103:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+37:2345:x1876702140652416:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762779.105424:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+39:2345:x1876702140652416:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3319us (3645us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789762779.105436:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:2.0:1789762779.105443:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183569170720 time 183575251819 state 0x2 ref 0 00002000:00100000:2.0:1789762779.105454:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x5:0x0] (4194304->5242879) req@ffff95d148de1c00 x1876702140652416/t4294967335(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1789762790 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762779.105461:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de1c00 with x1876702140652416 ext(4194304->5242879) 00002000:00010000:2.0:1789762779.105467:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de1c00 00000100:00100000:3.0:1789762779.107306:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762779.107361:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140652544 00000100:00100000:0.0:1789762779.107382:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140652544 00002000:00100000:0.0:1789762779.107435:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (6291456->7340031) req@ffff95d148de2680 x1876702140652544/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1789762790 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762779.107449:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de2680 with x1876702140652544 ext(6291456->7340031) 00002000:00010000:0.0:1789762779.107469:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de2680 00000100:00100000:0.0:1789762779.107483:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183569170720 time 183575251819 state 0x0 ref 1 00000100:00100000:0.0:1789762779.107527:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183575351819 time 183575251819 state 0x1 ref 1 00000100:00100000:0.0:1789762779.107563:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183575351819 time 183580725523 state 0x0 ref 1 00000100:00100000:0.0:1789762779.107596:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140652544:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762779.109695:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762779.109767:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140652928 00000100:00100000:2.0:1789762779.109775:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140652928 00000100:00080000:3.0:1789762779.109825:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762779.109865:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:2.0:1789762779.109882:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+31:11075:x1876702140652928:12345-192.168.203.31@tcp:35:dd.0 00000001:00080000:2.0:1789762779.110067:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000100:00100000:2.0:1789762779.110152:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+33:11075:x1876702140652928:12345-192.168.203.31@tcp:35:dd.0 Request processed in 277us (456us total) trans 4294967382 rc 0/0 00000100:00100000:2.0:1789762779.110160:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000020:00080000:2.0:1789762779.110166:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789762779.110404:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762779.110432:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140653056 00000100:00100000:0.0:1789762779.110438:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140653056 00002000:00100000:0.0:1789762779.110462:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (7340032->8388607) req@ffff95d148de0700 x1876702140653056/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1789762790 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1789762779.110470:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00002000:00100000:0.0:1789762779.110477:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de0700 with x1876702140653056 ext(7340032->8388607) 00002000:00010000:0.0:1789762779.110483:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de0700 00000100:00100000:0.0:1789762779.110511:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183580825523 time 183580725523 state 0x1 ref 2 00000100:00100000:0.0:1789762779.110537:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140652672 00000100:00100000:0.0:1789762779.110541:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140652672 00000100:00100000:3.0:1789762779.110551:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183580825523 time 183583713626 state 0x0 ref 2 00002000:00100000:0.0:1789762779.110558:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (2097152->3145727) req@ffff95d148de3480 x1876702140652672/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1789762790 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762779.110580:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de3480 with x1876702140652672 ext(2097152->3145727) 00002000:00010000:0.0:1789762779.110585:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de3480 00000100:00100000:3.0:1789762779.110589:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+41:2344:x1876702140653056:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762779.110607:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183583813626 time 183583713626 state 0x1 ref 3 00000100:00100000:0.0:1789762779.110676:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183583813626 time 183583840388 state 0x0 ref 3 00000100:00100000:0.0:1789762779.110686:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+41:2344:x1876702140652672:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762779.114723:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+45:2344:x1876702140652672:12345-192.168.203.31@tcp:4:dd.0 Request processed in 4032us (4251us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789762779.114749:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 32 00002000:00100000:2.0:1789762779.114764:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (2097152->3145727) req@ffff95d148de3480 x1876702140652672/t4294967336(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1789762790 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762779.114776:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de3480 with x1876702140652672 ext(2097152->3145727) 00002000:00010000:2.0:1789762779.114783:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de3480 00000100:00100000:2.0:1789762779.115377:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+45:2344:x1876702140653056:12345-192.168.203.31@tcp:4:dd.0 Request processed in 4811us (4974us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1789762779.115387:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 31 00002000:00100000:2.0:1789762779.115398:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (7340032->8388607) req@ffff95d148de0700 x1876702140653056/t4294967337(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1789762790 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762779.115407:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de0700 with x1876702140653056 ext(7340032->8388607) 00002000:00010000:2.0:1789762779.115414:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de0700 00000100:00100000:2.0:1789762779.116191:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+45:2344:x1876702140652544:12345-192.168.203.31@tcp:4:dd.0 Request processed in 8601us (8885us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789762779.116203:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1789762779.116208:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183583813626 time 183583840388 state 0x2 ref 0 00002000:00100000:2.0:1789762779.116217:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (6291456->7340031) req@ffff95d148de2680 x1876702140652544/t4294967338(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1789762790 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762779.116224:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de2680 with x1876702140652544 ext(6291456->7340031) 00002000:00010000:2.0:1789762779.116227:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de2680 00010000:00010000:1.0:1789762779.174921:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762779.232697:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 183905848019 time 183705848019 state 0x1 ref 8 00000100:00100000:0.0:1789762779.232753:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+39:2345:x1876702140647808:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:3.0:1789762779.232803:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762779.235537:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+41:2345:x1876702140647808:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2810us (780485us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1789762779.235562:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 10 00002000:00100000:2.0:1789762779.235591:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (4194304->5242879) req@ffff95d145f05180 x1876702140647808/t4294967445(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762779.235603:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f05180 with x1876702140647808 ext(4194304->5242879) 00002000:00010000:2.0:1789762779.235611:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f05180 00000001:00080000:0.0:1789762779.323146:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967444 is committed 00000001:00080000:0.0:1789762779.323196:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967445 is committed 00000100:00100000:2.0:1789762779.432795:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 184105950054 time 183905950054 state 0x1 ref 7 00000100:00100000:2.0:1789762779.432825:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+9:2345:x1876702140647936:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762779.436085:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+11:2345:x1876702140647936:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3274us (974425us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789762779.436092:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 11 00002000:00100000:2.0:1789762779.436102:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x6:0x0] (5242880->6291455) req@ffff95d173d30700 x1876702140647936/t4294967446(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762779.436111:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173d30700 with x1876702140647936 ext(5242880->6291455) 00002000:00010000:2.0:1789762779.436117:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d173d30700 00000100:00100000:2.0:1789762779.632873:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 184306025901 time 184106025901 state 0x1 ref 6 00000100:00100000:2.0:1789762779.632908:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+10:2345:x1876702140648064:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762779.635794:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140648064:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2901us (1167520us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1789762779.635803:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 12 00002000:00100000:2.0:1789762779.635813:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (6291456->7340031) req@ffff95d145f05500 x1876702140648064/t4294967447(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762779.635856:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f05500 with x1876702140648064 ext(6291456->7340031) 00002000:00010000:2.0:1789762779.635863:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f05500 00000100:00100000:2.0:1789762779.832968:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 184506120241 time 184306120241 state 0x1 ref 5 00000100:00100000:2.0:1789762779.832999:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+11:2345:x1876702140648192:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762779.836032:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+13:2345:x1876702140648192:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3044us (1356950us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1789762779.836040:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 13 00002000:00100000:2.0:1789762779.836051:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (7340032->8388607) req@ffff95d145f05880 x1876702140648192/t4294967448(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762779.836059:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f05880 with x1876702140648192 ext(7340032->8388607) 00002000:00010000:2.0:1789762779.836064:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145f05880 00000100:00100000:2.0:1789762780.033051:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 184706205766 time 184506205766 state 0x1 ref 4 00000100:00100000:2.0:1789762780.033080:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+44:2344:x1876702140648320:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762780.036330:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+46:2344:x1876702140648320:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3258us (1398844us total) trans 4294967339 rc 0/0 00000100:00100000:2.0:1789762780.036341:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 14 00002000:00100000:2.0:1789762780.036354:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (4194304->5242879) req@ffff95d147271c00 x1876702140648320/t4294967339(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762780.036366:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147271c00 with x1876702140648320 ext(4194304->5242879) 00002000:00010000:2.0:1789762780.036373:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d147271c00 00010000:00010000:2.0:1789762780.198993:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762780.233120:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 184906277031 time 184706277031 state 0x1 ref 3 00000100:00100000:2.0:1789762780.233147:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+45:2344:x1876702140648448:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762780.236237:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+47:2344:x1876702140648448:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3099us (1592019us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789762780.236249:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 15 00002000:00100000:2.0:1789762780.236261:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (5242880->6291455) req@ffff95d145f04a80 x1876702140648448/t4294967340(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762780.236272:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f04a80 with x1876702140648448 ext(5242880->6291455) 00002000:00010000:2.0:1789762780.236279:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d145f04a80 00000100:00100000:2.0:1789762780.433173:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185106327847 time 184906327847 state 0x1 ref 2 00000100:00100000:2.0:1789762780.433205:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+46:2345:x1876702140648576:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762780.436218:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+48:2345:x1876702140648576:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3025us (1598333us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789762780.436227:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 16 00002000:00100000:2.0:1789762780.436237:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x4:0x0] (6291456->7340031) req@ffff95d147272680 x1876702140648576/t4294967341(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762780.436246:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147272680 with x1876702140648576 ext(6291456->7340031) 00002000:00010000:2.0:1789762780.436251:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d147272680 00000100:00100000:2.0:1789762780.633239:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185106327847 time 185106394454 state 0x0 ref 1 00000100:00100000:2.0:1789762780.633268:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+47:2345:x1876702140648704:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762780.636363:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+49:2345:x1876702140648704:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3107us (1792281us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1789762780.636373:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1789762780.636380:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185106327847 time 185106394454 state 0x2 ref 0 00002000:00100000:2.0:1789762780.636394:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (7340032->8388607) req@ffff95d145f04000 x1876702140648704/t4294967342(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1789762789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762780.636405:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145f04000 with x1876702140648704 ext(7340032->8388607) 00002000:00010000:2.0:1789762780.636412:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d145f04000 00000100:00100000:1.0:1789762780.663513:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762780.663617:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140653184 00000100:00100000:0.0:1789762780.663627:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140653184 00000100:00100000:0.0:1789762780.663690:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1789762780.663701:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a049450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+49:10500:x1876702140653184:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762780.663716:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 8 locks, starting at 0 00002000:00010000:0.0:1789762780.663737:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1789762780.663741:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789762777 -> 1789762778 00002000:00010000:0.0:1789762780.663744:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789762777 -> 1789762778 00010000:00010000:0.0:1789762780.663768:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc0a6631/0xd08452c77c56ebdf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ae expref: 49 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762780.663796:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 2097152 -> 8388608 00010000:00010000:0.0:1789762780.663803:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000540d88e/0xd08452c77c56ec25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6d8 expref: 48 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762780.663813:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd3730ad/0xd08452c77c56ec17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ca expref: 47 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762780.663821:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d12a07f9/0xd08452c77c56ec2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 7 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6df expref: 46 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762780.663908:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008838c734/0xd08452c77c56ec3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6ed expref: 45 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762780.663923:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef8605ce/0xd08452c77c56ec33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6e6 expref: 44 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762780.663937:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002809c665/0xd08452c77c56ec41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6f4 expref: 43 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762780.663950:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56ec10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6c3 expref: 42 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762780.663965:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762780.664012:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a049450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+41:10500:x1876702140653184:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 313us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762780.664018:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1789762780.672275:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762780.672318:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140653312 00000100:00100000:1.0:1789762780.672324:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140653312 00000100:00100000:1.0:1789762780.672360:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:1.0:1789762780.672367:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77777931-b235-4c03-82d2-4b1d12553008+13:5572:x1876702140653312:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762780.672375:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:1.0:1789762780.672386:0:5798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1789762780.672389:0:5798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 10247 00010000:00010000:1.0:1789762780.672402:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff7398fd/0xd08452c77c56ebd8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6a7 expref: 13 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762780.672422:0:5798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1789762780.672424:0:5798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762777 -> 1789762778 00002000:00010000:1.0:1789762780.672426:0:5798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762777 -> 1789762778 00002000:00010000:1.0:1789762780.672428:0:5798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 1 -> 16391 00010000:00010000:1.0:1789762780.672433:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065fbb66f/0xd08452c77c56ec1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6d1 expref: 12 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.672442:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762780.672470:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77777931-b235-4c03-82d2-4b1d12553008+11:5572:x1876702140653312:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 104us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762780.672476:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1789762780.710881:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762780.710981:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140653568 00000100:00100000:1.0:1789762780.710991:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140653568 00000100:00100000:1.0:1789762780.711043:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:1.0:1789762780.711052:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+33:11101:x1876702140653568:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762780.711074:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762780.711090:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56ec48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e6fb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711148:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ec4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711160:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ec4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711170:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ec4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711179:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56ec56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711184:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56ec56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711188:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56ec56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711284:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56ec5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711290:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56ec5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711312:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56ec5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762780.711319:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xf:0x0]: returning size 16777216 00010000:00010000:1.0:1789762780.711400:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ec4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711406:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ec4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711410:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ec4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711414:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762780.711417:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ec4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711422:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ec4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711432:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:1.0:1789762780.711434:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762780.711437:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ec4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711441:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ec4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711449:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56ec56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711453:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56ec56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711462:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56ec56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711465:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762780.711467:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56ec56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711471:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56ec56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711476:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0xf4d4877e (ffff95d14abf2700) 00010000:00010000:1.0:1789762780.711477:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762780.711479:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56ec56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711482:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56ec56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711514:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56ec48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6fb expref: 36 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711528:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56ec5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6fb expref: 35 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.711534:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d151e90b00) 00010000:00010000:1.0:1789762780.711535:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762780.711537:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51a00, rc 0) 00000100:00100000:1.0:1789762780.711596:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+35:11101:x1876702140653568:12345-192.168.203.31@tcp:101:dd.0 Request processed in 546us (764us total) trans 4294967383 rc 0/0 00000100:00100000:1.0:1789762780.711608:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:0.0:1789762780.713121:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762780.713148:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762780.713217:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140653696 00000100:00100000:1.0:1789762780.713223:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140653696 00000100:00100000:3.0:1789762780.713249:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140653952 00000100:00100000:3.0:1789762780.713257:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140653952 00000100:00100000:1.0:1789762780.713262:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:1.0:1789762780.713272:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+12:11101:x1876702140653696:12345-192.168.203.31@tcp:101:dd.0 00000100:00100000:0.0:1789762780.713281:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:1.0:1789762780.713286:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789762780.713298:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140653824 00010000:00010000:1.0:1789762780.713300:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56ec6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e702 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762780.713305:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140653824 00000100:00100000:3.0:1789762780.713306:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:3.0:1789762780.713325:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+13:11100:x1876702140653952:12345-192.168.203.31@tcp:101:dd.0 00002000:00010000:1.0:1789762780.713328:0:10283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 8388608, mtime: 0x6aad9cd9, atime: 0x6aad9cd9, ctime: 0x6aad9cd9, blocks: 0x2807 00010000:00010000:3.0:1789762780.713336:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762780.713342:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=185s v=(0 0) 00000100:00100000:0.0:1789762780.713347:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00010000:00010000:1.0:1789762780.713350:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762780.713350:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56ec72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e710 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.713361:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56ec6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e702 expref: 14 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762780.713362:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+14:11102:x1876702140653824:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762780.713377:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762780.713384:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56ec6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e702 expref: 14 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762780.713388:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008034d957/0xd08452c77c56ec79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e709 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.713395:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50800, rc 0) 00010000:00010000:3.0:1789762780.713399:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762780.713409:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762780.713419:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56ec72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e710 expref: 16 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762780.713430:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+16:11101:x1876702140653696:12345-192.168.203.31@tcp:101:dd.0 Request processed in 159us (308us total) trans 0 rc 0/0 00010000:00010000:0.0:1789762780.713433:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1789762780.713438:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00010000:00010000:0.0:1789762780.713440:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762780.713449:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008034d957/0xd08452c77c56ec79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e709 expref: 15 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762780.713466:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008034d957/0xd08452c77c56ec79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e709 expref: 15 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762780.713467:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56ec72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e710 expref: 15 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762780.713488:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d173f5f000, rc 0) 00010000:00010000:3.0:1789762780.713492:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140031600, rc 0) 00000100:00100000:3.0:1789762780.713527:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+15:11100:x1876702140653952:12345-192.168.203.31@tcp:101:dd.0 Request processed in 207us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762780.713529:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+15:11102:x1876702140653824:12345-192.168.203.31@tcp:101:dd.0 Request processed in 166us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762780.713600:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:0.0:1789762780.713609:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:0.0:1789762780.718000:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762780.718087:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140654080 00000100:00100000:2.0:1789762780.718093:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140654080 00002000:00100000:2.0:1789762780.718121:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->1048575) req@ffff95d147273480 x1876702140654080/t0(0) o3->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1789762791 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762780.718129:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147273480 with x1876702140654080 ext(0->1048575) 00002000:00010000:2.0:1789762780.718134:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147273480 00000100:00100000:2.0:1789762780.718146:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183583813626 time 183583840388 state 0x0 ref 1 00000100:00100000:2.0:1789762780.718157:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183583940388 time 183583840388 state 0x1 ref 1 00000100:00100000:2.0:1789762780.718183:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183583940388 time 185191345999 state 0x0 ref 1 00000100:00100000:2.0:1789762780.718196:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+14:2345:x1876702140654080:12345-192.168.203.31@tcp:3:dd.0 00000100:00100000:2.0:1789762780.722072:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+14:2345:x1876702140654080:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3875us (4069us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762780.722090:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1789762780.722095:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183583940388 time 185191345999 state 0x2 ref 0 00002000:00100000:2.0:1789762780.722105:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->1048575) req@ffff95d147273480 x1876702140654080/t0(0) o3->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1789762791 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762780.722112:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147273480 with x1876702140654080 ext(0->1048575) 00002000:00010000:2.0:1789762780.722116:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147273480 00000100:00100000:1.0:1789762780.755473:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762780.755532:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140654336 00000100:00100000:3.0:1789762780.755542:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140654336 00000100:00100000:3.0:1789762780.755604:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1789762780.755613:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+35:11103:x1876702140654336:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:3.0:1789762780.755819:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+36:11103:x1876702140654336:12345-192.168.203.31@tcp:35:dd.0 Request processed in 207us (353us total) trans 4294967384 rc 0/0 00000100:00100000:3.0:1789762780.755826:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1789762780.756195:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762780.756276:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140654592 00000100:00100000:2.0:1789762780.756283:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140654592 00000100:00100000:2.0:1789762780.756324:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:2.0:1789762780.756334:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+36:11106:x1876702140654592:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762780.756346:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762780.756363:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ec80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e717 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.756437:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ec87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.756452:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ec87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.756465:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ec87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762780.756477:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xf:0x0]: returning size 16777216 00010000:00010000:2.0:1789762780.756576:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ec80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e717 expref: 39 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.756613:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ec87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e717 expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.756622:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d151e90b00) 00010000:00010000:2.0:1789762780.756625:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789762780.756628:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148888c00, rc 0) 00000100:00100000:2.0:1789762780.756664:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+38:11106:x1876702140654592:12345-192.168.203.31@tcp:101:dd.0 Request processed in 332us (471us total) trans 4294967385 rc 0/0 00000100:00100000:2.0:1789762780.756671:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:0.0:1789762780.769729:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762780.769791:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140654720 00000100:00100000:2.0:1789762780.769800:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140654720 00000100:00100000:2.0:1789762780.769864:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:2.0:1789762780.769875:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+38:11116:x1876702140654720:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789762780.769895:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762780.769909:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ec95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e71e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.769955:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ec9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.769964:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ec9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.769972:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ec9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762780.769992:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00000004:00200000:2.0:1789762780.770001:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762780.770015:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ec9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.770032:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ec95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e71e expref: 40 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.770043:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ec9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e71e expref: 39 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.770050:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:2.0:1789762780.770052:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762780.770054:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148889800, rc 0) 00000100:00100000:2.0:1789762780.770089:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+39:11116:x1876702140654720:12345-192.168.203.31@tcp:101:rm.0 Request processed in 218us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762780.770094:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:1.0:1789762780.771576:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762780.771616:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140654848 00000100:00100000:2.0:1789762780.771622:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140654848 00000100:00100000:2.0:1789762780.771649:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:2.0:1789762780.771655:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+39:11116:x1876702140654848:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:2.0:1789762780.773414:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+39:11116:x1876702140654848:12345-192.168.203.31@tcp:37:rm.0 Request processed in 1758us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762780.773420:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:3.0:1789762780.774741:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762780.774813:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140654976 00000100:00100000:1.0:1789762780.774825:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140654976 00000100:00100000:1.0:1789762780.774872:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:1.0:1789762780.774882:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+39:11116:x1876702140654976:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:1.0:1789762780.774913:0:5814:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7704936448 00000100:00100000:1.0:1789762780.774946:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+39:11116:x1876702140654976:12345-192.168.203.31@tcp:41:rm.0 Request processed in 68us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762780.774952:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:1.0:1789762780.775725:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762780.775763:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140655232 00000100:00100000:3.0:1789762780.775768:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140655232 00000100:00100000:3.0:1789762780.775795:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:3.0:1789762780.775801:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+39:11116:x1876702140655232:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:3.0:1789762780.775944:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+40:11116:x1876702140655232:12345-192.168.203.31@tcp:35:rm.0 Request processed in 143us (220us total) trans 4294967386 rc 0/0 00000100:00100000:3.0:1789762780.775950:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:0.0:1789762780.776681:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762780.776718:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140655488 00000100:00100000:2.0:1789762780.776723:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140655488 00000100:00100000:2.0:1789762780.776750:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:2.0:1789762780.776756:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+40:11116:x1876702140655488:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762780.776779:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789762780.776800:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c56ec5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6fb expref: 40 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.776815:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ec87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e717 expref: 39 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.776824:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d173f5ee00/0xd08452c77c56eaea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e653 expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.776830:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d151e90b00) 00010000:00010000:2.0:1789762780.776865:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ec9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e71e expref: 37 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.776871:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:2.0:1789762780.776874:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762780.776884:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56eca3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.776891:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56eca3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.776897:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56eca3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.776905:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ecaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.776910:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ecaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.776914:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ecaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.776970:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ecb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.776976:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ecb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.776981:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ecb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762780.777633:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 64 off8576 00000004:00080000:2.0:1789762780.777644:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 185250809336ns, next at 186250807191ns, rc = 0 00000040:00080000:2.0:1789762780.777780:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1789762780.777788:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 185250953924ns, next at 186250952689ns, rc = 0 00010000:00010000:2.0:1789762780.777853:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56ecb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.777863:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56ecb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.777870:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56ecb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.777877:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56ecb8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.777883:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56ecb8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.777889:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56ecb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.777919:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762780.777932:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ecb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.777940:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ecb1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.777948:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ecb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.777955:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762780.777956:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762780.777960:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ecb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.777963:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56ecb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.777974:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ecb1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.777975:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762780.777982:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56ecb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.777990:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:2.0:1789762780.777995:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762780.777999:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ecb1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.778000:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56ecb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.778019:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ecb1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.778026:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:1.0:1789762780.778032:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762780.778032:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56eca3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.778037:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56ecb8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.778038:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56eca3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.778056:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56eca3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.778060:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888200/0xd08452c77c56ecb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.778076:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762780.778081:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56eca3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.778086:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56eca3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.778090:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762780.778093:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:1.0:1789762780.778094:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762780.778098:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762780.778100:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762780.778101:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56eca3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.778105:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56eca3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762780.778113:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8c558ab reply state 0000000087b73958 transno 4294967387 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ecaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762780.778119:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762780.778154:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+38:11116:x1876702140655488:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1398us (1474us total) trans 4294967387 rc 0/0 00000100:00100000:2.0:1789762780.778159:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00010000:00010000:3.0:1789762780.778700:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ecaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762780.778708:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ecaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762780.778713:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ecaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762780.778717:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762780.778719:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ecaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762780.778723:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ecaa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762780.778731:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0xf4d4877e (ffff95d143e3f300) 00010000:00010000:3.0:1789762780.778733:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762780.778735:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ecaa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762780.778739:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888800/0xd08452c77c56ecaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762780.780219:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762780.780256:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140655744 00000100:00100000:2.0:1789762780.780263:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140655744 00000100:00100000:2.0:1789762780.780298:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:2.0:1789762780.780307:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+37:11116:x1876702140655744:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762780.780327:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789762780.780337:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ebfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e6b5 expref: 37 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780359:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56eb22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e661 expref: 36 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780367:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d15055d900) 00010000:00010000:2.0:1789762780.780372:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762780.780379:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ecbf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780385:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ecbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780390:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ecbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780398:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ecc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780402:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ecc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780406:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ecc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780441:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56eccd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780447:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56eccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780451:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56eccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762780.780726:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000040:00080000:2.0:1789762780.780738:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8640 00010000:00010000:2.0:1789762780.780767:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888e00/0xd08452c77c56ecd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780774:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888e00/0xd08452c77c56ecd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780779:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888e00/0xd08452c77c56ecd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780783:0:6681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888e00/0xd08452c77c56ecd4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780787:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888e00/0xd08452c77c56ecd4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780791:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888e00/0xd08452c77c56ecd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780807:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762780.780817:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56eccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780822:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56eccd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780826:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56eccd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780830:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762780.780852:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56eccd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.780856:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762780.780864:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888e00/0xd08452c77c56ecd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780867:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56eccd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.780882:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762780.780888:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d143e3f900) 00010000:00010000:1.0:1789762780.780889:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888e00/0xd08452c77c56ecd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780895:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762780.780900:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56eccd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.780902:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888e00/0xd08452c77c56ecd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780913:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56eccd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.780920:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d143e3f900) 00010000:00010000:1.0:1789762780.780924:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762780.780925:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ecbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.780927:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888e00/0xd08452c77c56ecd4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780941:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ecbf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.780942:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888e00/0xd08452c77c56ecd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780959:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ecbf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780965:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762780.780967:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ecbf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.780968:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762780.780971:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762780.780974:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762780.780976:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ecbf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780983:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:2.0:1789762780.780984:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762780.780986:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ecbf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.780997:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ecbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762780.781005:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033b5e3be reply state 000000002519ad84 transno 4294967388 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ecc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762780.781009:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762780.781041:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+37:11116:x1876702140655744:12345-192.168.203.31@tcp:36:rm.0 Request processed in 736us (822us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789762780.781047:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00010000:00010000:2.0:1789762780.781630:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ecc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.781639:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ecc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.781643:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ecc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.781647:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762780.781649:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ecc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.781653:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ecc6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.781660:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x636661f9 (ffff95d143e3f100) 00010000:00010000:2.0:1789762780.781662:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762780.781664:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ecc6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762780.781677:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ecc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762780.782120:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762780.782157:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140656000 00000100:00100000:2.0:1789762780.782163:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140656000 00000100:00100000:2.0:1789762780.782198:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1789762780.782208:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+36:11116:x1876702140656000:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:2.0:1789762780.782319:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+37:11116:x1876702140656000:12345-192.168.203.31@tcp:35:rm.0 Request processed in 113us (198us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1789762780.782328:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:0.0:1789762780.783011:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762780.783050:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140656256 00000100:00100000:1.0:1789762780.783057:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140656256 00000100:00100000:1.0:1789762780.783091:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:1.0:1789762780.783099:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+37:11116:x1876702140656256:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:1.0:1789762780.783133:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789762780.783145:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56eb30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e668 expref: 37 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783161:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56eab9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e645 expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783178:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d15055db00) 00010000:00010000:1.0:1789762780.783191:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889a00/0xd08452c77c56ea57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e630 expref: 35 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783200:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:1.0:1789762780.783207:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762780.783220:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ecdb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783229:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ecdb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783237:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ecdb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783249:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ece2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783257:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ece2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783264:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ece2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783320:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ece9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783330:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ece9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783349:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ece9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762780.783680:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00010000:00010000:1.0:1789762780.783692:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ece9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783699:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ece9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783706:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ece9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783711:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762780.783715:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ece9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783722:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ece9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783731:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:1.0:1789762780.783734:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762780.783737:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ece9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783744:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ece9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783759:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ecdb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783766:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ecdb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783780:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ecdb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783786:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762780.783790:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ecdb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783797:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ecdb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783807:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2700) 00010000:00010000:1.0:1789762780.783809:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762780.783812:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ecdb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762780.783818:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ecdb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762780.783828:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9c70fe6 reply state 00000000d37d2987 transno 4294967390 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ece2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762780.783863:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762780.783897:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+36:11116:x1876702140656256:12345-192.168.203.31@tcp:36:rm.0 Request processed in 800us (886us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789762780.783902:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00010000:00010000:3.0:1789762780.784429:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ece2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762780.784438:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ece2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762780.784449:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ece2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762780.784453:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762780.784455:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ece2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762780.784460:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ece2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762780.784467:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d14abf2600) 00010000:00010000:3.0:1789762780.784469:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762780.784471:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ece2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762780.784477:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51c00/0xd08452c77c56ece2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762781.057719:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.057763:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140656384 00000100:00100000:2.0:1789762781.057782:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140656384 00000100:00080000:0.0:1789762781.057823:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762781.057861:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:2.0:1789762781.057872:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+35:11127:x1876702140656384:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:2.0:1789762781.057902:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762781.057920:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ecf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e725 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.057974:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ecf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.057986:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ecf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.057994:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ecf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762781.058023:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762781.058039:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762781.058059:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ecf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.058088:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ecf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e725 expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.058106:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ecf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e725 expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.058115:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:2.0:1789762781.058118:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762781.058123:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148889000, rc 0) 00000100:00100000:2.0:1789762781.058179:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+36:11127:x1876702140656384:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 309us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762781.058184:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:1.0:1789762781.059362:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.059397:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140656640 00000100:00100000:2.0:1789762781.059401:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140656640 00000100:00100000:2.0:1789762781.059427:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:2.0:1789762781.059435:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+36:11127:x1876702140656640:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:2.0:1789762781.059461:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762781.059476:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ecf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e725 expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.059488:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f600) 00010000:00010000:2.0:1789762781.059496:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762781.059567:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ecfe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.059594:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ecfe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.059600:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ecfe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.059610:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed05 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.059615:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.059619:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762781.060261:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00010000:00010000:2.0:1789762781.060268:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ecfe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.060273:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ecfe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.060279:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ecfe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.060282:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.060286:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ecfe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.060291:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ecfe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.060307:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f900) 00010000:00010000:2.0:1789762781.060309:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.060311:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ecfe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.060316:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ecfe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762781.060334:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004417bb05 reply state 00000000ddbbdb24 transno 4294967391 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762781.060342:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762781.060397:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+37:11127:x1876702140656640:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 961us (1033us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789762781.060403:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00010000:00010000:2.0:1789762781.060976:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.060983:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed05 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.060987:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed05 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.060990:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.060993:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed05 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.060997:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed05 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.061014:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d143e3f300) 00010000:00010000:2.0:1789762781.061016:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.061018:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed05 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.061023:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed05 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762781.065850:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.065914:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140656768 00000100:00100000:2.0:1789762781.065920:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140656768 00000100:00100000:2.0:1789762781.065950:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:2.0:1789762781.065957:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+36:11128:x1876702140656768:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762781.065966:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762781.065975:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e72c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.066003:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ed13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.066010:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ed13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.066016:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ed13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762781.066029:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762781.066031:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762781.066039:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ed13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.066066:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e72c expref: 38 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.066081:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ed13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e72c expref: 37 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.066089:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f300) 00010000:00010000:2.0:1789762781.066093:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762781.066095:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148889600, rc 0) 00000100:00100000:2.0:1789762781.066133:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+37:11128:x1876702140656768:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 176us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762781.066139:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:0.0:1789762781.067236:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.067267:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140657024 00000100:00100000:2.0:1789762781.067272:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140657024 00000100:00100000:2.0:1789762781.067298:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:2.0:1789762781.067304:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+37:11128:x1876702140657024:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762781.067310:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762781.067312:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789762781.067321:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889600/0xd08452c77c56ed13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e72c expref: 37 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067330:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f300) 00010000:00010000:2.0:1789762781.067335:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762781.067345:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed1a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e733 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067429:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ed21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067437:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ed21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067442:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ed21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067450:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ed28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067455:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ed28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067460:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ed28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067516:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ed2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067526:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ed2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067531:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ed2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762781.067538:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00010000:00010000:2.0:1789762781.067546:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ed2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067563:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ed2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067575:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ed2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067579:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.067582:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ed2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067586:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ed2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067593:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d143e3ff00) 00010000:00010000:2.0:1789762781.067595:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.067597:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ed2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067601:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889800/0xd08452c77c56ed2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067615:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ed21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067619:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ed21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067624:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ed21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067628:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.067630:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ed21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067642:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ed21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067649:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f900) 00010000:00010000:2.0:1789762781.067651:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.067653:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ed21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067657:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889200/0xd08452c77c56ed21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067662:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ed28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067666:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ed28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067670:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ed28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067675:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.067677:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ed28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067682:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ed28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067687:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d143e3f600) 00010000:00010000:2.0:1789762781.067689:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.067691:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ed28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067702:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888000/0xd08452c77c56ed28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067722:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed1a lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e733 expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067729:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f900) 00010000:00010000:2.0:1789762781.067731:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.067735:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed1a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e733 expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.067751:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148889000, rc 0) 00000100:00100000:2.0:1789762781.067780:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+36:11128:x1876702140657024:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 477us (547us total) trans 0 rc 301/301 00000100:00100000:2.0:1789762781.067785:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:0.0:1789762781.068603:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.068637:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140657152 00000100:00100000:2.0:1789762781.068641:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140657152 00000100:00100000:2.0:1789762781.068668:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:2.0:1789762781.068675:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+36:11128:x1876702140657152:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762781.068683:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762781.068690:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ed36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e73a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.068714:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ed3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.068720:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ed3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.068731:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ed3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762781.068745:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762781.068747:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762781.068755:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ed3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.068767:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ed36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e73a expref: 38 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.068776:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ed3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e73a expref: 37 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.068781:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f700) 00010000:00010000:2.0:1789762781.068783:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762781.068786:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148888a00, rc 0) 00000100:00100000:2.0:1789762781.068812:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+37:11128:x1876702140657152:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 138us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762781.068818:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:3.0:1789762781.069646:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.069678:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140657408 00000100:00100000:2.0:1789762781.069682:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140657408 00000100:00100000:2.0:1789762781.069708:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:2.0:1789762781.069715:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+37:11128:x1876702140657408:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762781.069723:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762781.069730:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56ed44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e741 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.069774:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.069781:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.069787:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.069795:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.069801:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.069809:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762781.069901:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00010000:00010000:2.0:1789762781.069968:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.069977:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.069983:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.069990:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.069994:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.070013:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.070022:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f700) 00010000:00010000:2.0:1789762781.070024:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.070027:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.070032:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.070043:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.070048:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.070054:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.070061:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.070064:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.070071:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.070081:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d143e3fa00) 00010000:00010000:2.0:1789762781.070083:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.070087:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.070104:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.070134:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56ed44 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e741 expref: 39 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.070145:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f700) 00010000:00010000:2.0:1789762781.070148:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789762781.070152:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56ed44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e741 expref: 39 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.070162:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148889e00, rc 0) 00000100:00100000:2.0:1789762781.070190:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+38:11128:x1876702140657408:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 476us (546us total) trans 4294967392 rc 301/301 00000100:00100000:2.0:1789762781.070195:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:0.0:1789762781.071089:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.071120:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140657664 00000100:00100000:2.0:1789762781.071127:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140657664 00000100:00100000:2.0:1789762781.071159:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:2.0:1789762781.071167:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+38:11128:x1876702140657664:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:2.0:1789762781.071198:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.071205:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.071211:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762781.071308:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051b602cb reply state 0000000092bf5e70 transno 4294967393 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762781.071314:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762781.071318:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00000100:00100000:2.0:1789762781.071361:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+40:11128:x1876702140657664:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 194us (272us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789762781.071369:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 129 00010000:00010000:1.0:1789762781.071950:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.071972:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.071981:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.071987:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762781.071992:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.071997:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.072005:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d142a04100) 00010000:00010000:1.0:1789762781.072008:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789762781.072010:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.072014:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888400/0xd08452c77c56ed60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762781.072028:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.072065:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140657920 00000100:00100000:2.0:1789762781.072070:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140657920 00000100:00100000:2.0:1789762781.072105:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1789762781.072117:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15177c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+39:11128:x1876702140657920:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1789762781.072210:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15177c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+40:11128:x1876702140657920:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 97us (184us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789762781.072215:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:0.0:1789762781.076029:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.076098:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140658048 00000100:00100000:2.0:1789762781.076106:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140658048 00000100:00100000:2.0:1789762781.076148:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:2.0:1789762781.076160:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+40:11129:x1876702140658048:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:2.0:1789762781.076172:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762781.076183:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56ed67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e748 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076220:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076231:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076248:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076264:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076273:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076281:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076339:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ed7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076350:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ed7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076360:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ed7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762781.076379:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00000004:00200000:2.0:1789762781.076383:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762781.076396:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ed7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076407:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076414:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076433:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076440:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.076444:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076453:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076466:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f700) 00010000:00010000:2.0:1789762781.076470:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.076474:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076482:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56ed6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076495:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076504:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076510:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076516:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.076520:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076541:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076566:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d142a04900) 00010000:00010000:2.0:1789762781.076570:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.076574:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076581:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ed75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076610:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56ed67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e748 expref: 42 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076626:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ed7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e748 expref: 41 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.076635:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d142a04200) 00010000:00010000:2.0:1789762781.076638:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762781.076641:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148888c00, rc 0) 00000100:00100000:2.0:1789762781.076681:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+41:11129:x1876702140658048:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 524us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762781.076689:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:0.0:1789762781.077585:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.077631:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140658304 00000100:00100000:2.0:1789762781.077637:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140658304 00000100:00100000:2.0:1789762781.077672:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:2.0:1789762781.077681:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+41:11129:x1876702140658304:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:2.0:1789762781.077713:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762781.077726:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56ed7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e748 expref: 41 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.077739:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d142a04200) 00010000:00010000:2.0:1789762781.077746:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762781.077771:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.077782:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.077792:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762781.077945:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086d5d16d reply state 00000000228a67eb transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762781.077954:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762781.077960:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00000100:00100000:2.0:1789762781.078010:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+42:11129:x1876702140658304:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 328us (423us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789762781.078019:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 131 00010000:00010000:2.0:1789762781.078460:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.078467:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.078472:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.078482:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.078485:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.078490:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.078497:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d142a04d00) 00010000:00010000:2.0:1789762781.078499:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789762781.078501:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.078505:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ed83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762781.083450:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762781.083513:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140658432 00000100:00100000:1.0:1789762781.083521:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140658432 00000100:00100000:1.0:1789762781.083582:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:1.0:1789762781.083596:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+41:11130:x1876702140658432:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:1.0:1789762781.083610:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762781.083624:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ed8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e74f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.083672:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ed91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.083691:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ed91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.083701:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ed91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.083718:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ed98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.083726:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ed98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.083735:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ed98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.083809:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ed9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.083818:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ed9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.083826:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ed9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762781.083990:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00000004:00200000:1.0:1789762781.083994:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762781.084011:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ed9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084021:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ed91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084039:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ed91 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084046:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ed91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084053:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762781.084057:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ed91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084064:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ed91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084086:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f700) 00010000:00010000:1.0:1789762781.084089:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762781.084093:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ed91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084100:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c56ed91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084114:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ed98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084121:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ed98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084128:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ed98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084134:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762781.084145:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ed98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084152:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ed98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084163:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d14abf2700) 00010000:00010000:1.0:1789762781.084166:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762781.084170:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ed98 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084177:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c56ed98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084208:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c56ed8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e74f expref: 43 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084223:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ed9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e74f expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.084231:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:1.0:1789762781.084234:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789762781.084237:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51400, rc 0) 00000100:00100000:1.0:1789762781.084278:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+42:11130:x1876702140658432:12345-192.168.203.31@tcp:101:touch.500 Request processed in 687us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762781.084286:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:3.0:1789762781.085196:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762781.085221:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140658688 00000100:00100000:0.0:1789762781.085227:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140658688 00000100:00100000:0.0:1789762781.085257:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:0.0:1789762781.085265:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+42:11130:x1876702140658688:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:0.0:1789762781.085273:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762781.085282:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002aa00/0xd08452c77c56eda6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e756 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085338:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56edad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085346:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56edad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085354:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56edad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085409:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a200/0xd08452c77c56edb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085415:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a200/0xd08452c77c56edb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085420:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a200/0xd08452c77c56edb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789762781.085728:0:6681:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8:0x0], index 0: 0 00010000:00010000:0.0:1789762781.085822:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b600/0xd08452c77c56edbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085863:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b600/0xd08452c77c56edbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085871:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b600/0xd08452c77c56edbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085896:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56edad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085900:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56edad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085905:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56edad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085908:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762781.085910:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56edad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085914:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56edad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085920:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:0.0:1789762781.085922:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762781.085924:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56edad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085928:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56edad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762781.085936:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d749b06 reply state 00000000d8c27c5f transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a200/0xd08452c77c56edb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762781.085946:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789762781.085963:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002aa00/0xd08452c77c56eda6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e756 expref: 45 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085971:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b600/0xd08452c77c56edbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e756 expref: 44 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.085976:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d151e90d00) 00010000:00010000:0.0:1789762781.085978:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762781.085980:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16002b600, rc 0) 00000100:00100000:0.0:1789762781.086010:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+45:11130:x1876702140658688:12345-192.168.203.31@tcp:101:touch.500 Request processed in 747us (816us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789762781.086015:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 133 00010000:00010000:2.0:1789762781.086619:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a200/0xd08452c77c56edb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.086631:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a200/0xd08452c77c56edb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.086639:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a200/0xd08452c77c56edb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.086646:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.086650:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a200/0xd08452c77c56edb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.086658:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a200/0xd08452c77c56edb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.086681:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff95d151e90700) 00010000:00010000:2.0:1789762781.086685:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.086689:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a200/0xd08452c77c56edb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.086696:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a200/0xd08452c77c56edb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762781.087334:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.087375:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140658944 00000100:00100000:2.0:1789762781.087381:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140658944 00000100:00100000:2.0:1789762781.087420:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:2.0:1789762781.087429:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+44:11130:x1876702140658944:12345-192.168.203.31@tcp:36:touch.500 00010000:00010000:2.0:1789762781.087453:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762781.087464:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b600/0xd08452c77c56edbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e756 expref: 44 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.087476:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d151e90d00) 00010000:00010000:2.0:1789762781.087483:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762781.087503:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.087512:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.087520:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762781.087594:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000414f8a92 reply state 00000000f69f02a9 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762781.087614:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762781.087666:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+45:11130:x1876702140658944:12345-192.168.203.31@tcp:36:touch.500 Request processed in 238us (331us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789762781.087674:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 134 00010000:00010000:2.0:1789762781.088100:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.088106:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.088110:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.088113:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.088116:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.088119:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.088126:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d142a04d00) 00010000:00010000:2.0:1789762781.088127:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.088130:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.088133:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762781.088300:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762781.088328:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140659072 00000100:00100000:1.0:1789762781.088333:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140659072 00000100:00100000:1.0:1789762781.088361:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:1.0:1789762781.088368:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+44:11130:x1876702140659072:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:1.0:1789762781.088384:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762781.088393:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56edd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e75d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.088418:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56edd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e75d expref: 45 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.088425:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56edd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e75d expref: 45 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.088436:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:1.0:1789762781.088438:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789762781.088440:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50200, rc 0) 00000100:00100000:1.0:1789762781.088465:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+45:11130:x1876702140659072:12345-192.168.203.31@tcp:101:touch.500 Request processed in 98us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762781.088470:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:1.0:1789762781.089146:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.089209:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140659200 00000100:00100000:2.0:1789762781.089214:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140659200 00000100:00100000:2.0:1789762781.089267:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:2.0:1789762781.089275:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+14:2344:x1876702140659200:12345-192.168.203.31@tcp:2:touch.500 00000100:00080000:0.0:1789762781.089294:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762781.089433:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+15:2344:x1876702140659200:12345-192.168.203.31@tcp:2:touch.500 Request processed in 159us (286us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789762781.089439:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:1.0:1789762781.090224:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762781.090263:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140659456 00000100:00100000:0.0:1789762781.090269:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140659456 00000100:00100000:0.0:1789762781.090309:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1789762781.090320:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+45:11130:x1876702140659456:12345-192.168.203.31@tcp:35:touch.500 00000100:00100000:0.0:1789762781.090506:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+46:11130:x1876702140659456:12345-192.168.203.31@tcp:35:touch.500 Request processed in 189us (282us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789762781.090513:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1789762781.094584:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.094619:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140659584 00000100:00100000:2.0:1789762781.094625:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140659584 00000100:00100000:2.0:1789762781.094652:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:2.0:1789762781.094659:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+46:11131:x1876702140659584:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:2.0:1789762781.094669:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762781.094677:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56edd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e764 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094704:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56edde lrc: 3/1,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094711:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56edde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094717:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56edde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094724:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ede5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094729:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ede5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094734:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ede5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094777:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56edec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094783:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56edec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094788:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56edec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762781.094803:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x15:0x0]: returning size 0 00000004:00200000:2.0:1789762781.094806:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762781.094814:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56edec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094820:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56edec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094825:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56edde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094829:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56edde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094852:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56edde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094856:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.094859:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56edde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094865:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56edde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094878:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:2.0:1789762781.094880:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.094883:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56edde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094887:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889e00/0xd08452c77c56edde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094894:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ede5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094898:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ede5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094902:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ede5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094905:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.094908:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ede5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094911:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ede5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094915:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff95d142a04200) 00010000:00010000:2.0:1789762781.094917:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.094918:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ede5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094922:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889c00/0xd08452c77c56ede5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094946:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888c00/0xd08452c77c56edd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e764 expref: 48 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094954:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56edec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e764 expref: 47 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.094959:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:2.0:1789762781.094961:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762781.094963:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148888600, rc 0) 00000100:00100000:2.0:1789762781.094992:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+47:11131:x1876702140659584:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 334us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762781.094997:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:1.0:1789762781.095944:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762781.095975:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140659712 00000100:00100000:3.0:1789762781.095981:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140659712 00000100:00100000:3.0:1789762781.096012:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:3.0:1789762781.096018:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+15:2345:x1876702140659712:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:3.0:1789762781.096026:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762781.096035:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56edf3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e76b expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762781.096050:0:10283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x6aad9cdc, atime: 0x6aad9cdc, ctime: 0x6aad9cdc, blocks: 0x1 00010000:00010000:3.0:1789762781.096067:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=185s v=(0 0) 00010000:00010000:3.0:1789762781.096070:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762781.096076:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56edf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e76b expref: 16 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.096086:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56edf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e76b expref: 16 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.096094:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140031800, rc 0) 00000100:00100000:3.0:1789762781.096121:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+16:2345:x1876702140659712:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 103us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762781.096126:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:1.0:1789762781.097197:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.097224:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140659968 00000100:00100000:2.0:1789762781.097230:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140659968 00000100:00100000:2.0:1789762781.097258:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:2.0:1789762781.097264:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+47:11131:x1876702140659968:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:2.0:1789762781.097283:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762781.097293:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888600/0xd08452c77c56edec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e764 expref: 47 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.097303:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:2.0:1789762781.097305:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762781.097315:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edfa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.097322:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.097333:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762781.097407:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c342e3a reply state 00000000ea5e69f5 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762781.097413:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762781.097454:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+48:11131:x1876702140659968:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 190us (257us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789762781.097459:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 137 00010000:00010000:2.0:1789762781.097975:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.097981:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edfa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.097986:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.097989:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.097991:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.097996:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edfa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.098003:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:2.0:1789762781.098004:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789762781.098006:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edfa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.098020:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56edfa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762781.098111:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762781.098150:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140660096 00000100:00100000:0.0:1789762781.098156:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140660096 00000100:00100000:0.0:1789762781.098198:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:0.0:1789762781.098209:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+16:2344:x1876702140660096:12345-192.168.203.31@tcp:2:chmod.0 00002000:00010000:0.0:1789762781.098300:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789762781.098304:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762780 -> 1789762780 00002000:00010000:0.0:1789762781.098307:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb atime from disk: 1789762780 -> 1789762780 00002000:00010000:0.0:1789762781.098310:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762780 -> 1789762780 00002000:00010000:0.0:1789762781.098312:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789762781.098348:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+17:2344:x1876702140660096:12345-192.168.203.31@tcp:2:chmod.0 Request processed in 141us (236us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1789762781.098358:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:0.0:1789762781.117803:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762781.117877:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140660352 00000100:00100000:1.0:1789762781.117886:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140660352 00000100:00100000:1.0:1789762781.117931:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:1.0:1789762781.117940:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+47:11137:x1876702140660352:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:1.0:1789762781.117960:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762781.117974:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56ee01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e772 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118103:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56ee08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118114:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56ee08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118122:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56ee08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118130:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56ee0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118135:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56ee0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118140:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56ee0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118190:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ee16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118196:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ee16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118201:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ee16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762781.118208:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x15:0x0]: returning size 0 00010000:00010000:1.0:1789762781.118279:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56ee08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118292:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56ee08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118297:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56ee08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118301:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762781.118304:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56ee08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118310:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56ee08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118319:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:1.0:1789762781.118321:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762781.118324:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56ee08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118328:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c56ee08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118336:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56ee0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118341:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56ee0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118345:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56ee0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118348:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762781.118353:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56ee0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118358:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56ee0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118363:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff95d14abf2700) 00010000:00010000:1.0:1789762781.118364:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762781.118366:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56ee0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118369:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50e00/0xd08452c77c56ee0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118399:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c56ee01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e772 expref: 50 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118408:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ee16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e772 expref: 49 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762781.118412:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:1.0:1789762781.118414:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762781.118415:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e51000, rc 0) 00000100:00100000:1.0:1789762781.118461:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+49:11137:x1876702140660352:12345-192.168.203.31@tcp:101:dd.500 Request processed in 523us (665us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789762781.118471:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:1.0:1789762781.119606:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.119644:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140660608 00000100:00100000:2.0:1789762781.119650:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140660608 00000100:00100000:2.0:1789762781.119681:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:2.0:1789762781.119687:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+49:11137:x1876702140660608:12345-192.168.203.31@tcp:36:dd.500 00010000:00010000:2.0:1789762781.119712:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762781.119724:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51000/0xd08452c77c56ee16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e772 expref: 49 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.119734:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:2.0:1789762781.119737:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762781.119864:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ee24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.119872:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ee24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.119879:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ee24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762781.119916:0:6681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967401 00000004:00010000:2.0:1789762781.119933:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fd925d7 reply state 0000000057f443c4 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ee24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762781.119939:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762781.119983:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+51:11137:x1876702140660608:12345-192.168.203.31@tcp:36:dd.500 Request processed in 296us (377us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789762781.119998:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 139 00000020:00080000:2.0:1789762781.120002:0:6681:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789762781.120700:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ee24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.120710:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ee24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.120717:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ee24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.120723:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762781.120727:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ee24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.120733:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ee24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.120742:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:2.0:1789762781.120745:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762781.120748:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ee24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.120754:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148889000/0xd08452c77c56ee24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762781.121013:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.121136:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140660736 00000100:00100000:2.0:1789762781.121141:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140660736 00000100:00100000:2.0:1789762781.121170:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:2.0:1789762781.121175:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+17:11137:x1876702140660736:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:2.0:1789762781.121199:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762781.121209:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ee2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e779 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.121228:0:6654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56edf3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e76b expref: 18 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.121235:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762781.121239:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762781.121243:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ee2b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e779 expref: 18 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.121265:0:6654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56edf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e76b expref: 18 pid: 10283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.121275:0:6654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56edf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e76b expref: 18 pid: 10283 timeout: 285 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762781.121285:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6654:1876702149007488:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789762781.121345:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d145556f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789762781.122160:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6654:1876702149007488:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789762781.122183:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ee2b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e779 expref: 18 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.122198:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148888600, rc 0) 00000100:00100000:2.0:1789762781.122239:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+18:11137:x1876702140660736:12345-192.168.203.31@tcp:101:dd.500 Request processed in 1063us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762781.122245:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:1.0:1789762781.122284:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762781.122373:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140660864 00000100:00100000:3.0:1789762781.122378:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140660864 00010000:00010000:3.0:1789762781.122398:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56edf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e76b expref: 18 pid: 10283 timeout: 285 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762781.122420:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1789762781.122425:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+18:2344:x1876702140660864:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762781.122434:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762781.122438:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56edf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e76b expref: 18 pid: 10283 timeout: 285 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.122446:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56edf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e76b expref: 18 pid: 10283 timeout: 285 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.122467:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56edf3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e76b expref: 18 pid: 10283 timeout: 285 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.122476:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762781.122479:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762781.122483:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ee2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e779 expref: 17 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.122490:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ee2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e779 expref: 17 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.122507:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ee2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e779 expref: 17 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762781.122515:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148de3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149007616:192.168.203.31@tcp:105: 00000100:00100000:3.0:1789762781.122577:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d147226180 going to sleep for 11 seconds 00000100:00100000:3.0:1789762781.123243:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148de3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149007616:192.168.203.31@tcp:105: 00010000:00010000:3.0:1789762781.123255:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762781.123279:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+17:2344:x1876702140660864:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 854us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762781.123284:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:1.0:1789762781.123359:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.123399:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140660992 00000100:00100000:2.0:1789762781.123404:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140660992 00002000:00010000:2.0:1789762781.123421:0:11722:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/8 (0->18446744073709551615) 00002000:00100000:2.0:1789762781.123425:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148cd5c00 with x1876702140660992 ext(0->18446744073709551615) 00002000:00010000:2.0:1789762781.123429:0:11722:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148cd5c00. 00000100:00100000:2.0:1789762781.123438:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185106327847 time 185106394454 state 0x0 ref 1 00000100:00100000:2.0:1789762781.123446:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185306394454 time 185106394454 state 0x1 ref 1 00000100:00100000:2.0:1789762781.123465:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 1 deadline 185306394454 time 185596628721 state 0x0 ref 1 00000100:00100000:2.0:1789762781.123473:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+17:2345:x1876702140660992:12345-192.168.203.31@tcp:10:dd.500 00002000:00010000:2.0:1789762781.123660:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789762781.123663:0:11722:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762780 -> 1789762780 00002000:00010000:2.0:1789762781.123665:0:11722:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb atime from disk: 1789762780 -> 1789762780 00002000:00010000:2.0:1789762781.123667:0:11722:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762780 -> 1789762780 00002000:00010000:2.0:1789762781.123668:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789762781.123694:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+18:2345:x1876702140660992:12345-192.168.203.31@tcp:10:dd.500 Request processed in 223us (337us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1789762781.123700:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1789762781.123704:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 1 deadline 185306394454 time 185596628721 state 0x2 ref 0 00002000:00010000:2.0:1789762781.123708:0:11722:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/8 (0->18446744073709551615) 00002000:00100000:2.0:1789762781.123710:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148cd5c00 with x1876702140660992 ext(0->18446744073709551615) 00002000:00010000:2.0:1789762781.123720:0:11722:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148cd5c00. 00000100:00100000:0.0:1789762781.126467:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.126532:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140661120 00000100:00100000:2.0:1789762781.126537:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140661120 00000100:00100000:2.0:1789762781.126575:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 1 deadline 185306394454 time 185596628721 state 0x0 ref 1 00000100:00100000:2.0:1789762781.126582:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 1 deadline 185796628721 time 185596628721 state 0x1 ref 1 00000100:00100000:2.0:1789762781.126606:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185796628721 time 185599771246 state 0x0 ref 1 00000100:00100000:2.0:1789762781.126615:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+18:2344:x1876702140661120:12345-192.168.203.31@tcp:4:dd.500 00010000:00010000:2.0:1789762781.126633:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.126644:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ee2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e779 expref: 18 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.126651:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762781.126653:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789762781.126656:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.126669:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ee2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e779 expref: 18 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.126677:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ee2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e779 expref: 18 pid: 6654 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762781.126684:0:6661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:6661:1876702149007744:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789762781.126728:0:6661:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d145556f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789762781.127441:0:6661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:6661:1876702149007744:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789762781.127452:0:6661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762781.127601:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762781.127640:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140661248 00000100:00100000:3.0:1789762781.127647:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140661248 00010000:00010000:3.0:1789762781.127664:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ee2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e779 expref: 19 pid: 6654 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762781.127733:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:3.0:1789762781.127739:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+19:2344:x1876702140661248:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762781.127747:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762781.127766:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ee2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e779 expref: 19 pid: 6654 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.127776:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ee2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e779 expref: 19 pid: 6654 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.127787:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ee2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e779 expref: 19 pid: 6654 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.127796:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789762781.127798:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789762781.127802:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.127807:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.127822:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762781.127857:0:6661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.127865:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762781.127873:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+18:2344:x1876702140661248:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 133us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762781.127880:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000001:00080000:3.0:1789762781.148108:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967450 is committed 00000001:00080000:3.0:1789762781.148119:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967452 is committed 00002000:00010000:0.0:1789762781.148125:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1789762781.148130:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1789762781.148142:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.148153:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.148161:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.148166:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762781.148169:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.148187:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.148202:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.148207:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ee32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762781.148275:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140661120:12345-192.168.203.31@tcp:4:dd.500 Request processed in 21658us (21808us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789762781.148288:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1789762781.148296:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185796628721 time 185599771246 state 0x2 ref 0 00000100:00100000:0.0:1789762781.153200:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.153243:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140661376 00000100:00100000:2.0:1789762781.153252:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140661376 00000100:00100000:2.0:1789762781.153293:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185796628721 time 185599771246 state 0x0 ref 1 00000100:00100000:2.0:1789762781.153303:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185799771246 time 185599771246 state 0x1 ref 1 00010000:00010000:1.0:1789762781.222936:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762781.326698:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185799771246 time 185799854003 state 0x0 ref 1 00000100:00100000:2.0:1789762781.326725:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140661376:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762781.326775:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 1048576, mtime: 0x6aad9cdc, atime: 0x6aad9cdc, ctime: 0x6aad9cdc, blocks: 0x803 00010000:00010000:2.0:1789762781.326783:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.326796:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=185s v=(0 0) 00010000:00010000:2.0:1789762781.326800:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762781.326804:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.326828:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762781.341857:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1789762781.341862:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 2051 -> 4103 00000001:00080000:0.0:1789762781.341875:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967453 is committed 00010000:00010000:2.0:1789762781.341875:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.341886:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.341894:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.341899:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762781.341903:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.341910:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.341923:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.341928:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762781.342004:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140661376:12345-192.168.203.31@tcp:4:dd.500 Request processed in 15290us (188807us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789762781.342013:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1789762781.342021:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185799771246 time 185799854003 state 0x2 ref 0 00000100:00100000:1.0:1789762781.344136:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762781.344201:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140661504 00000100:00100000:0.0:1789762781.344211:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140661504 00000100:00100000:0.0:1789762781.344249:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185799771246 time 185799854003 state 0x0 ref 1 00000100:00100000:0.0:1789762781.344261:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185999854003 time 185799854003 state 0x1 ref 1 00000100:00100000:2.0:1789762781.526793:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185999854003 time 185999949269 state 0x0 ref 1 00000100:00100000:2.0:1789762781.526822:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140661504:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762781.526909:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 2097152, mtime: 0x6aad9cdc, atime: 0x6aad9cdc, ctime: 0x6aad9cdc, blocks: 0x1007 00010000:00010000:2.0:1789762781.526917:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.526930:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=185s v=(0 0) 00010000:00010000:2.0:1789762781.526934:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762781.526939:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.526950:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762781.539626:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1789762781.539631:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1789762781.539641:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.539661:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.539667:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.539672:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762781.539676:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.539682:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.539696:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.539702:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b4f8c2f/0xd08452c77c56ee40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762781.539762:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+10:2344:x1876702140661504:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12952us (195626us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789762781.539770:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1789762781.539776:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185999854003 time 185999949269 state 0x2 ref 0 00000001:00080000:0.0:1789762781.539807:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967454 is committed 00000100:00100000:3.0:1789762781.542074:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.542151:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140661632 00000100:00100000:2.0:1789762781.542160:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140661632 00000100:00100000:2.0:1789762781.542193:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 185999854003 time 185999949269 state 0x0 ref 1 00000100:00100000:2.0:1789762781.542202:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186199949269 time 185999949269 state 0x1 ref 1 00000100:00100000:0.0:1789762781.726875:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186199949269 time 186200030793 state 0x0 ref 1 00000100:00100000:0.0:1789762781.726917:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140661632:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762781.726967:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 3145728, mtime: 0x6aad9cdc, atime: 0x6aad9cdc, ctime: 0x6aad9cdc, blocks: 0x1807 00010000:00010000:0.0:1789762781.726974:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56ee47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.726988:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=186s v=(0 0) 00010000:00010000:0.0:1789762781.726991:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762781.726996:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56ee47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.727007:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56ee47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762781.739936:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1789762781.739941:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762780 -> 1789762781 00002000:00010000:0.0:1789762781.739943:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762780 -> 1789762781 00002000:00010000:0.0:1789762781.739945:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1789762781.739953:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56ee47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.739962:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56ee47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.739969:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56ee47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.739985:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ba00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762781.739988:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56ee47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.739995:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56ee47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.740008:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56ee47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762781.740013:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56ee47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762781.740073:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+10:2345:x1876702140661632:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13165us (197997us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789762781.740080:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:0.0:1789762781.740086:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186199949269 time 186200030793 state 0x2 ref 0 00000001:00080000:0.0:1789762781.740118:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967455 is committed 00000100:00100000:1.0:1789762781.742297:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762781.742346:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140661760 00000100:00100000:2.0:1789762781.742354:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140661760 00000100:00100000:2.0:1789762781.742387:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186199949269 time 186200030793 state 0x0 ref 1 00000100:00100000:2.0:1789762781.742395:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186400030793 time 186200030793 state 0x1 ref 1 00000100:00100000:2.0:1789762781.926973:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186400030793 time 186400125376 state 0x0 ref 1 00000100:00100000:2.0:1789762781.927015:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140661760:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762781.927078:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 4194304, mtime: 0x6aad9cdd, atime: 0x6aad9cdc, ctime: 0x6aad9cdd, blocks: 0x2007 00010000:00010000:2.0:1789762781.927088:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ee4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.927105:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=186s v=(0 0) 00010000:00010000:2.0:1789762781.927110:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762781.927116:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ee4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762781.927130:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ee4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762781.951119:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967456 is committed 00002000:00010000:3.0:1789762781.951205:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1789762781.951215:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1789762781.951233:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ee4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.951250:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ee4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.951263:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ee4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.951273:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762781.951279:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ee4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.951291:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ee4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.951313:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ee4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762781.951323:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ee4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762781.951433:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140661760:12345-192.168.203.31@tcp:4:dd.500 Request processed in 24431us (209131us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789762781.951461:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1789762781.951471:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186400030793 time 186400125376 state 0x2 ref 0 00000100:00100000:1.0:1789762781.955400:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762781.955534:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140661888 00000100:00100000:0.0:1789762781.955570:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140661888 00000100:00100000:0.0:1789762781.955637:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186400030793 time 186400125376 state 0x0 ref 1 00000100:00100000:0.0:1789762781.955660:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186600125376 time 186400125376 state 0x1 ref 1 00000100:00100000:2.0:1789762782.127160:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186600125376 time 186600310436 state 0x0 ref 1 00000100:00100000:2.0:1789762782.127196:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140661888:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762782.127268:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 5242880, mtime: 0x6aad9cdd, atime: 0x6aad9cdc, ctime: 0x6aad9cdd, blocks: 0x2807 00010000:00010000:2.0:1789762782.127280:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ee55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.127319:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=186s v=(0 0) 00010000:00010000:2.0:1789762782.127325:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762782.127333:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ee55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.127352:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ee55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762782.152943:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967457 is committed 00002000:00010000:0.0:1789762782.153067:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1789762782.153089:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1789762782.153109:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ee55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.153126:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ee55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.153139:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ee55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.153148:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762782.153154:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ee55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.153166:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ee55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.153190:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ee55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.153200:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ee55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762782.153317:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140661888:12345-192.168.203.31@tcp:4:dd.500 Request processed in 26130us (197918us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789762782.153332:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1789762782.153343:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186600125376 time 186600310436 state 0x2 ref 0 00000100:00100000:3.0:1789762782.157395:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762782.157518:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140662016 00000100:00100000:0.0:1789762782.157533:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140662016 00000100:00100000:0.0:1789762782.157633:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186600125376 time 186600310436 state 0x0 ref 1 00000100:00100000:0.0:1789762782.157656:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186800310436 time 186600310436 state 0x1 ref 1 00010000:00010000:2.0:1789762782.247079:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762782.327255:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186800310436 time 186800409906 state 0x0 ref 1 00000100:00100000:0.0:1789762782.327288:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2343:x1876702140662016:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762782.327351:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 6291456, mtime: 0x6aad9cdd, atime: 0x6aad9cdc, ctime: 0x6aad9cdd, blocks: 0x3007 00010000:00010000:0.0:1789762782.327363:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.327385:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=186s v=(0 0) 00010000:00010000:0.0:1789762782.327391:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762782.327398:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.327416:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762782.352657:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967458 is committed 00002000:00010000:0.0:1789762782.352741:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1789762782.352750:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1789762782.352766:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.352783:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.352810:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.352820:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762782.352826:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.352875:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.352899:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.352909:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762782.353014:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2343:x1876702140662016:12345-192.168.203.31@tcp:4:dd.500 Request processed in 25733us (195619us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789762782.353027:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1789762782.353037:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186800310436 time 186800409906 state 0x2 ref 0 00000100:00100000:3.0:1789762782.357227:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762782.357328:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140662144 00000100:00100000:2.0:1789762782.357345:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140662144 00000100:00100000:2.0:1789762782.357407:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 186800310436 time 186800409906 state 0x0 ref 1 00000100:00100000:2.0:1789762782.357423:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187000409906 time 186800409906 state 0x1 ref 1 00000001:00080000:2.0:1789762782.393047:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000001:00080000:2.0:1789762782.393082:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000001:00080000:2.0:1789762782.393108:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1789762782.393148:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1789762782.393175:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:2.0:1789762782.393410:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149007872:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789762782.393437:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149008000:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789762782.393501:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762782.393596:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149007872 00000100:00100000:1.0:1789762782.393611:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149007872 00000100:00100000:3.0:1789762782.393613:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762782.393668:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149008000 00000100:00100000:0.0:1789762782.393682:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149008000 00000100:00100000:1.0:1789762782.393731:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789762782.393755:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149007872:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789762782.393766:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789762782.393791:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16fbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149008000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789762782.393797:0:10283:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00000100:00080000:0.0:1789762782.393805:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762782.393814:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1789762782.393821:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6 count 1 00010000:00010000:2.0:1789762782.393882:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762782.393892:0:10283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 8388608, mtime: 0x6aad9cda, atime: 0x6aad9cd9, ctime: 0x6aad9cda, blocks: 0x1 00010000:00010000:1.0:1789762782.393908:0:10283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006258da0a/0xd08452c77c56ee63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762782.393953:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=186s v=(0 0) 00010000:00010000:1.0:1789762782.393961:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762782.393966:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56ec6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e702 expref: 8 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762782.393973:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006258da0a/0xd08452c77c56ee63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.394022:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008034d957/0xd08452c77c56ec79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e709 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762782.394025:0:10283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006258da0a/0xd08452c77c56ee63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762782.394074:0:10283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006258da0a/0xd08452c77c56ee63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.394076:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56ec72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e710 expref: 8 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762782.394114:0:10283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006258da0a/0xd08452c77c56ee63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.394119:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762782.394141:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762782.394153:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762782.394158:0:10283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762782.394208:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762782.394213:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56ec72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e710 expref: 8 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.394241:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006258da0a/0xd08452c77c56ee63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.394249:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56ec72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e710 expref: 8 pid: 8803 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.394282:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50000 already unused, calling callback (ffffffffc14a9350) 00000100:00100000:2.0:1789762782.394294:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1876702149008128:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762782.394295:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006258da0a/0xd08452c77c56ee63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.394322:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006258da0a/0xd08452c77c56ee63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.394347:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006258da0a/0xd08452c77c56ee63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.394357:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006258da0a/0xd08452c77c56ee63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.394398:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762782.394404:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762782.394410:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762782.394455:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008034d957/0xd08452c77c56ec79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e709 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.394490:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008034d957/0xd08452c77c56ec79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e709 expref: 8 pid: 6656 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762782.394507:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1876702149008256:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789762782.394610:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56ec6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e702 expref: 8 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.394634:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56ec6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e702 expref: 8 pid: 10283 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762782.394661:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1876702149008384:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789762782.394733:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d16a0c9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789762782.395266:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149007872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1508us (1753us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789762782.395287:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000004:00080000:2.0:1789762782.395328:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d042719500/2, rc 0, transno 4294967343 00000100:00100000:2.0:1789762782.395359:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149007872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789762782.396562:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1876702149008128:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789762782.396589:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1876702149008256:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789762782.396791:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762782.396870:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140662272 00000100:00100000:1.0:1789762782.396880:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140662272 00000100:00100000:2.0:1789762782.396891:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1876702149008384:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789762782.396923:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56ec72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e710 expref: 9 pid: 8803 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.396962:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762782.396979:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1789762782.397007:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77777931-b235-4c03-82d2-4b1d12553008+9:2345:x1876702140662272:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762782.397027:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789762782.397030:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:1.0:1789762782.397048:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56ec72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e710 expref: 9 pid: 8803 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762782.397078:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56ec72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e710 expref: 9 pid: 8803 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762782.397112:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762782.397118:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140662400 00010000:00010000:1.0:1789762782.397123:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c56ec72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e710 expref: 9 pid: 8803 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762782.397132:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140662400 00010000:00010000:1.0:1789762782.397158:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762782.397178:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008034d957/0xd08452c77c56ec79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e709 expref: 9 pid: 6656 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762782.397200:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140662528 00000100:00100000:2.0:1789762782.397210:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140662528 00000100:00100000:1.0:1789762782.397226:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77777931-b235-4c03-82d2-4b1d12553008+9:2345:x1876702140662272:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 225us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762782.397245:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1789762782.397261:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00010000:00010000:2.0:1789762782.397262:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56ec6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e702 expref: 10 pid: 10283 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762782.397268:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+10:2344:x1876702140662400:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762782.397300:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762782.397327:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008034d957/0xd08452c77c56ec79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e709 expref: 9 pid: 6656 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762782.397336:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00010000:00010000:0.0:1789762782.397364:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008034d957/0xd08452c77c56ec79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e709 expref: 9 pid: 6656 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762782.397366:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+9:2342:x1876702140662528:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762782.397391:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762782.397402:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56ec6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e702 expref: 9 pid: 10283 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.397408:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008034d957/0xd08452c77c56ec79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e709 expref: 9 pid: 6656 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.397440:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56ec6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e702 expref: 8 pid: 10283 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.397462:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762782.397484:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c56ec6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e702 expref: 8 pid: 10283 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.397510:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762782.397519:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1789762782.397526:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140662400:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 265us (497us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762782.397536:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762782.397569:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00010000:00010000:2.0:1789762782.397592:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.397648:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762782.397664:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.397680:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.397692:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.397703:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762782.397714:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140662528:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 353us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762782.397739:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00010000:00010000:0.0:1789762782.397754:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762782.397808:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762782.397821:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762782.397928:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762782.397939:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762782.397960:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762782.397995:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762782.398012:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ee6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762782.398047:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762782.398051:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762782.398054:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762782.398589:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16fbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149008000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4802us (4975us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1789762782.398614:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000004:00080000:3.0:1789762782.398639:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d148cd7b80/2, rc 0, transno 4294967459 00000100:00100000:3.0:1789762782.398675:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149008000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789762782.527429:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187000409906 time 187000579033 state 0x0 ref 1 00000100:00100000:0.0:1789762782.527471:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140662144:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762782.527565:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 7340032, mtime: 0x6aad9cdd, atime: 0x6aad9cdc, ctime: 0x6aad9cdd, blocks: 0x3807 00010000:00010000:0.0:1789762782.527580:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.527602:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=187s v=(0 0) 00010000:00010000:0.0:1789762782.527608:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762782.527616:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.527636:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762782.551650:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967460 is committed 00000001:00080000:3.0:1789762782.551671:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967459 is committed 00002000:00010000:0.0:1789762782.551716:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:0.0:1789762782.551724:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1789762782.551742:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.551758:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.551770:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.551798:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762782.551804:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.551815:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.551869:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee71 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.551880:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762782.551995:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140662144:12345-192.168.203.31@tcp:4:dd.500 Request processed in 24538us (194771us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789762782.552010:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1789762782.552023:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187000409906 time 187000579033 state 0x2 ref 0 00000100:00100000:3.0:1789762782.555597:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762782.555675:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140662656 00000100:00100000:2.0:1789762782.555687:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140662656 00000100:00100000:2.0:1789762782.555738:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187000409906 time 187000579033 state 0x0 ref 1 00000100:00100000:2.0:1789762782.555752:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187200579033 time 187000579033 state 0x1 ref 1 00000100:00100000:2.0:1789762782.727506:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187200579033 time 187200660178 state 0x0 ref 1 00000100:00100000:2.0:1789762782.727552:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140662656:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762782.727643:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 8388608, mtime: 0x6aad9cdd, atime: 0x6aad9cdc, ctime: 0x6aad9cdd, blocks: 0x4007 00010000:00010000:2.0:1789762782.727655:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ee78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.727670:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=187s v=(0 0) 00010000:00010000:2.0:1789762782.727675:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762782.727680:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ee78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.727692:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ee78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762782.739862:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967461 is committed 00002000:00010000:0.0:1789762782.739886:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:0.0:1789762782.739891:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762781 -> 1789762782 00002000:00010000:0.0:1789762782.739894:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762781 -> 1789762782 00002000:00010000:0.0:1789762782.739895:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:0.0:1789762782.739906:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ee78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.739917:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ee78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.739931:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ee78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.739936:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762782.739940:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ee78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.739946:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ee78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.739965:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ee78 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.739973:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ee78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762782.740050:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140662656:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12525us (184458us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789762782.740060:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:0.0:1789762782.740067:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187200579033 time 187200660178 state 0x2 ref 0 00000100:00100000:3.0:1789762782.742456:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762782.742492:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140662784 00000100:00100000:0.0:1789762782.742500:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140662784 00000100:00100000:0.0:1789762782.742534:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187200579033 time 187200660178 state 0x0 ref 1 00000100:00100000:0.0:1789762782.742557:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187400660178 time 187200660178 state 0x1 ref 1 00000100:00100000:3.0:1789762782.887007:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:0.0:1789762782.887013:0:8167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 187360178334ns, next at 188360175714ns, rc = 0 00000100:00100000:3.0:1789762782.887030:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d151b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149008512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762782.887096:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762782.887098:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789762782.887111:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149008640:0@lo:400:kworker.0 00000100:00100000:3.0:1789762782.887157:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789762782.887164:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762782.887169:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149009024:0@lo:400:kworker.0 00000100:00100000:1.0:1789762782.887190:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149008768:0@lo:400:kworker.0 00000100:00100000:3.0:1789762782.887209:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762782.887215:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789762782.887227:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149009152:0@lo:400:kworker.0 00000100:00100000:1.0:1789762782.887246:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762782.887261:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149008512 00000100:00100000:3.0:1789762782.887278:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149008512 00000100:00100000:0.0:1789762782.887289:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762782.887301:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789762782.887314:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149008896:0@lo:400:kworker.0 00000100:00100000:3.0:1789762782.887336:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789762782.887337:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149008768 00000100:00100000:0.0:1789762782.887344:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149008768 00000100:00100000:3.0:1789762782.887350:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149008512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762782.887358:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762782.887413:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149009152 00000100:00100000:1.0:1789762782.887416:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149008896 00000100:00100000:2.0:1789762782.887419:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149009152 00000100:00100000:3.0:1789762782.887419:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149008640 00000100:00100000:1.0:1789762782.887423:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149008896 00000100:00100000:3.0:1789762782.887426:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149008640 00000100:00100000:3.0:1789762782.887461:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789762782.887470:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149008640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762782.887478:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789762782.887487:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789762782.887494:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149008768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762782.887502:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149009152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762782.887513:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789762782.887529:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149008640:12345-0@lo:400:kworker.0 Request processed in 50us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762782.887531:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149008896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762782.887552:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789762782.887577:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149008768:12345-0@lo:400:kworker.0 Request processed in 90us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762782.887585:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789762782.887598:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149009152:12345-0@lo:400:kworker.0 Request processed in 101us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762782.887599:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149009024 00000100:00100000:3.0:1789762782.887604:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149009024 00000100:00100000:0.0:1789762782.887611:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149008896:12345-0@lo:400:kworker.0 Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762782.887617:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1789762782.887619:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762782.887633:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789762782.887639:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789762782.887648:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149009024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762782.887678:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149008896:0@lo:400:kworker.0 00000100:00100000:1.0:1789762782.887700:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149008768:0@lo:400:kworker.0 00000100:00100000:3.0:1789762782.887702:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149009024:12345-0@lo:400:kworker.0 Request processed in 55us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762782.887713:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00002000:00000024:2.0:1789762782.887721:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 98762752 pending 27262976 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762782.887758:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149009152:0@lo:400:kworker.0 00000100:00100000:2.0:1789762782.887767:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149008512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 420us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762782.887773:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149008640:0@lo:400:kworker.0 00000100:00100000:2.0:1789762782.887777:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789762782.887810:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967459 gen 2 00000004:00080000:3.0:1789762782.887815:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d148cd7b80, transno 4294967459 00000100:00100000:3.0:1789762782.887828:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149009024:0@lo:400:kworker.0 00000100:00100000:3.0:1789762782.887863:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d151b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149008512:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789762782.905963:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967333 is committed 00000001:00080000:0.0:1789762782.905993:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967343 is committed 00000001:00080000:0.0:1789762782.905996:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967334 is committed 00000001:00080000:0.0:1789762782.906001:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967342 is committed 00000100:00100000:2.0:1789762782.927629:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187400660178 time 187400784786 state 0x0 ref 1 00000100:00100000:2.0:1789762782.927659:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140662784:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762782.927711:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 9437184, mtime: 0x6aad9cde, atime: 0x6aad9cdc, ctime: 0x6aad9cde, blocks: 0x4807 00010000:00010000:2.0:1789762782.927718:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ee7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.927732:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=187s v=(0 0) 00010000:00010000:2.0:1789762782.927735:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762782.927740:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ee7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762782.927752:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ee7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762782.939781:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967462 is committed 00002000:00010000:0.0:1789762782.939850:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:0.0:1789762782.939857:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:0.0:1789762782.939873:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ee7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.939889:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ee7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.939899:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ee7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.939917:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762782.939923:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ee7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.939934:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ee7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.939954:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ee7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762782.939964:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ee7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762782.940059:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140662784:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12408us (197598us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1789762782.940071:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:0.0:1789762782.940079:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187400660178 time 187400784786 state 0x2 ref 0 00000100:00100000:1.0:1789762782.942450:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762782.942516:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140662912 00000100:00100000:0.0:1789762782.942525:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140662912 00000100:00100000:0.0:1789762782.942573:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187400660178 time 187400784786 state 0x0 ref 1 00000100:00100000:0.0:1789762782.942585:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187600784786 time 187400784786 state 0x1 ref 1 00000100:00100000:3.0:1789762783.092377:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762783.092425:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762783.092448:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762783.092451:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140663040 00000100:00100000:0.0:1789762783.092461:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140663040 00000100:00100000:3.0:1789762783.092478:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762783.092480:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140663168 00000100:00100000:2.0:1789762783.092488:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140663168 00000100:00100000:0.0:1789762783.092518:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00100000:3.0:1789762783.092519:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140663296 00000100:00100000:1.0:1789762783.092521:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140663424 00000100:00100000:3.0:1789762783.092527:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140663296 00000100:00100000:1.0:1789762783.092529:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140663424 00000100:00100000:0.0:1789762783.092558:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140663040:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762783.092558:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:2.0:1789762783.092575:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140663168:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762783.092591:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:3.0:1789762783.092601:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140663296:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762783.092608:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:1.0:1789762783.092622:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140663424:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762783.092628:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140663040:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762783.092636:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00100000:2.0:1789762783.092641:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140663168:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762783.092647:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140663296:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 47us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.092654:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:3.0:1789762783.092656:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:1.0:1789762783.092674:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140663424:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 53us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762783.092686:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00080000:2.0:1789762783.092686:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789762783.092691:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762783.127694:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187600784786 time 187600850398 state 0x0 ref 1 00000100:00100000:0.0:1789762783.127735:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140662912:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:2.0:1789762783.127758:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789762783.127793:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 10485760, mtime: 0x6aad9cde, atime: 0x6aad9cdc, ctime: 0x6aad9cde, blocks: 0x5007 00010000:00010000:0.0:1789762783.127800:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.127814:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=187s v=(0 0) 00010000:00010000:0.0:1789762783.127817:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762783.127821:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.127852:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762783.139111:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967463 is committed 00002000:00010000:0.0:1789762783.139151:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:0.0:1789762783.139157:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 20487 -> 22535 00010000:00010000:0.0:1789762783.139171:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.139186:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.139211:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.139219:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762783.139225:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.139235:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.139255:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee86 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.139265:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762783.139350:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140662912:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11636us (196896us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1789762783.139361:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:0.0:1789762783.139369:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187600784786 time 187600850398 state 0x2 ref 0 00000100:00100000:1.0:1789762783.141870:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762783.141913:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140663552 00000100:00100000:2.0:1789762783.141922:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140663552 00000100:00100000:2.0:1789762783.141955:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187600784786 time 187600850398 state 0x0 ref 1 00000100:00100000:2.0:1789762783.141966:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187800850398 time 187600850398 state 0x1 ref 1 00010000:00010000:1.0:1789762783.270939:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762783.327790:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187800850398 time 187800946628 state 0x0 ref 1 00000100:00100000:0.0:1789762783.327820:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140663552:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762783.327902:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 11534336, mtime: 0x6aad9cde, atime: 0x6aad9cdc, ctime: 0x6aad9cde, blocks: 0x5807 00010000:00010000:0.0:1789762783.327922:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.327935:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=187s v=(0 0) 00010000:00010000:0.0:1789762783.327938:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762783.327943:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.327954:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762783.339358:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967464 is committed 00002000:00010000:0.0:1789762783.339425:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:0.0:1789762783.339430:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 22535 -> 24583 00010000:00010000:0.0:1789762783.339442:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.339452:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.339458:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.339463:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762783.339467:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.339474:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.339501:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee8d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.339511:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56ee8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762783.339605:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140663552:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11795us (197733us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1789762783.339613:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:0.0:1789762783.339620:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187800850398 time 187800946628 state 0x2 ref 0 00000100:00100000:3.0:1789762783.341848:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762783.341901:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140663680 00000100:00100000:2.0:1789762783.341910:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140663680 00000100:00100000:2.0:1789762783.341945:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 187800850398 time 187800946628 state 0x0 ref 1 00000100:00100000:2.0:1789762783.341955:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188000946628 time 187800946628 state 0x1 ref 1 00000004:00080000:0.0:1789762783.398999:0:7131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 187872162724ns, next at 188872160129ns, rc = 0 00000100:00100000:1.0:1789762783.399010:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d151b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149009280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762783.399083:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762783.399123:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149009280 00000100:00100000:2.0:1789762783.399132:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149009280 00000100:00100000:2.0:1789762783.399186:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789762783.399194:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149009280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762783.399215:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 289603584 pending 0 free 3839885312 avail 3828350976 00000100:00100000:2.0:1789762783.399259:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149009280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.399265:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789762783.399302:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d151b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149009280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762783.527892:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188000946628 time 188001045166 state 0x0 ref 1 00000100:00100000:2.0:1789762783.527926:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140663680:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762783.527988:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 12582912, mtime: 0x6aad9cde, atime: 0x6aad9cdc, ctime: 0x6aad9cde, blocks: 0x6007 00010000:00010000:2.0:1789762783.527996:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.528022:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=188s v=(0 0) 00010000:00010000:2.0:1789762783.528025:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762783.528030:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.528042:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762783.539894:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 12582912 -> 13631488 00000001:00080000:3.0:1789762783.539897:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967465 is committed 00002000:00010000:2.0:1789762783.539901:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 24583 -> 26631 00010000:00010000:2.0:1789762783.539914:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.539925:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.539937:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.539945:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762783.539950:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.539960:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.539992:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.539998:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762783.540059:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140663680:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12146us (198223us total) trans 4294967465 rc 0/0 00000100:00100000:2.0:1789762783.540068:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1789762783.540074:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188000946628 time 188001045166 state 0x2 ref 0 00000100:00100000:3.0:1789762783.542165:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762783.542212:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140663808 00000100:00100000:0.0:1789762783.542221:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140663808 00000100:00100000:0.0:1789762783.542257:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188000946628 time 188001045166 state 0x0 ref 1 00000100:00100000:0.0:1789762783.542267:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188201045166 time 188001045166 state 0x1 ref 1 00000100:00100000:2.0:1789762783.728003:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188201045166 time 188201159049 state 0x0 ref 1 00000100:00100000:2.0:1789762783.728032:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140663808:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762783.728084:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 13631488, mtime: 0x6aad9cde, atime: 0x6aad9cdc, ctime: 0x6aad9cde, blocks: 0x6807 00010000:00010000:2.0:1789762783.728091:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.728105:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=188s v=(0 0) 00010000:00010000:2.0:1789762783.728110:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762783.728117:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.728132:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762783.740515:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967466 is committed 00002000:00010000:0.0:1789762783.740567:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:0.0:1789762783.740572:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762782 -> 1789762783 00002000:00010000:0.0:1789762783.740575:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762782 -> 1789762783 00002000:00010000:0.0:1789762783.740577:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 26631 -> 28679 00010000:00010000:0.0:1789762783.740590:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.740603:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.740621:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.740629:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762783.740634:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.740644:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.740663:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.740671:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56ee9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762783.740756:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140663808:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12732us (198587us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1789762783.740768:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:0.0:1789762783.740776:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188201045166 time 188201159049 state 0x2 ref 0 00000100:00100000:2.0:1789762783.742973:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762783.743015:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140663936 00000100:00100000:0.0:1789762783.743024:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140663936 00000100:00100000:0.0:1789762783.743068:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188201045166 time 188201159049 state 0x0 ref 1 00000100:00100000:0.0:1789762783.743081:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188401159049 time 188201159049 state 0x1 ref 1 00000100:00100000:0.0:1789762783.928071:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188401159049 time 188401228254 state 0x0 ref 1 00000100:00100000:0.0:1789762783.928096:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140663936:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762783.928147:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 14680064, mtime: 0x6aad9cdf, atime: 0x6aad9cdc, ctime: 0x6aad9cdf, blocks: 0x7007 00010000:00010000:0.0:1789762783.928154:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56eea2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.928168:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=188s v=(0 0) 00010000:00010000:0.0:1789762783.928172:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762783.928176:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56eea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762783.928187:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56eea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762783.938789:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967467 is committed 00002000:00010000:2.0:1789762783.938813:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:2.0:1789762783.938818:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 28679 -> 30727 00010000:00010000:2.0:1789762783.938829:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56eea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.938853:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56eea2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.938861:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56eea2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.938866:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762783.938870:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56eea2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.938876:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56eea2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.938889:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56eea2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.938895:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56eea2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762783.938973:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140663936:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10883us (195997us total) trans 4294967467 rc 0/0 00000100:00100000:2.0:1789762783.938983:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1789762783.938990:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188401159049 time 188401228254 state 0x2 ref 0 00000100:00100000:2.0:1789762783.941315:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762783.941363:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140664064 00000100:00100000:0.0:1789762783.941371:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140664064 00000100:00100000:0.0:1789762783.941407:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188401159049 time 188401228254 state 0x0 ref 1 00000100:00100000:0.0:1789762783.941415:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188601228254 time 188401228254 state 0x1 ref 1 00000100:00100000:0.0:1789762784.128154:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188601228254 time 188601310021 state 0x0 ref 1 00000100:00100000:0.0:1789762784.128184:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140664064:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762784.128244:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 15728640, mtime: 0x6aad9cdf, atime: 0x6aad9cdc, ctime: 0x6aad9cdf, blocks: 0x7807 00010000:00010000:0.0:1789762784.128252:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56eea9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.128279:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=188s v=(0 0) 00010000:00010000:0.0:1789762784.128283:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762784.128287:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56eea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.128298:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56eea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762784.139159:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967468 is committed 00002000:00010000:2.0:1789762784.139165:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:2.0:1789762784.139172:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 30727 -> 32775 00010000:00010000:2.0:1789762784.139185:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56eea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.139199:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56eea9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.139210:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56eea9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.139217:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762784.139220:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56eea9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.139227:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56eea9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.139241:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56eea9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.139252:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56eea9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762784.139307:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140664064:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11137us (197991us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789762784.139316:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:2.0:1789762784.139322:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188601228254 time 188601310021 state 0x2 ref 0 00000100:00100000:2.0:1789762784.141955:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762784.142033:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140664192 00000100:00100000:0.0:1789762784.142041:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140664192 00000100:00100000:0.0:1789762784.142073:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188601228254 time 188601310021 state 0x0 ref 1 00000100:00100000:0.0:1789762784.142082:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188801310021 time 188601310021 state 0x1 ref 1 00010000:00010000:2.0:1789762784.294954:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762784.328228:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188801310021 time 188801386038 state 0x0 ref 1 00000100:00100000:0.0:1789762784.328254:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140664192:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762784.328304:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 16777216, mtime: 0x6aad9cdf, atime: 0x6aad9cdc, ctime: 0x6aad9cdf, blocks: 0x8007 00010000:00010000:0.0:1789762784.328310:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.328323:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=188s v=(0 0) 00010000:00010000:0.0:1789762784.328327:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762784.328331:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.328357:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762784.344230:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967469 is committed 00002000:00010000:0.0:1789762784.344264:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:0.0:1789762784.344269:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 32775 -> 34823 00010000:00010000:0.0:1789762784.344279:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.344290:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.344300:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.344308:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762784.344313:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.344324:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.344343:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.344350:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762784.344420:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140664192:12345-192.168.203.31@tcp:4:dd.500 Request processed in 16174us (202462us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789762784.344428:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:0.0:1789762784.344434:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188801310021 time 188801386038 state 0x2 ref 0 00000100:00100000:1.0:1789762784.346822:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762784.346880:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140664320 00000100:00100000:2.0:1789762784.346888:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140664320 00000100:00100000:2.0:1789762784.346922:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 188801310021 time 188801386038 state 0x0 ref 1 00000100:00100000:2.0:1789762784.346931:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189001386038 time 188801386038 state 0x1 ref 1 00000100:00100000:0.0:1789762784.528316:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189001386038 time 189001472073 state 0x0 ref 1 00000100:00100000:0.0:1789762784.528349:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140664320:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762784.528402:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 17825792, mtime: 0x6aad9cdf, atime: 0x6aad9cdc, ctime: 0x6aad9cdf, blocks: 0x8807 00010000:00010000:0.0:1789762784.528410:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.528423:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=189s v=(0 0) 00010000:00010000:0.0:1789762784.528427:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762784.528431:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.528447:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762784.540819:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967470 is committed 00002000:00010000:0.0:1789762784.540932:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:0.0:1789762784.540936:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 34823 -> 36871 00010000:00010000:0.0:1789762784.540946:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.540966:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.540973:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.540978:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762784.540981:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.540988:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.541002:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762784.541007:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eeb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762784.541073:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140664320:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12735us (194247us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789762784.541085:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1789762784.541093:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189001386038 time 189001472073 state 0x2 ref 0 00000100:00100000:1.0:1789762784.543246:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762784.543325:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140664448 00000100:00100000:2.0:1789762784.543333:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140664448 00000100:00100000:2.0:1789762784.543366:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189001386038 time 189001472073 state 0x0 ref 1 00000100:00100000:2.0:1789762784.543375:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189201472073 time 189001472073 state 0x1 ref 1 00000100:00100000:2.0:1789762784.728403:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189201472073 time 189201541638 state 0x0 ref 1 00000100:00100000:2.0:1789762784.728438:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140664448:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762784.728515:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 18874368, mtime: 0x6aad9cdf, atime: 0x6aad9cdc, ctime: 0x6aad9cdf, blocks: 0x9007 00010000:00010000:2.0:1789762784.728567:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eebe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.728599:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=189s v=(0 0) 00010000:00010000:2.0:1789762784.728602:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762784.728607:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.728618:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762784.743956:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:2.0:1789762784.743964:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762783 -> 1789762784 00002000:00010000:2.0:1789762784.743967:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762783 -> 1789762784 00002000:00010000:2.0:1789762784.743970:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 36871 -> 38921 00010000:00010000:2.0:1789762784.743983:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.743997:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eebe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.744008:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eebe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.744015:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762784.744020:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eebe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.744047:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eebe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.744066:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eebe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.744074:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eebe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762784.744156:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140664448:12345-192.168.203.31@tcp:4:dd.500 Request processed in 15732us (200909us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789762784.744164:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1789762784.744169:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189201472073 time 189201541638 state 0x2 ref 0 00000001:00080000:2.0:1789762784.744216:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967471 is committed 00000100:00100000:2.0:1789762784.747304:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762784.747347:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140664576 00000100:00100000:0.0:1789762784.747360:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140664576 00000100:00100000:0.0:1789762784.747409:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189201472073 time 189201541638 state 0x0 ref 1 00000100:00100000:0.0:1789762784.747419:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189401541638 time 189201541638 state 0x1 ref 1 00000100:00100000:2.0:1789762784.928491:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189401541638 time 189401646879 state 0x0 ref 1 00000100:00100000:2.0:1789762784.928536:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140664576:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762784.928593:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 19922944, mtime: 0x6aad9ce0, atime: 0x6aad9cdc, ctime: 0x6aad9ce0, blocks: 0x9809 00010000:00010000:2.0:1789762784.928601:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eec5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.928616:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=189s v=(0 0) 00010000:00010000:2.0:1789762784.928620:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762784.928638:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eec5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.928651:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eec5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762784.944591:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967472 is committed 00002000:00010000:2.0:1789762784.944628:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:2.0:1789762784.944634:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 38921 -> 40969 00010000:00010000:2.0:1789762784.944647:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eec5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.944659:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eec5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.944666:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eec5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.944672:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762784.944676:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eec5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.944684:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eec5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.944701:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eec5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.944718:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56eec5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762784.944805:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140664576:12345-192.168.203.31@tcp:4:dd.500 Request processed in 16292us (197497us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789762784.944814:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1789762784.944821:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189401541638 time 189401646879 state 0x2 ref 0 00000100:00100000:3.0:1789762784.947494:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762784.947565:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140664704 00000100:00100000:0.0:1789762784.947574:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140664704 00000100:00100000:0.0:1789762784.947613:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189401541638 time 189401646879 state 0x0 ref 1 00000100:00100000:0.0:1789762784.947624:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189601646879 time 189401646879 state 0x1 ref 1 00000100:00100000:0.0:1789762785.128629:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189601646879 time 189601781216 state 0x0 ref 1 00000100:00100000:0.0:1789762785.128684:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140664704:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:2.0:1789762785.128755:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789762785.128760:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 20971520, mtime: 0x6aad9ce0, atime: 0x6aad9cdc, ctime: 0x6aad9ce0, blocks: 0xa009 00010000:00010000:0.0:1789762785.128775:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eecc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.128797:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=189s v=(0 0) 00010000:00010000:0.0:1789762785.128803:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762785.128811:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eecc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.128875:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eecc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762785.146895:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967473 is committed 00002000:00010000:2.0:1789762785.146935:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:2.0:1789762785.146945:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 40969 -> 43017 00010000:00010000:2.0:1789762785.146974:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eecc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762785.146984:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eecc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762785.146991:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eecc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762785.146997:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762785.147001:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eecc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762785.147009:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eecc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762785.147034:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eecc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762785.147041:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56eecc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762785.147112:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140664704:12345-192.168.203.31@tcp:4:dd.500 Request processed in 18461us (199619us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1789762785.147121:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:2.0:1789762785.147130:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189601646879 time 189601781216 state 0x2 ref 0 00000100:00100000:1.0:1789762785.149954:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762785.149993:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140664832 00000100:00100000:2.0:1789762785.150002:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140664832 00000100:00100000:2.0:1789762785.150038:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189601646879 time 189601781216 state 0x0 ref 1 00000100:00100000:2.0:1789762785.150049:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189801781216 time 189601781216 state 0x1 ref 1 00010000:00010000:0.0:1789762785.318960:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762785.328696:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189801781216 time 189801855308 state 0x0 ref 1 00000100:00100000:0.0:1789762785.328743:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140664832:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762785.328790:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 22020096, mtime: 0x6aad9ce0, atime: 0x6aad9cdc, ctime: 0x6aad9ce0, blocks: 0xa809 00010000:00010000:0.0:1789762785.328798:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eed3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.328811:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=189s v=(0 0) 00010000:00010000:0.0:1789762785.328815:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762785.328819:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eed3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.328830:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eed3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762785.343630:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967474 is committed 00002000:00010000:0.0:1789762785.343643:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:0.0:1789762785.343649:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 43017 -> 45065 00010000:00010000:0.0:1789762785.343658:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eed3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.343667:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.343673:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.343678:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762785.343681:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.343696:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.343709:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eed3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.343714:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eed3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762785.343769:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140664832:12345-192.168.203.31@tcp:4:dd.500 Request processed in 15041us (193815us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1789762785.343777:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1789762785.343783:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189801781216 time 189801855308 state 0x2 ref 0 00000100:00100000:3.0:1789762785.346178:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762785.346236:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140664960 00000100:00100000:2.0:1789762785.346244:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140664960 00000100:00100000:2.0:1789762785.346277:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 189801781216 time 189801855308 state 0x0 ref 1 00000100:00100000:2.0:1789762785.346286:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190001855308 time 189801855308 state 0x1 ref 1 00000100:00100000:2.0:1789762785.528748:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190001855308 time 190001904044 state 0x0 ref 1 00000100:00100000:2.0:1789762785.528778:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140664960:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762785.528829:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 23068672, mtime: 0x6aad9ce0, atime: 0x6aad9cdc, ctime: 0x6aad9ce0, blocks: 0xb009 00010000:00010000:2.0:1789762785.528871:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56eeda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762785.528885:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=190s v=(0 0) 00010000:00010000:2.0:1789762785.528888:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762785.528893:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56eeda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762785.528905:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56eeda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762785.541757:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967475 is committed 00002000:00010000:0.0:1789762785.541819:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:0.0:1789762785.541823:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 45065 -> 47113 00010000:00010000:0.0:1789762785.541850:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56eeda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.541859:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56eeda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.541865:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56eeda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.541870:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762785.541880:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56eeda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.541887:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56eeda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.541901:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56eeda lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.541906:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56eeda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762785.541964:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140664960:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13199us (195793us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1789762785.541971:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:0.0:1789762785.541977:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190001855308 time 190001904044 state 0x2 ref 0 00000100:00100000:1.0:1789762785.544232:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762785.544276:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140665088 00000100:00100000:0.0:1789762785.544284:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140665088 00000100:00100000:0.0:1789762785.544316:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190001855308 time 190001904044 state 0x0 ref 1 00000100:00100000:0.0:1789762785.544326:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190201904044 time 190001904044 state 0x1 ref 1 00000100:00100000:2.0:1789762785.728896:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190201904044 time 190202047873 state 0x0 ref 1 00000100:00100000:2.0:1789762785.728935:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140665088:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762785.729007:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 24117248, mtime: 0x6aad9ce0, atime: 0x6aad9cdc, ctime: 0x6aad9ce0, blocks: 0xb809 00010000:00010000:2.0:1789762785.729016:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56eee1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762785.729034:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=190s v=(0 0) 00010000:00010000:2.0:1789762785.729039:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762785.729045:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56eee1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762785.729058:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56eee1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762785.742556:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967476 is committed 00002000:00010000:0.0:1789762785.742598:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:0.0:1789762785.742604:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762784 -> 1789762785 00002000:00010000:0.0:1789762785.742607:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762784 -> 1789762785 00002000:00010000:0.0:1789762785.742608:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 47113 -> 49161 00010000:00010000:0.0:1789762785.742620:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56eee1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.742639:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56eee1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.742646:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56eee1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.742651:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762785.742655:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56eee1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.742661:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56eee1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.742676:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56eee1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.742681:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56eee1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762785.742758:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140665088:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13840us (198524us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1789762785.742766:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:0.0:1789762785.742773:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190201904044 time 190202047873 state 0x2 ref 0 00000100:00100000:1.0:1789762785.745285:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762785.745360:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140665216 00000100:00100000:0.0:1789762785.745375:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140665216 00000100:00100000:0.0:1789762785.745410:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190201904044 time 190202047873 state 0x0 ref 1 00000100:00100000:0.0:1789762785.745419:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190402047873 time 190202047873 state 0x1 ref 1 00000100:00100000:0.0:1789762785.928954:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190402047873 time 190402103909 state 0x0 ref 1 00000100:00100000:0.0:1789762785.928993:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140665216:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762785.929064:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 25165824, mtime: 0x6aad9ce1, atime: 0x6aad9cdc, ctime: 0x6aad9ce1, blocks: 0xc009 00010000:00010000:0.0:1789762785.929073:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eee8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.929090:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=190s v=(0 0) 00010000:00010000:0.0:1789762785.929094:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762785.929100:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.929114:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762785.942634:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967477 is committed 00002000:00010000:0.0:1789762785.942667:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:0.0:1789762785.942674:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 49161 -> 51209 00010000:00010000:0.0:1789762785.942691:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.942707:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.942733:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eee8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.942743:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762785.942749:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eee8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.942761:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eee8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.942787:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eee8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762785.942798:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eee8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762785.942932:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140665216:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13950us (197642us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789762785.942945:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:0.0:1789762785.942956:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190402047873 time 190402103909 state 0x2 ref 0 00000100:00100000:3.0:1789762785.945097:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762785.945163:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140665344 00000100:00100000:2.0:1789762785.945176:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140665344 00000100:00100000:2.0:1789762785.945224:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190402047873 time 190402103909 state 0x0 ref 1 00000100:00100000:2.0:1789762785.945236:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190602103909 time 190402103909 state 0x1 ref 1 00000100:00100000:0.0:1789762786.129120:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190602103909 time 190602269618 state 0x0 ref 1 00000100:00100000:0.0:1789762786.129165:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140665344:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762786.129242:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 26214400, mtime: 0x6aad9ce1, atime: 0x6aad9cdc, ctime: 0x6aad9ce1, blocks: 0xc809 00010000:00010000:0.0:1789762786.129269:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eeef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.129287:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=190s v=(0 0) 00010000:00010000:0.0:1789762786.129291:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762786.129298:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eeef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.129313:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eeef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762786.146369:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967478 is committed 00002000:00010000:0.0:1789762786.146401:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:0.0:1789762786.146409:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 51209 -> 53257 00010000:00010000:0.0:1789762786.146424:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eeef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.146437:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eeef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.146445:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eeef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.146450:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762786.146455:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eeef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.146463:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eeef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.146493:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eeef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.146500:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eeef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762786.146619:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140665344:12345-192.168.203.31@tcp:4:dd.500 Request processed in 17475us (201518us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789762786.146628:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1789762786.146637:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190602103909 time 190602269618 state 0x2 ref 0 00000100:00100000:2.0:1789762786.150139:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762786.150219:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140665472 00000100:00100000:0.0:1789762786.150230:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140665472 00000100:00100000:0.0:1789762786.150277:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190602103909 time 190602269618 state 0x0 ref 1 00000100:00100000:0.0:1789762786.150290:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190802269618 time 190602269618 state 0x1 ref 1 00000100:00100000:2.0:1789762786.329288:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190802269618 time 190802439109 state 0x0 ref 1 00000100:00100000:2.0:1789762786.329332:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140665472:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762786.329412:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 27262976, mtime: 0x6aad9ce1, atime: 0x6aad9cdc, ctime: 0x6aad9ce1, blocks: 0xd009 00010000:00010000:2.0:1789762786.329425:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56eef6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762786.329446:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=190s v=(0 0) 00010000:00010000:2.0:1789762786.329452:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762786.329460:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56eef6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762786.329479:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56eef6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762786.343003:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789762786.350825:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967479 is committed 00002000:00010000:0.0:1789762786.351032:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:0.0:1789762786.351043:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 53257 -> 55305 00010000:00010000:0.0:1789762786.351073:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56eef6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.351086:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56eef6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.351093:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56eef6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.351113:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762786.351118:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56eef6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.351126:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56eef6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.351146:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56eef6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.351152:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56eef6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762786.351262:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140665472:12345-192.168.203.31@tcp:4:dd.500 Request processed in 21946us (201122us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789762786.351274:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1789762786.351285:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190802269618 time 190802439109 state 0x2 ref 0 00000100:00100000:3.0:1789762786.353979:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762786.354028:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140665600 00000100:00100000:0.0:1789762786.354041:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140665600 00000100:00100000:0.0:1789762786.354088:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 190802269618 time 190802439109 state 0x0 ref 1 00000100:00100000:0.0:1789762786.354101:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191002439109 time 190802439109 state 0x1 ref 1 00000100:00100000:0.0:1789762786.529416:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191002439109 time 191002566049 state 0x0 ref 1 00000100:00100000:0.0:1789762786.529459:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140665600:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762786.529569:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 28311552, mtime: 0x6aad9ce1, atime: 0x6aad9cdc, ctime: 0x6aad9ce1, blocks: 0xd809 00010000:00010000:0.0:1789762786.529579:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eefd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.529597:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=191s v=(0 0) 00010000:00010000:0.0:1789762786.529602:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762786.529608:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eefd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.529634:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eefd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762786.548763:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967480 is committed 00002000:00010000:0.0:1789762786.548815:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:0.0:1789762786.548824:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 55305 -> 57353 00010000:00010000:0.0:1789762786.548861:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eefd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.548873:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eefd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.548881:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eefd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.548888:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762786.548892:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eefd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.548914:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eefd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.548934:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eefd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.548939:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56eefd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762786.549043:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140665600:12345-192.168.203.31@tcp:4:dd.500 Request processed in 19603us (195064us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789762786.549053:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:0.0:1789762786.549062:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191002439109 time 191002566049 state 0x2 ref 0 00000100:00100000:3.0:1789762786.552907:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762786.552992:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140665728 00000100:00100000:2.0:1789762786.553019:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140665728 00000100:00100000:2.0:1789762786.553096:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191002439109 time 191002566049 state 0x0 ref 1 00000100:00100000:2.0:1789762786.553111:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191202566049 time 191002566049 state 0x1 ref 1 00000100:00100000:0.0:1789762786.729577:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191202566049 time 191202727875 state 0x0 ref 1 00000100:00100000:0.0:1789762786.729618:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140665728:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762786.729693:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 29360128, mtime: 0x6aad9ce1, atime: 0x6aad9cdc, ctime: 0x6aad9ce1, blocks: 0xe009 00010000:00010000:0.0:1789762786.729702:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.729720:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=191s v=(0 0) 00010000:00010000:0.0:1789762786.729724:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762786.729730:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.729777:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762786.743826:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967481 is committed 00002000:00010000:0.0:1789762786.743885:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:0.0:1789762786.743890:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762785 -> 1789762786 00002000:00010000:0.0:1789762786.743892:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762785 -> 1789762786 00002000:00010000:0.0:1789762786.743894:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 57353 -> 59401 00010000:00010000:0.0:1789762786.743906:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.743916:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.743924:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.743929:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762786.743933:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.743940:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.743956:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.743973:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762786.744050:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140665728:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14450us (191146us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789762786.744059:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:0.0:1789762786.744066:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191202566049 time 191202727875 state 0x2 ref 0 00000100:00100000:1.0:1789762786.746619:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762786.746703:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140665856 00000100:00100000:2.0:1789762786.746712:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140665856 00000100:00100000:2.0:1789762786.746750:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191202566049 time 191202727875 state 0x0 ref 1 00000100:00100000:2.0:1789762786.746760:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191402727875 time 191202727875 state 0x1 ref 1 00000100:00100000:2.0:1789762786.929703:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191402727875 time 191402854046 state 0x0 ref 1 00000100:00100000:2.0:1789762786.929745:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140665856:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762786.929819:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 30408704, mtime: 0x6aad9ce2, atime: 0x6aad9cdc, ctime: 0x6aad9ce2, blocks: 0xe809 00010000:00010000:2.0:1789762786.929877:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ef0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762786.929901:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=191s v=(0 0) 00010000:00010000:2.0:1789762786.929908:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762786.929917:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ef0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762786.929936:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ef0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762786.953398:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967482 is committed 00002000:00010000:0.0:1789762786.953429:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:0.0:1789762786.953438:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 59401 -> 61449 00010000:00010000:0.0:1789762786.953456:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ef0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.953474:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ef0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.953489:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ef0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.953500:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762786.953505:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ef0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.953533:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ef0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.953567:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ef0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762786.953574:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd3730ad/0xd08452c77c56ef0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762786.953660:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140665856:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23930us (207038us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789762786.953671:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:0.0:1789762786.953679:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191402727875 time 191402854046 state 0x2 ref 0 00000100:00100000:2.0:1789762786.957206:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762786.957268:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140665984 00000100:00100000:0.0:1789762786.957278:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140665984 00000100:00100000:0.0:1789762786.957334:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191402727875 time 191402854046 state 0x0 ref 1 00000100:00100000:0.0:1789762786.957344:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191602854046 time 191402854046 state 0x1 ref 1 00000100:00100000:2.0:1789762787.129863:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191602854046 time 191602990305 state 0x0 ref 1 00000100:00100000:2.0:1789762787.129936:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140665984:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:0.0:1789762787.129954:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789762787.130012:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 31457280, mtime: 0x6aad9ce2, atime: 0x6aad9cdc, ctime: 0x6aad9ce2, blocks: 0xf009 00010000:00010000:2.0:1789762787.130022:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc0a6631/0xd08452c77c56ef12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.130036:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=191s v=(0 0) 00010000:00010000:2.0:1789762787.130040:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762787.130045:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc0a6631/0xd08452c77c56ef12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.130064:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc0a6631/0xd08452c77c56ef12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762787.141829:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967483 is committed 00002000:00010000:0.0:1789762787.141873:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:0.0:1789762787.141879:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 61449 -> 63497 00010000:00010000:0.0:1789762787.141891:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc0a6631/0xd08452c77c56ef12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.141901:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc0a6631/0xd08452c77c56ef12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.141907:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc0a6631/0xd08452c77c56ef12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.141920:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762787.141924:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc0a6631/0xd08452c77c56ef12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.141930:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc0a6631/0xd08452c77c56ef12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.141946:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc0a6631/0xd08452c77c56ef12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.141953:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc0a6631/0xd08452c77c56ef12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.142042:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140665984:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12136us (184833us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789762787.142054:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:0.0:1789762787.142062:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191602854046 time 191602990305 state 0x2 ref 0 00000100:00100000:1.0:1789762787.144194:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762787.144237:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140666112 00000100:00100000:0.0:1789762787.144246:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140666112 00000100:00100000:0.0:1789762787.144283:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191602854046 time 191602990305 state 0x0 ref 1 00000100:00100000:0.0:1789762787.144293:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191802990305 time 191602990305 state 0x1 ref 1 00000100:00100000:0.0:1789762787.329974:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191802990305 time 191803121895 state 0x0 ref 1 00000100:00100000:0.0:1789762787.330008:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140666112:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762787.330072:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 32505856, mtime: 0x6aad9ce2, atime: 0x6aad9cdc, ctime: 0x6aad9ce2, blocks: 0xf809 00010000:00010000:0.0:1789762787.330079:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.330093:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=191s v=(0 0) 00010000:00010000:0.0:1789762787.330096:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762787.330101:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.330112:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762787.341447:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967484 is committed 00002000:00010000:0.0:1789762787.341520:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:0.0:1789762787.341525:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 63497 -> 65545 00010000:00010000:0.0:1789762787.341537:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.341548:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.341554:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.341559:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762787.341563:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.341581:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.341596:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef19 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.341601:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dce16c0c/0xd08452c77c56ef19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.341673:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140666112:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11681us (197479us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789762787.341682:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:0.0:1789762787.341690:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191802990305 time 191803121895 state 0x2 ref 0 00000100:00100000:3.0:1789762787.343884:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762787.343965:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140666240 00000100:00100000:2.0:1789762787.343973:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140666240 00000100:00100000:2.0:1789762787.344012:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 191802990305 time 191803121895 state 0x0 ref 1 00000100:00100000:2.0:1789762787.344024:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192003121895 time 191803121895 state 0x1 ref 1 00010000:00010000:1.0:1789762787.366910:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789762787.501807:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:2.0:1789762787.501822:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:1.0:1789762787.501909:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789762787.501932:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d14552a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149009536:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789762787.501933:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d151b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149009408:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789762787.502000:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762787.502039:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762787.502057:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149009408 00000100:00100000:0.0:1789762787.502066:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149009408 00000100:00100000:2.0:1789762787.502083:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149009536 00000100:00100000:2.0:1789762787.502091:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149009536 00000100:00080000:1.0:1789762787.502104:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762787.502108:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762787.502130:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789762787.502144:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149009408:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789762787.502145:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789762787.502163:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149009536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789762787.502177:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00080000:2.0:1789762787.502183:0:6654:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:7 count 1 00002000:00010000:0.0:1789762787.502206:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 8388608, mtime: 0x6aad9cda, atime: 0x6aad9cd9, ctime: 0x6aad9cda, blocks: 0x4007 00010000:00010000:0.0:1789762787.502214:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce16c0c/0xd08452c77c56ef20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762787.502215:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 8388608, mtime: 0x6aad9cda, atime: 0x6aad9cd9, ctime: 0x6aad9cda, blocks: 0x4007 00010000:00010000:2.0:1789762787.502230:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ef27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.502233:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=191s v=(0 0) 00010000:00010000:0.0:1789762787.502240:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762787.502248:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=191s v=(0 0) 00010000:00010000:0.0:1789762787.502252:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dce16c0c/0xd08452c77c56ef20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.502254:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762787.502266:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ef27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.502272:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dce16c0c/0xd08452c77c56ef20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.502289:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce16c0c/0xd08452c77c56ef20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.502289:0:6654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ef27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.502303:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dce16c0c/0xd08452c77c56ef20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.502313:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ef27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.502324:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762787.502325:0:6654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ef27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.502350:0:6654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789762787.502358:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789762787.502366:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dce16c0c/0xd08452c77c56ef20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.502374:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762787.502379:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762787.502379:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce16c0c/0xd08452c77c56ef20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.502387:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ef27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.502390:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce16c0c/0xd08452c77c56ef20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.502407:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762787.502413:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ef27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.502418:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dce16c0c/0xd08452c77c56ef20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.502422:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ef27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.502428:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dce16c0c/0xd08452c77c56ef20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.502441:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ef27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.502448:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007013f244/0xd08452c77c56ef27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.502454:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762787.502459:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762787.502463:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762787.502465:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762787.502475:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762787.502478:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762787.503014:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149009408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 874us (1013us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789762787.503023:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789762787.503050:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967343 gen 2 00000004:00080000:3.0:1789762787.503057:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d042719500, transno 4294967343 00000100:00100000:3.0:1789762787.503073:0:3276:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d151b31880 x1876702149009408/t4294967344(4294967344) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789762803 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762787.503081:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149009536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 922us (1041us total) trans 4294967485 rc 0/0 00000004:00080000:3.0:1789762787.503092:0:3276:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d151b31880/2, rc 0, transno 4294967344 00000100:00100000:2.0:1789762787.503093:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000004:00080000:1.0:1789762787.503103:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d14552a300/2, rc 0, transno 4294967485 00000100:00100000:1.0:1789762787.503110:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d14552a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149009536:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789762787.503110:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d151b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149009408:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789762787.530068:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192003121895 time 192003224100 state 0x0 ref 1 00000100:00100000:0.0:1789762787.530096:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140666240:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762787.530146:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 33554432, mtime: 0x6aad9ce2, atime: 0x6aad9cdc, ctime: 0x6aad9ce2, blocks: 0x10009 00010000:00010000:0.0:1789762787.530153:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.530167:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=192s v=(0 0) 00010000:00010000:0.0:1789762787.530171:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762787.530176:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.530207:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762787.544599:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967486 is committed 00000001:00080000:2.0:1789762787.544615:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967485 is committed 00002000:00010000:0.0:1789762787.544624:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:0.0:1789762787.544630:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 65545 -> 67593 00010000:00010000:0.0:1789762787.544642:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.544653:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.544660:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.544665:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762787.544669:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.544693:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.544710:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.544716:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.544803:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140666240:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14715us (200916us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789762787.544815:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1789762787.544822:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192003121895 time 192003224100 state 0x2 ref 0 00000100:00100000:3.0:1789762787.547300:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762787.547351:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140666368 00000100:00100000:2.0:1789762787.547361:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140666368 00000100:00100000:2.0:1789762787.547404:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192003121895 time 192003224100 state 0x0 ref 1 00000100:00100000:2.0:1789762787.547428:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192203224100 time 192003224100 state 0x1 ref 1 00000100:00100000:2.0:1789762787.730187:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192203224100 time 192203340080 state 0x0 ref 1 00000100:00100000:2.0:1789762787.730226:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140666368:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762787.730306:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 34603008, mtime: 0x6aad9ce2, atime: 0x6aad9cdc, ctime: 0x6aad9ce2, blocks: 0x10809 00010000:00010000:2.0:1789762787.730319:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ef35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.730339:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=192s v=(0 0) 00010000:00010000:2.0:1789762787.730345:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762787.730354:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ef35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.730372:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ef35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762787.742008:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967487 is committed 00002000:00010000:0.0:1789762787.742031:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 34603008 -> 35651584 00002000:00010000:0.0:1789762787.742036:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762786 -> 1789762787 00002000:00010000:0.0:1789762787.742038:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762786 -> 1789762787 00002000:00010000:0.0:1789762787.742040:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 67593 -> 69641 00010000:00010000:0.0:1789762787.742051:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ef35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.742064:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ef35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.742074:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ef35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.742082:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762787.742088:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ef35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.742099:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ef35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.742129:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ef35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.742135:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063245c1f/0xd08452c77c56ef35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.742211:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140666368:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12001us (194909us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1789762787.742220:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:0.0:1789762787.742226:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192203224100 time 192203340080 state 0x2 ref 0 00000100:00100000:3.0:1789762787.744388:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762787.744422:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140666496 00000100:00100000:0.0:1789762787.744430:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140666496 00000100:00100000:0.0:1789762787.744471:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192203224100 time 192203340080 state 0x0 ref 1 00000100:00100000:0.0:1789762787.744480:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192403340080 time 192203340080 state 0x1 ref 1 00000100:00100000:2.0:1789762787.930304:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192403340080 time 192403456950 state 0x0 ref 1 00000100:00100000:2.0:1789762787.930335:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140666496:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762787.930391:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 35651584, mtime: 0x6aad9ce3, atime: 0x6aad9cdc, ctime: 0x6aad9ce3, blocks: 0x11009 00010000:00010000:2.0:1789762787.930400:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.930416:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=192s v=(0 0) 00010000:00010000:2.0:1789762787.930420:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762787.930455:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.930467:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762787.944302:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:2.0:1789762787.944309:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 69641 -> 71689 00000001:00080000:0.0:1789762787.944315:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967488 is committed 00010000:00010000:2.0:1789762787.944323:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.944336:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.944344:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.944350:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762787.944354:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.944361:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.944376:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.944393:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762787.944471:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140666496:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14146us (200080us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1789762787.944480:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:2.0:1789762787.944488:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192403340080 time 192403456950 state 0x2 ref 0 00000100:00100000:3.0:1789762787.946964:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762787.947065:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140666624 00000100:00100000:0.0:1789762787.947076:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140666624 00000100:00100000:0.0:1789762787.947137:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192403340080 time 192403456950 state 0x0 ref 1 00000100:00100000:0.0:1789762787.947150:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192603456950 time 192403456950 state 0x1 ref 1 00000100:00100000:0.0:1789762788.007046:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149009792:0@lo:400:kworker.0 00000100:00100000:3.0:1789762788.007046:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149009664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762788.007062:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149010048:0@lo:400:kworker.0 00000100:00100000:0.0:1789762788.007145:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762788.007151:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762788.007153:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.007221:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149010304:0@lo:400:kworker.0 00000100:00100000:3.0:1789762788.007223:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149010176:0@lo:400:kworker.0 00000100:00100000:1.0:1789762788.007230:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149009920:0@lo:400:kworker.0 00000100:00100000:0.0:1789762788.007286:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762788.007287:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149010048 00000100:00100000:3.0:1789762788.007287:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762788.007295:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149010048 00000100:00100000:3.0:1789762788.007356:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149009664 00000100:00100000:3.0:1789762788.007360:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149009664 00000100:00100000:1.0:1789762788.007363:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149010304 00000100:00100000:1.0:1789762788.007368:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149010304 00000100:00100000:0.0:1789762788.007376:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.007408:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149010432:0@lo:400:kworker.0 00000100:00100000:1.0:1789762788.007411:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149009920 00000100:00100000:1.0:1789762788.007416:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149009920 00000100:00100000:3.0:1789762788.007419:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789762788.007433:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149009664:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762788.007436:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149009792 00000100:00100000:1.0:1789762788.007440:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789762788.007443:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149009792 00000100:00100000:1.0:1789762788.007451:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149010048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762788.007459:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789762788.007461:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789762788.007483:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789762788.007497:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149009792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762788.007539:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149009664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762788.007543:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789762788.007546:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149010048:12345-0@lo:400:kworker.0 Request processed in 95us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.007557:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789762788.007558:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149010304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762788.007563:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789762788.007584:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149009792:12345-0@lo:400:kworker.0 Request processed in 92us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762788.007593:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789762788.007594:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149010176 00000100:00100000:1.0:1789762788.007599:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789762788.007601:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149010176 00000100:00100000:0.0:1789762788.007607:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149010304:12345-0@lo:400:kworker.0 Request processed in 53us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762788.007612:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149009920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762788.007619:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789762788.007638:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149010432 00000100:00100000:3.0:1789762788.007642:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149010432 00000100:00080000:0.0:1789762788.007649:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762788.007671:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789762788.007677:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149009920:12345-0@lo:400:kworker.0 Request processed in 67us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.007684:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149010176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762788.007689:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789762788.007715:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149010048:0@lo:400:kworker.0 00000100:00100000:1.0:1789762788.007743:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789762788.007746:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149010176:12345-0@lo:400:kworker.0 Request processed in 66us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762788.007758:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149010432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762788.007759:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789762788.007770:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149009920:0@lo:400:kworker.0 00000100:00100000:1.0:1789762788.007810:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149010432:12345-0@lo:400:kworker.0 Request processed in 59us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762788.007825:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789762788.007832:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967485 gen 2 00000004:00080000:3.0:1789762788.007843:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d14552a300, transno 4294967485 00000100:00100000:0.0:1789762788.007878:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149010432:0@lo:400:kworker.0 00000100:00100000:3.0:1789762788.007882:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149010176:0@lo:400:kworker.0 00000100:00100000:3.0:1789762788.007910:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149009664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762788.007928:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149010304:0@lo:400:kworker.0 00000100:00100000:0.0:1789762788.007941:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149009792:0@lo:400:kworker.0 00000001:00080000:0.0:1789762788.017801:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967344 is committed 00000100:00100000:0.0:1789762788.130391:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192603456950 time 192603546796 state 0x0 ref 1 00000100:00100000:0.0:1789762788.130419:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140666624:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762788.130470:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 36700160, mtime: 0x6aad9ce3, atime: 0x6aad9cdc, ctime: 0x6aad9ce3, blocks: 0x11809 00010000:00010000:0.0:1789762788.130477:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.130528:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=192s v=(0 0) 00010000:00010000:0.0:1789762788.130531:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762788.130537:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.130548:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762788.142397:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967489 is committed 00002000:00010000:0.0:1789762788.142436:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:0.0:1789762788.142439:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 71689 -> 73737 00010000:00010000:0.0:1789762788.142450:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.142459:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.142466:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.142471:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762788.142475:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.142481:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.142522:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.142529:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762788.142601:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140666624:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12192us (195637us total) trans 4294967489 rc 0/0 00000100:00100000:0.0:1789762788.142609:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:0.0:1789762788.142617:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192603456950 time 192603546796 state 0x2 ref 0 00000100:00100000:3.0:1789762788.144952:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762788.145034:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140666752 00000100:00100000:2.0:1789762788.145043:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140666752 00000100:00100000:2.0:1789762788.145078:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192603456950 time 192603546796 state 0x0 ref 1 00000100:00100000:2.0:1789762788.145088:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192803546796 time 192603546796 state 0x1 ref 1 00000100:00100000:1.0:1789762788.212660:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762788.212702:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762788.212732:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762788.212756:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140666880 00000100:00100000:1.0:1789762788.212770:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762788.212772:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140666880 00000100:00100000:2.0:1789762788.212791:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140667008 00000100:00100000:2.0:1789762788.212801:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140667008 00000100:00100000:1.0:1789762788.212813:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140667136 00000100:00100000:1.0:1789762788.212821:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140667136 00000100:00080000:0.0:1789762788.212868:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762788.212880:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762788.212904:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 247 00000100:00100000:0.0:1789762788.212913:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140667264 00000100:00100000:0.0:1789762788.212923:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140667264 00000100:00100000:3.0:1789762788.212927:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140666880:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762788.212959:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:2.0:1789762788.212963:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:1.0:1789762788.212977:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140667136:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762788.212988:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2342:x1876702140667008:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762788.213004:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:0.0:1789762788.213019:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140667264:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762788.213041:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140667136:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 65us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.213042:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140666880:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 118us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762788.213050:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2342:x1876702140667008:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 69us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762788.213062:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:3.0:1789762788.213072:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 247 00000100:00100000:0.0:1789762788.213073:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140667264:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 54us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762788.213095:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:0.0:1789762788.213105:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00080000:0.0:1789762788.213156:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762788.330529:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192803546796 time 192803679951 state 0x0 ref 1 00000100:00100000:0.0:1789762788.330591:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140666752:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762788.330672:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 37748736, mtime: 0x6aad9ce3, atime: 0x6aad9cdc, ctime: 0x6aad9ce3, blocks: 0x12009 00010000:00010000:0.0:1789762788.330702:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.330722:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=192s v=(0 0) 00010000:00010000:0.0:1789762788.330727:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762788.330735:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.330752:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762788.349468:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:0.0:1789762788.349477:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 73737 -> 75785 00010000:00010000:0.0:1789762788.349492:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.349527:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.349537:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.349547:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762788.349555:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.349569:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.349610:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef4a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.349623:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762788.349735:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+7:2345:x1876702140666752:12345-192.168.203.31@tcp:4:dd.500 Request processed in 19162us (204779us total) trans 4294967490 rc 0/0 00000100:00100000:0.0:1789762788.349748:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:0.0:1789762788.349756:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192803546796 time 192803679951 state 0x2 ref 0 00000001:00080000:0.0:1789762788.349798:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967490 is committed 00000100:00100000:3.0:1789762788.353005:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762788.353082:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140667392 00000100:00100000:2.0:1789762788.353092:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140667392 00000100:00100000:2.0:1789762788.353161:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 192803546796 time 192803679951 state 0x0 ref 1 00000100:00100000:2.0:1789762788.353174:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193003679951 time 192803679951 state 0x1 ref 1 00010000:00010000:1.0:1789762788.390995:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762788.519031:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149010560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762788.519152:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762788.519218:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149010560 00000100:00100000:3.0:1789762788.519230:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149010560 00000100:00100000:3.0:1789762788.519305:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789762788.519317:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149010560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762788.519343:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 332201984 pending 0 free 3817865216 avail 3810525184 00000100:00100000:3.0:1789762788.519401:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149010560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.519409:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789762788.519458:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149010560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762788.530589:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193003679951 time 193003744964 state 0x0 ref 1 00000100:00100000:2.0:1789762788.530615:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140667392:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762788.530669:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 38797312, mtime: 0x6aad9ce3, atime: 0x6aad9cdc, ctime: 0x6aad9ce3, blocks: 0x12809 00010000:00010000:2.0:1789762788.530679:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.530696:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=193s v=(0 0) 00010000:00010000:2.0:1789762788.530701:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762788.530706:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.530722:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762788.551468:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967491 is committed 00002000:00010000:3.0:1789762788.551489:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:3.0:1789762788.551514:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 75785 -> 77833 00010000:00010000:3.0:1789762788.551547:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.551560:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.551578:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.551604:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762788.551609:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.551619:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.551642:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.551669:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e49b606/0xd08452c77c56ef51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762788.551759:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140667392:12345-192.168.203.31@tcp:4:dd.500 Request processed in 21148us (198755us total) trans 4294967491 rc 0/0 00000100:00100000:3.0:1789762788.551773:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:3.0:1789762788.551801:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193003679951 time 193003744964 state 0x2 ref 0 00000100:00100000:3.0:1789762788.555370:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762788.555433:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140667520 00000100:00100000:0.0:1789762788.555444:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140667520 00000100:00100000:0.0:1789762788.555490:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193003679951 time 193003744964 state 0x0 ref 1 00000100:00100000:0.0:1789762788.555521:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193203744964 time 193003744964 state 0x1 ref 1 00000100:00100000:2.0:1789762788.730667:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193203744964 time 193203822866 state 0x0 ref 1 00000100:00100000:2.0:1789762788.730695:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140667520:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762788.730746:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 39845888, mtime: 0x6aad9ce3, atime: 0x6aad9cdc, ctime: 0x6aad9ce3, blocks: 0x13009 00010000:00010000:2.0:1789762788.730763:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ef58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.730777:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=193s v=(0 0) 00010000:00010000:2.0:1789762788.730780:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762788.730785:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ef58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.730796:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ef58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762788.741984:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967492 is committed 00002000:00010000:0.0:1789762788.742001:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:0.0:1789762788.742006:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762787 -> 1789762788 00002000:00010000:0.0:1789762788.742008:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762787 -> 1789762788 00002000:00010000:0.0:1789762788.742011:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 77833 -> 79881 00010000:00010000:0.0:1789762788.742022:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ef58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.742032:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ef58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.742047:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ef58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.742052:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762788.742055:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ef58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.742062:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ef58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.742080:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ef58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.742088:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56ef58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762788.742169:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140667520:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11483us (186797us total) trans 4294967492 rc 0/0 00000100:00100000:0.0:1789762788.742181:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:0.0:1789762788.742190:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193203744964 time 193203822866 state 0x2 ref 0 00000100:00100000:3.0:1789762788.744228:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762788.744265:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140667648 00000100:00100000:0.0:1789762788.744274:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140667648 00000100:00100000:0.0:1789762788.744311:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193203744964 time 193203822866 state 0x0 ref 1 00000100:00100000:0.0:1789762788.744320:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193403822866 time 193203822866 state 0x1 ref 1 00000100:00100000:0.0:1789762788.930750:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193403822866 time 193403898913 state 0x0 ref 1 00000100:00100000:0.0:1789762788.930781:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140667648:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762788.930881:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 40894464, mtime: 0x6aad9ce4, atime: 0x6aad9cdc, ctime: 0x6aad9ce4, blocks: 0x13809 00010000:00010000:0.0:1789762788.930892:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.930911:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=193s v=(0 0) 00010000:00010000:0.0:1789762788.930917:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762788.930924:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.930940:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762788.942699:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967493 is committed 00002000:00010000:0.0:1789762788.942726:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:0.0:1789762788.942731:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 79881 -> 81929 00010000:00010000:0.0:1789762788.942742:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.942752:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.942759:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.942773:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762788.942777:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.942783:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.942801:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.942810:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762788.942923:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140667648:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12151us (198690us total) trans 4294967493 rc 0/0 00000100:00100000:0.0:1789762788.942931:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:0.0:1789762788.942938:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193403822866 time 193403898913 state 0x2 ref 0 00000100:00100000:1.0:1789762788.945043:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762788.945092:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140667776 00000100:00100000:2.0:1789762788.945100:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140667776 00000100:00100000:2.0:1789762788.945134:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193403822866 time 193403898913 state 0x0 ref 1 00000100:00100000:2.0:1789762788.945143:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193603898913 time 193403898913 state 0x1 ref 1 00000100:00100000:0.0:1789762789.130878:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193603898913 time 193604035406 state 0x0 ref 1 00000100:00100000:0.0:1789762789.130926:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140667776:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:2.0:1789762789.130961:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789762789.130976:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 41943040, mtime: 0x6aad9ce4, atime: 0x6aad9cdc, ctime: 0x6aad9ce4, blocks: 0x14009 00010000:00010000:0.0:1789762789.130985:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.131015:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=193s v=(0 0) 00010000:00010000:0.0:1789762789.131018:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762789.131023:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.131033:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762789.142151:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967494 is committed 00002000:00010000:0.0:1789762789.142219:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:0.0:1789762789.142223:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 81929 -> 83977 00010000:00010000:0.0:1789762789.142234:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.142245:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.142251:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.142256:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762789.142260:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.142266:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.142292:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.142298:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762789.142362:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140667776:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11460us (197320us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1789762789.142371:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:0.0:1789762789.142378:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193603898913 time 193604035406 state 0x2 ref 0 00000100:00100000:3.0:1789762789.144622:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762789.144672:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140667904 00000100:00100000:2.0:1789762789.144683:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140667904 00000100:00100000:2.0:1789762789.144720:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193603898913 time 193604035406 state 0x0 ref 1 00000100:00100000:2.0:1789762789.144729:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193804035406 time 193604035406 state 0x1 ref 1 00000100:00100000:2.0:1789762789.330968:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193804035406 time 193804124826 state 0x0 ref 1 00000100:00100000:2.0:1789762789.330997:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140667904:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762789.331048:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 42991616, mtime: 0x6aad9ce4, atime: 0x6aad9cdc, ctime: 0x6aad9ce4, blocks: 0x14809 00010000:00010000:2.0:1789762789.331072:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ef6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762789.331090:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=193s v=(0 0) 00010000:00010000:2.0:1789762789.331095:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762789.331101:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ef6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762789.331114:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ef6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762789.342215:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967495 is committed 00002000:00010000:0.0:1789762789.342232:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:0.0:1789762789.342238:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 83977 -> 86027 00010000:00010000:0.0:1789762789.342250:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ef6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.342264:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ef6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.342274:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ef6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.342281:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762789.342285:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ef6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.342302:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ef6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.342318:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ef6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.342323:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008838c734/0xd08452c77c56ef6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762789.342387:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140667904:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11399us (197762us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1789762789.342397:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:0.0:1789762789.342405:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193804035406 time 193804124826 state 0x2 ref 0 00000100:00100000:1.0:1789762789.344385:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762789.344420:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140668032 00000100:00100000:0.0:1789762789.344428:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140668032 00000100:00100000:0.0:1789762789.344462:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 193804035406 time 193804124826 state 0x0 ref 1 00000100:00100000:0.0:1789762789.344471:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194004124826 time 193804124826 state 0x1 ref 1 00010000:00010000:1.0:1789762789.414972:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762789.531088:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194004124826 time 194004244165 state 0x0 ref 1 00000100:00100000:2.0:1789762789.531113:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140668032:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762789.531163:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 44040192, mtime: 0x6aad9ce4, atime: 0x6aad9cdc, ctime: 0x6aad9ce4, blocks: 0x1500b 00010000:00010000:2.0:1789762789.531171:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56ef74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762789.531184:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=194s v=(0 0) 00010000:00010000:2.0:1789762789.531187:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762789.531191:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56ef74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762789.531204:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56ef74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762789.541761:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967496 is committed 00002000:00010000:0.0:1789762789.541787:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:0.0:1789762789.541793:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 86027 -> 88075 00010000:00010000:0.0:1789762789.541805:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56ef74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.541819:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56ef74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.541856:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56ef74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.541866:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762789.541871:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56ef74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.541882:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56ef74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.541900:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56ef74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.541910:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc5264e5/0xd08452c77c56ef74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762789.541976:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140668032:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10871us (197589us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789762789.541987:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:0.0:1789762789.541995:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194004124826 time 194004244165 state 0x2 ref 0 00000100:00100000:3.0:1789762789.543963:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762789.544002:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140668160 00000100:00100000:0.0:1789762789.544011:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140668160 00000100:00100000:0.0:1789762789.544042:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194004124826 time 194004244165 state 0x0 ref 1 00000100:00100000:0.0:1789762789.544051:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194204244165 time 194004244165 state 0x1 ref 1 00000100:00100000:0.0:1789762789.731211:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194204244165 time 194204366501 state 0x0 ref 1 00000100:00100000:0.0:1789762789.731240:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140668160:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762789.731293:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 45088768, mtime: 0x6aad9ce4, atime: 0x6aad9cdc, ctime: 0x6aad9ce4, blocks: 0x1580b 00010000:00010000:0.0:1789762789.731300:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.731313:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=194s v=(0 0) 00010000:00010000:0.0:1789762789.731316:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762789.731320:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.731331:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762789.742424:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967497 is committed 00002000:00010000:0.0:1789762789.742444:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:0.0:1789762789.742451:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762788 -> 1789762789 00002000:00010000:0.0:1789762789.742454:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762788 -> 1789762789 00002000:00010000:0.0:1789762789.742457:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 88075 -> 90123 00010000:00010000:0.0:1789762789.742470:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.742485:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.742509:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.742525:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762789.742531:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.742542:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.742562:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.742571:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762789.742648:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140668160:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11418us (198682us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789762789.742657:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:0.0:1789762789.742664:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194204244165 time 194204366501 state 0x2 ref 0 00000100:00100000:1.0:1789762789.744859:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762789.744910:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140668288 00000100:00100000:2.0:1789762789.744927:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140668288 00000100:00100000:2.0:1789762789.744966:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194204244165 time 194204366501 state 0x0 ref 1 00000100:00100000:2.0:1789762789.744975:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194404366501 time 194204366501 state 0x1 ref 1 00000100:00100000:0.0:1789762789.931298:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194404366501 time 194404453850 state 0x0 ref 1 00000100:00100000:0.0:1789762789.931322:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140668288:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762789.931369:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 46137344, mtime: 0x6aad9ce5, atime: 0x6aad9cdc, ctime: 0x6aad9ce5, blocks: 0x1600b 00010000:00010000:0.0:1789762789.931376:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.931405:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=194s v=(0 0) 00010000:00010000:0.0:1789762789.931408:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762789.931413:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.931425:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762789.943119:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967498 is committed 00002000:00010000:0.0:1789762789.943201:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:0.0:1789762789.943206:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 90123 -> 92171 00010000:00010000:0.0:1789762789.943217:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.943228:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.943235:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.943240:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762789.943244:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.943250:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.943277:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef82 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762789.943283:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762789.943366:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140668288:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12049us (198505us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789762789.943375:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:0.0:1789762789.943381:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194404366501 time 194404453850 state 0x2 ref 0 00000100:00100000:1.0:1789762789.946420:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762789.946479:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140668416 00000100:00100000:2.0:1789762789.946500:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140668416 00000100:00100000:2.0:1789762789.946565:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194404366501 time 194404453850 state 0x0 ref 1 00000100:00100000:2.0:1789762789.946581:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194604453850 time 194404453850 state 0x1 ref 1 00000100:00100000:2.0:1789762790.131386:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194604453850 time 194604542276 state 0x0 ref 1 00000100:00100000:2.0:1789762790.131415:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140668416:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762790.131466:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 47185920, mtime: 0x6aad9ce5, atime: 0x6aad9cdc, ctime: 0x6aad9ce5, blocks: 0x1680b 00010000:00010000:2.0:1789762790.131474:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ef89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.131504:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=194s v=(0 0) 00010000:00010000:2.0:1789762790.131508:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762790.131513:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ef89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.131525:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ef89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762790.142394:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967499 is committed 00002000:00010000:0.0:1789762790.142458:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 47185920 -> 48234496 00002000:00010000:0.0:1789762790.142463:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 92171 -> 94219 00010000:00010000:0.0:1789762790.142473:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ef89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.142498:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ef89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.142506:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ef89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.142512:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762790.142516:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ef89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.142533:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ef89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.142548:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ef89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.142554:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56ef89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762790.142617:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140668416:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11213us (196201us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1789762790.142625:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:0.0:1789762790.142631:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194604453850 time 194604542276 state 0x2 ref 0 00000100:00100000:3.0:1789762790.144640:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762790.144687:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140668544 00000100:00100000:0.0:1789762790.144697:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140668544 00000100:00100000:0.0:1789762790.144739:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194604453850 time 194604542276 state 0x0 ref 1 00000100:00100000:0.0:1789762790.144752:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194804542276 time 194604542276 state 0x1 ref 1 00000100:00100000:2.0:1789762790.331500:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194804542276 time 194804639820 state 0x0 ref 1 00000100:00100000:2.0:1789762790.331541:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140668544:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762790.331592:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 48234496, mtime: 0x6aad9ce5, atime: 0x6aad9cdc, ctime: 0x6aad9ce5, blocks: 0x1700b 00010000:00010000:2.0:1789762790.331599:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56ef90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.331612:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=194s v=(0 0) 00010000:00010000:2.0:1789762790.331616:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762790.331620:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56ef90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.331632:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56ef90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762790.343563:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967500 is committed 00002000:00010000:0.0:1789762790.343587:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:0.0:1789762790.343592:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 94219 -> 96267 00010000:00010000:0.0:1789762790.343603:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56ef90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.343613:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56ef90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.343627:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56ef90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.343633:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762790.343636:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56ef90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.343643:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56ef90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.343657:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56ef90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.343662:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56ef90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762790.343727:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140668544:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12194us (199085us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789762790.343735:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:0.0:1789762790.343741:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194804542276 time 194804639820 state 0x2 ref 0 00000100:00100000:3.0:1789762790.345976:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762790.346009:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140668672 00000100:00100000:0.0:1789762790.346017:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140668672 00000100:00100000:0.0:1789762790.346050:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 194804542276 time 194804639820 state 0x0 ref 1 00000100:00100000:0.0:1789762790.346060:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195004639820 time 194804639820 state 0x1 ref 1 00010000:00010000:3.0:1789762790.438971:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762790.531567:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195004639820 time 195004722720 state 0x0 ref 1 00000100:00100000:0.0:1789762790.531597:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140668672:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762790.531649:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 49283072, mtime: 0x6aad9ce5, atime: 0x6aad9cdc, ctime: 0x6aad9ce5, blocks: 0x1780b 00010000:00010000:0.0:1789762790.531657:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.531670:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=195s v=(0 0) 00010000:00010000:0.0:1789762790.531673:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762790.531678:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.531690:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762790.542897:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 49283072 -> 50331648 00000001:00080000:3.0:1789762790.542897:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967501 is committed 00002000:00010000:0.0:1789762790.542903:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 96267 -> 98315 00010000:00010000:0.0:1789762790.542917:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.542930:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.542941:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.542963:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762790.542969:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.542980:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.542999:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.543008:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762790.543075:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140668672:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11490us (197098us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1789762790.543085:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:0.0:1789762790.543091:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195004639820 time 195004722720 state 0x2 ref 0 00000100:00100000:3.0:1789762790.545167:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762790.545222:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140668800 00000100:00100000:2.0:1789762790.545231:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140668800 00000100:00100000:2.0:1789762790.545272:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195004639820 time 195004722720 state 0x0 ref 1 00000100:00100000:2.0:1789762790.545284:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195204722720 time 195004722720 state 0x1 ref 1 00000100:00100000:0.0:1789762790.731660:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195204722720 time 195204816176 state 0x0 ref 1 00000100:00100000:0.0:1789762790.731689:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140668800:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762790.731740:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 50331648, mtime: 0x6aad9ce5, atime: 0x6aad9cdc, ctime: 0x6aad9ce5, blocks: 0x1800b 00010000:00010000:0.0:1789762790.731747:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.731794:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=195s v=(0 0) 00010000:00010000:0.0:1789762790.731800:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762790.731807:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.731819:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762790.743396:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967502 is committed 00002000:00010000:0.0:1789762790.743460:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:0.0:1789762790.743465:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762789 -> 1789762790 00002000:00010000:0.0:1789762790.743467:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762789 -> 1789762790 00002000:00010000:0.0:1789762790.743468:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 98315 -> 100363 00010000:00010000:0.0:1789762790.743490:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.743502:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.743509:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.743517:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762790.743522:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.743531:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.743561:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.743569:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56ef9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762790.743638:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140668800:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11960us (198470us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789762790.743648:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:0.0:1789762790.743655:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195204722720 time 195204816176 state 0x2 ref 0 00000100:00100000:3.0:1789762790.745857:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762790.745907:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140668928 00000100:00100000:2.0:1789762790.745915:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140668928 00000100:00100000:2.0:1789762790.745950:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195204722720 time 195204816176 state 0x0 ref 1 00000100:00100000:2.0:1789762790.745960:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195404816176 time 195204816176 state 0x1 ref 1 00000100:00100000:2.0:1789762790.931722:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195404816176 time 195404878185 state 0x0 ref 1 00000100:00100000:2.0:1789762790.931768:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140668928:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762790.931827:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 51380224, mtime: 0x6aad9ce6, atime: 0x6aad9cdc, ctime: 0x6aad9ce6, blocks: 0x1880b 00010000:00010000:2.0:1789762790.931852:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56efa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.931866:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=195s v=(0 0) 00010000:00010000:2.0:1789762790.931870:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762790.931875:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56efa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.931886:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56efa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762790.943341:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967503 is committed 00002000:00010000:0.0:1789762790.943365:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:0.0:1789762790.943371:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 100363 -> 102411 00010000:00010000:0.0:1789762790.943382:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56efa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.943394:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56efa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.943400:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56efa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.943406:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762790.943412:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56efa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.943436:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56efa5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.943457:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56efa5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.943463:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56efa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762790.943551:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140668928:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11792us (197713us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1789762790.943560:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:0.0:1789762790.943567:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195404816176 time 195404878185 state 0x2 ref 0 00000100:00100000:1.0:1789762790.945806:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762790.945861:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140669056 00000100:00100000:0.0:1789762790.945868:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140669056 00000100:00100000:0.0:1789762790.945903:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195404816176 time 195404878185 state 0x0 ref 1 00000100:00100000:0.0:1789762790.945912:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195604878185 time 195404878185 state 0x1 ref 1 00000100:00100000:2.0:1789762791.131819:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195604878185 time 195604973320 state 0x0 ref 1 00000100:00100000:2.0:1789762791.131888:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140669056:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:0.0:1789762791.131921:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789762791.131948:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 52428800, mtime: 0x6aad9ce6, atime: 0x6aad9cdc, ctime: 0x6aad9ce6, blocks: 0x1900b 00010000:00010000:2.0:1789762791.131958:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56efac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762791.131976:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=195s v=(0 0) 00010000:00010000:2.0:1789762791.131980:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762791.131987:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56efac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762791.132024:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56efac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762791.145076:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967504 is committed 00002000:00010000:3.0:1789762791.145086:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:3.0:1789762791.145091:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 102411 -> 104459 00010000:00010000:3.0:1789762791.145105:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56efac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762791.145116:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56efac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762791.145124:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56efac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762791.145129:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762791.145133:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56efac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762791.145141:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56efac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762791.145156:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56efac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762791.145171:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002809c665/0xd08452c77c56efac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762791.145249:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140669056:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13390us (199443us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789762791.145258:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:3.0:1789762791.145265:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195604878185 time 195604973320 state 0x2 ref 0 00000100:00100000:1.0:1789762791.147552:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762791.147596:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140669184 00000100:00100000:2.0:1789762791.147604:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140669184 00000100:00100000:2.0:1789762791.147643:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195604878185 time 195604973320 state 0x0 ref 1 00000100:00100000:2.0:1789762791.147653:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195804973320 time 195604973320 state 0x1 ref 1 00000100:00100000:0.0:1789762791.331920:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195804973320 time 195805073903 state 0x0 ref 1 00000100:00100000:0.0:1789762791.331952:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140669184:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762791.332013:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 53477376, mtime: 0x6aad9ce6, atime: 0x6aad9cdc, ctime: 0x6aad9ce6, blocks: 0x1980b 00010000:00010000:0.0:1789762791.332024:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.332052:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=195s v=(0 0) 00010000:00010000:0.0:1789762791.332057:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762791.332064:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.332080:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762791.343519:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967505 is committed 00002000:00010000:0.0:1789762791.343542:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:0.0:1789762791.343547:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 104459 -> 106507 00010000:00010000:0.0:1789762791.343558:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.343567:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.343575:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.343581:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762791.343584:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.343593:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.343627:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efb3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.343637:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762791.343704:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140669184:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11764us (196154us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789762791.343713:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:0.0:1789762791.343719:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195804973320 time 195805073903 state 0x2 ref 0 00000100:00100000:3.0:1789762791.345757:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762791.345804:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140669312 00000100:00100000:2.0:1789762791.345812:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140669312 00000100:00100000:2.0:1789762791.345860:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 195804973320 time 195805073903 state 0x0 ref 1 00000100:00100000:2.0:1789762791.345869:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196005073903 time 195805073903 state 0x1 ref 1 00010000:00010000:1.0:1789762791.462935:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762791.532025:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196005073903 time 196005178460 state 0x0 ref 1 00000100:00100000:2.0:1789762791.532071:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140669312:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762791.532138:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 54525952, mtime: 0x6aad9ce6, atime: 0x6aad9cdc, ctime: 0x6aad9ce6, blocks: 0x1a00b 00010000:00010000:2.0:1789762791.532148:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762791.532165:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=196s v=(0 0) 00010000:00010000:2.0:1789762791.532170:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762791.532177:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762791.532213:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762791.545020:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967506 is committed 00002000:00010000:0.0:1789762791.545080:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:0.0:1789762791.545088:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 106507 -> 108555 00010000:00010000:0.0:1789762791.545105:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.545123:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.545135:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.545143:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762791.545150:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.545180:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.545208:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.545218:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762791.545345:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140669312:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13294us (199582us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789762791.545359:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:0.0:1789762791.545370:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196005073903 time 196005178460 state 0x2 ref 0 00000100:00100000:3.0:1789762791.547655:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762791.547715:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140669440 00000100:00100000:1.0:1789762791.547726:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140669440 00000100:00100000:1.0:1789762791.547772:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196005073903 time 196005178460 state 0x0 ref 1 00000100:00100000:1.0:1789762791.547784:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196205178460 time 196005178460 state 0x1 ref 1 00000100:00100000:2.0:1789762791.732152:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196205178460 time 196205307018 state 0x0 ref 1 00000100:00100000:2.0:1789762791.732179:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140669440:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762791.732231:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 55574528, mtime: 0x6aad9ce6, atime: 0x6aad9cdc, ctime: 0x6aad9ce6, blocks: 0x1a80b 00010000:00010000:2.0:1789762791.732238:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762791.732252:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=196s v=(0 0) 00010000:00010000:2.0:1789762791.732256:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762791.732260:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762791.732270:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762791.745547:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967507 is committed 00002000:00010000:0.0:1789762791.745647:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:0.0:1789762791.745652:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762790 -> 1789762791 00002000:00010000:0.0:1789762791.745654:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762790 -> 1789762791 00002000:00010000:0.0:1789762791.745656:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 108555 -> 110603 00010000:00010000:0.0:1789762791.745671:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.745683:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.745691:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.745705:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762791.745710:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.745717:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.745737:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efc1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.745742:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa0b5795/0xd08452c77c56efc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762791.745865:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140669440:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13660us (198175us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789762791.745876:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:0.0:1789762791.745885:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196205178460 time 196205307018 state 0x2 ref 0 00000100:00100000:1.0:1789762791.748577:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762791.748635:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140669568 00000100:00100000:3.0:1789762791.748646:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140669568 00000100:00100000:3.0:1789762791.748695:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196205178460 time 196205307018 state 0x0 ref 1 00000100:00100000:3.0:1789762791.748706:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196405307018 time 196205307018 state 0x1 ref 1 00000100:00100000:1.0:1789762791.932249:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196405307018 time 196405404985 state 0x0 ref 1 00000100:00100000:1.0:1789762791.932278:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140669568:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762791.932334:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 56623104, mtime: 0x6aad9ce7, atime: 0x6aad9cdc, ctime: 0x6aad9ce7, blocks: 0x1b00b 00010000:00010000:1.0:1789762791.932342:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56efc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762791.932355:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=196s v=(0 0) 00010000:00010000:1.0:1789762791.932358:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762791.932363:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56efc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762791.932374:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56efc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762791.945929:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 56623104 -> 57671680 00000001:00080000:2.0:1789762791.945936:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967508 is committed 00002000:00010000:1.0:1789762791.945947:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 110603 -> 112651 00010000:00010000:1.0:1789762791.945964:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56efc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762791.945975:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56efc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762791.945982:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56efc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762791.945987:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762791.945991:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56efc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762791.945998:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56efc8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762791.946018:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56efc8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762791.946025:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c56efc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762791.946131:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140669568:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13862us (197556us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789762791.946143:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:1.0:1789762791.946152:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196405307018 time 196405404985 state 0x2 ref 0 00000100:00100000:3.0:1789762791.948985:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762791.949042:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140669696 00000100:00100000:0.0:1789762791.949055:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140669696 00000100:00100000:0.0:1789762791.949114:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196405307018 time 196405404985 state 0x0 ref 1 00000100:00100000:0.0:1789762791.949129:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196605404985 time 196405404985 state 0x1 ref 1 00000100:00100000:3.0:1789762792.132413:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196605404985 time 196605568130 state 0x0 ref 1 00000100:00100000:3.0:1789762792.132444:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140669696:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762792.132512:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 57671680, mtime: 0x6aad9ce7, atime: 0x6aad9cdc, ctime: 0x6aad9ce7, blocks: 0x1b80b 00010000:00010000:3.0:1789762792.132520:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56efcf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762792.132533:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=196s v=(0 0) 00010000:00010000:3.0:1789762792.132537:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762792.132554:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56efcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762792.132566:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56efcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762792.145871:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967509 is committed 00002000:00010000:2.0:1789762792.145897:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:2.0:1789762792.145903:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 112651 -> 114699 00010000:00010000:2.0:1789762792.145914:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56efcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.145936:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56efcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.145943:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56efcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.145948:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762792.145951:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56efcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.145958:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56efcf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.145974:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56efcf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.145978:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56efcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762792.146052:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140669696:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13620us (197067us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789762792.146061:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:2.0:1789762792.146068:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196605404985 time 196605568130 state 0x2 ref 0 00000100:00100000:1.0:1789762792.148615:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762792.148669:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140669824 00000100:00100000:0.0:1789762792.148683:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140669824 00000100:00100000:0.0:1789762792.148736:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196605404985 time 196605568130 state 0x0 ref 1 00000100:00100000:0.0:1789762792.148756:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196805568130 time 196605568130 state 0x1 ref 1 00000100:00100000:0.0:1789762792.332537:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196805568130 time 196805688301 state 0x0 ref 1 00000100:00100000:0.0:1789762792.332578:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140669824:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762792.332651:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 58720256, mtime: 0x6aad9ce7, atime: 0x6aad9cdc, ctime: 0x6aad9ce7, blocks: 0x1c00b 00010000:00010000:0.0:1789762792.332665:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762792.332689:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=196s v=(0 0) 00010000:00010000:0.0:1789762792.332693:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762792.332699:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762792.332712:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762792.346104:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967510 is committed 00002000:00010000:2.0:1789762792.346129:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:2.0:1789762792.346143:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 114699 -> 116747 00010000:00010000:2.0:1789762792.346155:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.346165:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.346172:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.346177:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762792.346181:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.346189:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.346211:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efd6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.346221:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56efd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762792.346306:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140669824:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13747us (197689us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1789762792.346316:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:2.0:1789762792.346324:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196805568130 time 196805688301 state 0x2 ref 0 00000100:00100000:1.0:1789762792.348605:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762792.348644:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140669952 00000100:00100000:2.0:1789762792.348653:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140669952 00000100:00100000:2.0:1789762792.348688:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 196805568130 time 196805688301 state 0x0 ref 1 00000100:00100000:2.0:1789762792.348697:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197005688301 time 196805688301 state 0x1 ref 1 00010000:00010000:1.0:1789762792.487003:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762792.532656:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197005688301 time 197005808438 state 0x0 ref 1 00000100:00100000:0.0:1789762792.532703:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140669952:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762792.532773:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 59768832, mtime: 0x6aad9ce7, atime: 0x6aad9cdc, ctime: 0x6aad9ce7, blocks: 0x1c80b 00010000:00010000:0.0:1789762792.532782:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56efdd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762792.532799:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=197s v=(0 0) 00010000:00010000:0.0:1789762792.532803:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762792.532826:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56efdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762792.532888:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56efdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762792.546180:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967511 is committed 00002000:00010000:2.0:1789762792.546183:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:2.0:1789762792.546189:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 116747 -> 118795 00010000:00010000:2.0:1789762792.546202:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56efdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.546213:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56efdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.546220:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56efdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.546225:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762792.546229:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56efdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.546235:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56efdd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.546251:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56efdd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.546256:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56efdd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762792.546341:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140669952:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13657us (197735us total) trans 4294967511 rc 0/0 00000100:00100000:2.0:1789762792.546350:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:2.0:1789762792.546357:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197005688301 time 197005808438 state 0x2 ref 0 00000100:00100000:1.0:1789762792.548720:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762792.548775:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140670080 00000100:00100000:0.0:1789762792.548786:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140670080 00000100:00100000:0.0:1789762792.548854:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197005688301 time 197005808438 state 0x0 ref 1 00000100:00100000:0.0:1789762792.548866:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197205808438 time 197005808438 state 0x1 ref 1 00000100:00100000:2.0:1789762792.732767:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197205808438 time 197205922713 state 0x0 ref 1 00000100:00100000:2.0:1789762792.732795:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140670080:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762792.732874:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 60817408, mtime: 0x6aad9ce7, atime: 0x6aad9cdc, ctime: 0x6aad9ce7, blocks: 0x1d00b 00010000:00010000:2.0:1789762792.732883:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56efe4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.732897:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=197s v=(0 0) 00010000:00010000:2.0:1789762792.732900:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762792.732904:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56efe4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.732915:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56efe4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762792.747030:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:2.0:1789762792.747036:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762791 -> 1789762792 00000001:00080000:1.0:1789762792.747040:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967512 is committed 00002000:00010000:2.0:1789762792.747041:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762791 -> 1789762792 00002000:00010000:2.0:1789762792.747052:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 118795 -> 120843 00010000:00010000:2.0:1789762792.747068:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56efe4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.747086:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56efe4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.747093:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56efe4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.747098:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762792.747102:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56efe4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.747108:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56efe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.747123:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56efe4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.747128:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56efe4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762792.747203:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140670080:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14419us (198480us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1789762792.747211:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:2.0:1789762792.747218:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197205808438 time 197205922713 state 0x2 ref 0 00000100:00100000:3.0:1789762792.749666:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762792.749710:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140670208 00000100:00100000:2.0:1789762792.749725:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140670208 00000100:00100000:2.0:1789762792.749759:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197205808438 time 197205922713 state 0x0 ref 1 00000100:00100000:2.0:1789762792.749768:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197405922713 time 197205922713 state 0x1 ref 1 00000100:00100000:0.0:1789762792.932922:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197405922713 time 197406069648 state 0x0 ref 1 00000100:00100000:0.0:1789762792.932969:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140670208:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762792.933057:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 61865984, mtime: 0x6aad9ce8, atime: 0x6aad9cdc, ctime: 0x6aad9ce8, blocks: 0x1d80b 00010000:00010000:0.0:1789762792.933068:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56efeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762792.933091:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=197s v=(0 0) 00010000:00010000:0.0:1789762792.933097:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762792.933105:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56efeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762792.933133:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56efeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762792.946684:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967513 is committed 00002000:00010000:2.0:1789762792.946705:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:2.0:1789762792.946711:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 120843 -> 122891 00010000:00010000:2.0:1789762792.946723:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56efeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.946733:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56efeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.946740:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56efeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.946744:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762792.946748:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56efeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.946755:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56efeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.946769:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56efeb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762792.946774:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56efeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762792.946890:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140670208:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13941us (197220us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1789762792.946900:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:2.0:1789762792.946907:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197405922713 time 197406069648 state 0x2 ref 0 00000100:00100000:3.0:1789762792.949239:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762792.949304:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140670336 00000100:00100000:2.0:1789762792.949313:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140670336 00000100:00100000:2.0:1789762792.949349:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197405922713 time 197406069648 state 0x0 ref 1 00000100:00100000:2.0:1789762792.949358:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197606069648 time 197406069648 state 0x1 ref 1 00000100:00100000:3.0:1789762793.126999:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149010688:0@lo:400:kworker.0 00000100:00100000:1.0:1789762793.127009:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149010816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762793.127041:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149011072:0@lo:400:kworker.0 00000100:00100000:1.0:1789762793.127081:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762793.127088:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762793.127094:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762793.127159:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149011328:0@lo:400:kworker.0 00000100:00100000:3.0:1789762793.127166:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149011200:0@lo:400:kworker.0 00000100:00100000:2.0:1789762793.127174:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149010688 00000100:00100000:2.0:1789762793.127180:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149010688 00000100:00100000:1.0:1789762793.127190:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762793.127217:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762793.127218:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789762793.127228:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149010944:0@lo:400:kworker.0 00000100:00100000:2.0:1789762793.127230:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789762793.127244:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149010688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762793.127259:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762793.127272:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149010816 00000100:00100000:3.0:1789762793.127277:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149010816 00000100:00100000:0.0:1789762793.127280:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149011072 00000100:00100000:1.0:1789762793.127285:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149011456:0@lo:400:kworker.0 00000100:00100000:2.0:1789762793.127304:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149010688:12345-0@lo:400:kworker.0 Request processed in 63us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762793.127311:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789762793.127316:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762793.127327:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789762793.127338:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149010816:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762793.127343:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149011072 00000100:00100000:1.0:1789762793.127360:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149011328 00000100:00100000:1.0:1789762793.127364:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149011328 00002000:00000024:3.0:1789762793.127366:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762793.127389:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149010944 00000100:00100000:0.0:1789762793.127395:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149010944 00000100:00100000:1.0:1789762793.127403:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789762793.127406:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149010688:0@lo:400:kworker.0 00000100:00100000:1.0:1789762793.127415:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149011072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762793.127418:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149010816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762793.127427:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789762793.127433:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789762793.127445:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149011328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762793.127478:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149011072:12345-0@lo:400:kworker.0 Request processed in 52us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762793.127479:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149011200 00000100:00100000:3.0:1789762793.127484:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149011200 00000100:00100000:1.0:1789762793.127501:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789762793.127517:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149011456 00000100:00100000:3.0:1789762793.127521:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149011456 00000100:00100000:1.0:1789762793.127526:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789762793.127535:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149011328:12345-0@lo:400:kworker.0 Request processed in 91us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762793.127549:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789762793.127549:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149010944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762793.127550:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789762793.127568:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149011200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762793.127603:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149010944:12345-0@lo:400:kworker.0 Request processed in 60us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762793.127622:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789762793.127627:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789762793.127632:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149011200:12345-0@lo:400:kworker.0 Request processed in 69us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762793.127635:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149011456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762793.127635:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149011072:0@lo:400:kworker.0 00000100:00100000:3.0:1789762793.127654:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789762793.127684:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149011456:12345-0@lo:400:kworker.0 Request processed in 51us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762793.127690:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789762793.127698:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149010944:0@lo:400:kworker.0 00000100:00100000:3.0:1789762793.127706:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149011200:0@lo:400:kworker.0 00000100:00100000:1.0:1789762793.127717:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967344 gen 2 00000004:00080000:1.0:1789762793.127724:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d151b31880, transno 4294967344 00000100:00100000:1.0:1789762793.127740:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149011456:0@lo:400:kworker.0 00000100:00100000:1.0:1789762793.127758:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149011328:0@lo:400:kworker.0 00000100:00080000:0.0:1789762793.127761:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762793.127768:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762793.127773:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762793.127779:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149010816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762793.132963:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197606069648 time 197606123178 state 0x0 ref 1 00000100:00100000:2.0:1789762793.132989:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140670336:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:0.0:1789762793.133014:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789762793.133034:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 62914560, mtime: 0x6aad9ce8, atime: 0x6aad9cdc, ctime: 0x6aad9ce8, blocks: 0x1e00b 00010000:00010000:2.0:1789762793.133042:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.133055:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=197s v=(0 0) 00010000:00010000:2.0:1789762793.133059:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762793.133063:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.133074:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762793.145028:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967514 is committed 00002000:00010000:2.0:1789762793.145105:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:2.0:1789762793.145111:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 122891 -> 124939 00010000:00010000:2.0:1789762793.145125:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.145140:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.145151:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.145159:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762793.145164:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.145189:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.145210:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.145219:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762793.145301:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140670336:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12320us (196057us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789762793.145313:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:2.0:1789762793.145322:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197606069648 time 197606123178 state 0x2 ref 0 00000100:00100000:1.0:1789762793.147562:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762793.147605:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140670464 00000100:00100000:0.0:1789762793.147614:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140670464 00000100:00100000:0.0:1789762793.147649:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197606069648 time 197606123178 state 0x0 ref 1 00000100:00100000:0.0:1789762793.147659:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197806123178 time 197606123178 state 0x1 ref 1 00000100:00100000:3.0:1789762793.332480:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762793.332514:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762793.332536:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140670592 00000100:00100000:3.0:1789762793.332536:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762793.332549:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140670592 00000100:00100000:3.0:1789762793.332565:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762793.332570:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140670720 00000100:00100000:0.0:1789762793.332577:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140670720 00000100:00100000:1.0:1789762793.332600:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140670848 00000100:00100000:3.0:1789762793.332602:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762793.332607:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140670848 00000100:00100000:2.0:1789762793.332611:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 249 00000100:00100000:2.0:1789762793.332623:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140670592:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762793.332631:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140671104 00000100:00100000:0.0:1789762793.332636:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140671104 00000100:00100000:1.0:1789762793.332653:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140670976 00000100:00100000:1.0:1789762793.332659:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140670976 00000100:00100000:3.0:1789762793.332661:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:0.0:1789762793.332676:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:3.0:1789762793.332677:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2343:x1876702140670720:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762793.332689:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140670592:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 68us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762793.332698:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140671104:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762793.332701:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 249 00000100:00100000:1.0:1789762793.332702:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:1.0:1789762793.332718:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140670848:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762793.332724:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2343:x1876702140670720:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 54us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762793.332733:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00080000:2.0:1789762793.332739:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789762793.332744:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762793.332772:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140671104:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 83us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762793.332782:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140670848:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 67us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762793.332784:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:2.0:1789762793.332787:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:2.0:1789762793.332800:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140670976:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762793.332803:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1789762793.332870:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140670976:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 72us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762793.332876:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:2.0:1789762793.333006:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197806123178 time 197806166758 state 0x0 ref 1 00000100:00100000:2.0:1789762793.333017:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140670464:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762793.333053:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 63963136, mtime: 0x6aad9ce8, atime: 0x6aad9cdc, ctime: 0x6aad9ce8, blocks: 0x1e80b 00010000:00010000:2.0:1789762793.333062:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.333079:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=197s v=(0 0) 00010000:00010000:2.0:1789762793.333084:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762793.333091:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.333106:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762793.345748:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967515 is committed 00002000:00010000:2.0:1789762793.345767:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:2.0:1789762793.345773:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 124939 -> 126987 00010000:00010000:2.0:1789762793.345787:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.345801:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.345826:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.345848:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762793.345852:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.345860:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.345876:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.345882:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56eff9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762793.345966:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140670464:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12945us (198402us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789762793.345975:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:2.0:1789762793.345982:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197806123178 time 197806166758 state 0x2 ref 0 00000100:00100000:1.0:1789762793.348674:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762793.348722:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140671232 00000100:00100000:0.0:1789762793.348731:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140671232 00000100:00100000:0.0:1789762793.348768:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 197806123178 time 197806166758 state 0x0 ref 1 00000100:00100000:0.0:1789762793.348778:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198006166758 time 197806166758 state 0x1 ref 1 00010000:00010000:1.0:1789762793.511026:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762793.533056:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198006166758 time 198006213288 state 0x0 ref 1 00000100:00100000:0.0:1789762793.533081:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140671232:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762793.533132:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 65011712, mtime: 0x6aad9ce8, atime: 0x6aad9cdc, ctime: 0x6aad9ce8, blocks: 0x1f00b 00010000:00010000:0.0:1789762793.533140:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f000 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762793.533155:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=198s v=(0 0) 00010000:00010000:0.0:1789762793.533159:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762793.533164:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f000 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762793.533194:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f000 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762793.545794:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967516 is committed 00002000:00010000:2.0:1789762793.545815:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:2.0:1789762793.545820:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 126987 -> 129035 00010000:00010000:2.0:1789762793.545849:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f000 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.545879:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f000 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.545886:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f000 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.545892:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002bc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762793.545895:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f000 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.545902:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f000 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.545917:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f000 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.545922:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f000 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762793.545993:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140671232:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12920us (197318us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789762793.546002:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:2.0:1789762793.546009:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198006166758 time 198006213288 state 0x2 ref 0 00000100:00100000:1.0:1789762793.548527:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762793.548578:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140671360 00000100:00100000:2.0:1789762793.548596:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140671360 00000100:00100000:2.0:1789762793.548639:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198006166758 time 198006213288 state 0x0 ref 1 00000100:00100000:2.0:1789762793.548652:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198206213288 time 198006213288 state 0x1 ref 1 00000100:00100000:1.0:1789762793.639108:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149011584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762793.639195:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762793.639267:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149011584 00000100:00100000:3.0:1789762793.639279:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149011584 00000100:00100000:3.0:1789762793.639342:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789762793.639353:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149011584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762793.639377:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 376504320 pending 0 free 3794796544 avail 3791650816 00000100:00100000:3.0:1789762793.639437:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149011584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762793.639449:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789762793.639496:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149011584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762793.733156:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198206213288 time 198206310725 state 0x0 ref 1 00000100:00100000:0.0:1789762793.733198:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140671360:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762793.733268:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 66060288, mtime: 0x6aad9ce8, atime: 0x6aad9cdc, ctime: 0x6aad9ce8, blocks: 0x1f80b 00010000:00010000:0.0:1789762793.733278:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f007 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762793.733292:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=198s v=(0 0) 00010000:00010000:0.0:1789762793.733296:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762793.733302:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f007 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762793.733317:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f007 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762793.745506:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967517 is committed 00002000:00010000:2.0:1789762793.745516:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:2.0:1789762793.745522:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762792 -> 1789762793 00002000:00010000:2.0:1789762793.745526:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762792 -> 1789762793 00002000:00010000:2.0:1789762793.745529:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 129035 -> 131083 00010000:00010000:2.0:1789762793.745544:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f007 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.745559:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f007 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.745568:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f007 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.745576:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762793.745580:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f007 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.745589:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f007 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.745608:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f007 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.745629:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f007 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762793.745715:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140671360:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12536us (197184us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789762793.745727:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:2.0:1789762793.745736:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198206213288 time 198206310725 state 0x2 ref 0 00000100:00100000:2.0:1789762793.748023:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762793.748067:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140671488 00000100:00100000:3.0:1789762793.748077:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140671488 00000100:00100000:3.0:1789762793.748117:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198206213288 time 198206310725 state 0x0 ref 1 00000100:00100000:3.0:1789762793.748127:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198406310725 time 198206310725 state 0x1 ref 1 00000100:00100000:2.0:1789762793.933262:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198406310725 time 198406416033 state 0x0 ref 1 00000100:00100000:2.0:1789762793.933297:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140671488:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762793.933355:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 67108864, mtime: 0x6aad9ce9, atime: 0x6aad9cdc, ctime: 0x6aad9ce9, blocks: 0x2000b 00010000:00010000:2.0:1789762793.933365:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f00e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.933382:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=198s v=(0 0) 00010000:00010000:2.0:1789762793.933395:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762793.933402:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f00e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.933417:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f00e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762793.944800:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967518 is committed 00002000:00010000:2.0:1789762793.944804:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:2.0:1789762793.944818:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 131083 -> 133131 00010000:00010000:2.0:1789762793.944855:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f00e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.944868:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f00e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.944875:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f00e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.944880:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762793.944883:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f00e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.944889:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f00e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.944905:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f00e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762793.944910:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f00e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762793.944991:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140671488:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11705us (196963us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789762793.945000:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:2.0:1789762793.945007:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198406310725 time 198406416033 state 0x2 ref 0 00000100:00100000:1.0:1789762793.947519:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762793.947568:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140671616 00000100:00100000:0.0:1789762793.947577:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140671616 00000100:00100000:0.0:1789762793.947613:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198406310725 time 198406416033 state 0x0 ref 1 00000100:00100000:0.0:1789762793.947623:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198606416033 time 198406416033 state 0x1 ref 1 00000100:00100000:3.0:1789762794.133352:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198606416033 time 198606508366 state 0x0 ref 1 00000100:00100000:3.0:1789762794.133385:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140671616:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762794.133441:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 68157440, mtime: 0x6aad9ce9, atime: 0x6aad9cdc, ctime: 0x6aad9ce9, blocks: 0x2080b 00010000:00010000:3.0:1789762794.133448:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f015 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762794.133473:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=198s v=(0 0) 00010000:00010000:3.0:1789762794.133477:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762794.133482:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762794.133493:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762794.146138:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967519 is committed 00002000:00010000:3.0:1789762794.146141:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:3.0:1789762794.146146:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 133131 -> 135179 00010000:00010000:3.0:1789762794.146159:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762794.146170:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762794.146178:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762794.146194:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762794.146198:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762794.146204:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762794.146221:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f015 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762794.146226:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f015 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762794.146310:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140671616:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12940us (198789us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789762794.146318:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:3.0:1789762794.146325:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198606416033 time 198606508366 state 0x2 ref 0 00000100:00100000:2.0:1789762794.149286:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762794.149342:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140671744 00000100:00100000:0.0:1789762794.149352:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140671744 00000100:00100000:0.0:1789762794.149398:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198606416033 time 198606508366 state 0x0 ref 1 00000100:00100000:0.0:1789762794.149411:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198806508366 time 198606508366 state 0x1 ref 1 00000100:00100000:0.0:1789762794.333431:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198806508366 time 198806585610 state 0x0 ref 1 00000100:00100000:0.0:1789762794.333477:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140671744:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762794.333533:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 69206016, mtime: 0x6aad9ce9, atime: 0x6aad9cdc, ctime: 0x6aad9ce9, blocks: 0x2100b 00010000:00010000:0.0:1789762794.333554:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f01c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762794.333569:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=198s v=(0 0) 00010000:00010000:0.0:1789762794.333574:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762794.333579:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f01c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762794.333593:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f01c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762794.345294:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 69206016 -> 70254592 00000001:00080000:1.0:1789762794.345297:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967520 is committed 00002000:00010000:2.0:1789762794.345300:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 135179 -> 137227 00010000:00010000:2.0:1789762794.345315:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f01c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.345326:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f01c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.345333:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f01c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.345338:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002aa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762794.345342:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f01c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.345348:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f01c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.345363:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f01c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.345370:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f01c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762794.345468:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140671744:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12003us (196170us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789762794.345487:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:2.0:1789762794.345494:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198806508366 time 198806585610 state 0x2 ref 0 00000100:00100000:3.0:1789762794.347882:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762794.347913:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140671872 00000100:00100000:2.0:1789762794.347921:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140671872 00000100:00100000:2.0:1789762794.347957:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 198806508366 time 198806585610 state 0x0 ref 1 00000100:00100000:2.0:1789762794.347969:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199006585610 time 198806585610 state 0x1 ref 1 00000100:00100000:0.0:1789762794.533576:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199006585610 time 199006707345 state 0x0 ref 1 00000100:00100000:0.0:1789762794.533631:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140671872:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762794.533714:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 70254592, mtime: 0x6aad9ce9, atime: 0x6aad9cdc, ctime: 0x6aad9ce9, blocks: 0x2180b 00010000:00010000:0.0:1789762794.533727:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f023 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762794.533765:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=199s v=(0 0) 00010000:00010000:0.0:1789762794.533772:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762794.533801:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762794.533814:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762794.535068:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789762794.549662:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967521 is committed 00002000:00010000:2.0:1789762794.549683:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:2.0:1789762794.549690:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 137227 -> 139277 00010000:00010000:2.0:1789762794.549709:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.549729:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.549742:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f023 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.549753:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762794.549758:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f023 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.549767:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f023 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.549802:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f023 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.549815:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f023 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762794.549943:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140671872:12345-192.168.203.31@tcp:4:dd.500 Request processed in 16334us (202055us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789762794.549973:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:2.0:1789762794.549983:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199006585610 time 199006707345 state 0x2 ref 0 00000100:00100000:1.0:1789762794.552646:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762794.552682:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140672000 00000100:00100000:2.0:1789762794.552691:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140672000 00000100:00100000:2.0:1789762794.552727:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199006585610 time 199006707345 state 0x0 ref 1 00000100:00100000:2.0:1789762794.552736:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199206707345 time 199006707345 state 0x1 ref 1 00000100:00100000:2.0:1789762794.733640:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199206707345 time 199206795077 state 0x0 ref 1 00000100:00100000:2.0:1789762794.733683:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140672000:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762794.733740:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 71303168, mtime: 0x6aad9ce9, atime: 0x6aad9cdc, ctime: 0x6aad9ce9, blocks: 0x2200d 00010000:00010000:2.0:1789762794.733748:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f02a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.733764:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=199s v=(0 0) 00010000:00010000:2.0:1789762794.733768:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762794.733774:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f02a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.733807:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f02a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762794.747126:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967522 is committed 00002000:00010000:2.0:1789762794.747135:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:2.0:1789762794.747140:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762793 -> 1789762794 00002000:00010000:2.0:1789762794.747143:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762793 -> 1789762794 00002000:00010000:2.0:1789762794.747145:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 139277 -> 141325 00010000:00010000:2.0:1789762794.747157:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f02a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.747168:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f02a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.747175:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f02a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.747180:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762794.747183:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f02a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.747189:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f02a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.747204:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f02a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.747227:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f02a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762794.747312:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140672000:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13641us (194664us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789762794.747320:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:2.0:1789762794.747327:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199206707345 time 199206795077 state 0x2 ref 0 00000100:00100000:3.0:1789762794.749865:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762794.749918:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140672128 00000100:00100000:0.0:1789762794.749932:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140672128 00000100:00100000:0.0:1789762794.749966:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199206707345 time 199206795077 state 0x0 ref 1 00000100:00100000:0.0:1789762794.749975:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199406795077 time 199206795077 state 0x1 ref 1 00000100:00100000:2.0:1789762794.933725:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199406795077 time 199406881246 state 0x0 ref 1 00000100:00100000:2.0:1789762794.933753:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140672128:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762794.933805:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 72351744, mtime: 0x6aad9cea, atime: 0x6aad9cdc, ctime: 0x6aad9cea, blocks: 0x2280d 00010000:00010000:2.0:1789762794.933812:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f031 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.933826:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=199s v=(0 0) 00010000:00010000:2.0:1789762794.933830:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762794.933862:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.933874:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762794.944715:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967523 is committed 00002000:00010000:2.0:1789762794.944736:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:2.0:1789762794.944741:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 141325 -> 143373 00010000:00010000:2.0:1789762794.944771:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.944782:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f031 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.944788:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f031 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.944793:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762794.944797:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f031 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.944804:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f031 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.944819:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f031 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762794.944823:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f031 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762794.944908:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140672128:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11165us (195043us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789762794.944917:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:2.0:1789762794.944924:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199406795077 time 199406881246 state 0x2 ref 0 00000100:00100000:1.0:1789762794.947220:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762794.947265:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140672256 00000100:00100000:0.0:1789762794.947273:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140672256 00000100:00100000:0.0:1789762794.947308:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199406795077 time 199406881246 state 0x0 ref 1 00000100:00100000:0.0:1789762794.947317:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199606881246 time 199406881246 state 0x1 ref 1 00000100:00100000:0.0:1789762795.133805:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199606881246 time 199606960980 state 0x0 ref 1 00000100:00100000:0.0:1789762795.133868:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140672256:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:2.0:1789762795.133886:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789762795.133928:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 73400320, mtime: 0x6aad9cea, atime: 0x6aad9cdc, ctime: 0x6aad9cea, blocks: 0x2300d 00010000:00010000:0.0:1789762795.133939:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f038 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762795.133956:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=199s v=(0 0) 00010000:00010000:0.0:1789762795.133962:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762795.133968:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762795.133981:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762795.145632:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967524 is committed 00002000:00010000:3.0:1789762795.145640:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:3.0:1789762795.145646:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 143373 -> 145421 00010000:00010000:3.0:1789762795.145660:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762795.145689:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f038 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762795.145699:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f038 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762795.145707:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762795.145711:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f038 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762795.145720:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f038 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762795.145735:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f038 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762795.145741:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f038 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762795.145812:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140672256:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11988us (198591us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789762795.145820:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:3.0:1789762795.145827:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199606881246 time 199606960980 state 0x2 ref 0 00000100:00100000:3.0:1789762795.148066:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762795.148120:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140672384 00000100:00100000:2.0:1789762795.148131:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140672384 00000100:00100000:2.0:1789762795.148172:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199606881246 time 199606960980 state 0x0 ref 1 00000100:00100000:2.0:1789762795.148186:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199806960980 time 199606960980 state 0x1 ref 1 00000100:00100000:0.0:1789762795.333899:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199806960980 time 199807055288 state 0x0 ref 1 00000100:00100000:0.0:1789762795.333926:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140672384:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762795.333996:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 74448896, mtime: 0x6aad9cea, atime: 0x6aad9cdc, ctime: 0x6aad9cea, blocks: 0x2380d 00010000:00010000:0.0:1789762795.334007:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f03f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762795.334022:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=199s v=(0 0) 00010000:00010000:0.0:1789762795.334026:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762795.334031:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f03f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762795.334042:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f03f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762795.345532:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967525 is committed 00002000:00010000:2.0:1789762795.345559:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:2.0:1789762795.345565:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 145421 -> 147469 00010000:00010000:2.0:1789762795.345579:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f03f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.345593:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f03f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.345604:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f03f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.345613:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762795.345619:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f03f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.345626:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f03f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.345643:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f03f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.345648:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f03f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762795.345732:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140672384:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11814us (197663us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789762795.345742:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:2.0:1789762795.345749:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199806960980 time 199807055288 state 0x2 ref 0 00000100:00100000:1.0:1789762795.348026:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762795.348060:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140672512 00000100:00100000:2.0:1789762795.348068:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140672512 00000100:00100000:2.0:1789762795.348109:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 199806960980 time 199807055288 state 0x0 ref 1 00000100:00100000:2.0:1789762795.348122:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200007055288 time 199807055288 state 0x1 ref 1 00000100:00100000:2.0:1789762795.534270:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200007055288 time 200007413080 state 0x0 ref 1 00000100:00100000:2.0:1789762795.534304:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140672512:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762795.534374:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 75497472, mtime: 0x6aad9cea, atime: 0x6aad9cdc, ctime: 0x6aad9cea, blocks: 0x2400d 00010000:00010000:2.0:1789762795.534383:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f046 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.534402:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=200s v=(0 0) 00010000:00010000:2.0:1789762795.534408:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762795.534415:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.534431:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762795.546938:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967526 is committed 00002000:00010000:2.0:1789762795.546952:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 75497472 -> 76546048 00002000:00010000:2.0:1789762795.546958:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 147469 -> 149517 00010000:00010000:2.0:1789762795.546970:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.546981:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f046 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.546987:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f046 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.546992:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762795.546995:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f046 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.547002:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f046 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.547017:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f046 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.547022:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f046 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762795.547094:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140672512:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12802us (199066us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789762795.547109:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:2.0:1789762795.547116:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200007055288 time 200007413080 state 0x2 ref 0 00000100:00100000:1.0:1789762795.549667:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762795.549713:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140672640 00000100:00100000:0.0:1789762795.549721:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140672640 00000100:00100000:0.0:1789762795.549755:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200007055288 time 200007413080 state 0x0 ref 1 00000100:00100000:0.0:1789762795.549764:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200207413080 time 200007413080 state 0x1 ref 1 00010000:00010000:1.0:1789762795.558932:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762795.734411:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200207413080 time 200207565577 state 0x0 ref 1 00000100:00100000:2.0:1789762795.734463:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140672640:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762795.734523:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 76546048, mtime: 0x6aad9cea, atime: 0x6aad9cdc, ctime: 0x6aad9cea, blocks: 0x2480d 00010000:00010000:2.0:1789762795.734532:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f04d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.734548:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=200s v=(0 0) 00010000:00010000:2.0:1789762795.734552:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762795.734557:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f04d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.734570:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f04d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762795.753268:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967527 is committed 00002000:00010000:2.0:1789762795.753300:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:2.0:1789762795.753309:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762794 -> 1789762795 00002000:00010000:2.0:1789762795.753315:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762794 -> 1789762795 00002000:00010000:2.0:1789762795.753320:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 149517 -> 151565 00010000:00010000:2.0:1789762795.753344:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f04d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.753371:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f04d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.753406:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f04d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.753416:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762795.753423:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f04d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.753434:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f04d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.753499:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f04d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.753511:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f04d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762795.753619:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140672640:12345-192.168.203.31@tcp:4:dd.500 Request processed in 19183us (203944us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1789762795.753635:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:2.0:1789762795.753646:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200207413080 time 200207565577 state 0x2 ref 0 00000100:00100000:3.0:1789762795.757221:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762795.757294:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140672768 00000100:00100000:0.0:1789762795.757306:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140672768 00000100:00100000:0.0:1789762795.757357:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200207413080 time 200207565577 state 0x0 ref 1 00000100:00100000:0.0:1789762795.757376:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200407565577 time 200207565577 state 0x1 ref 1 00000100:00100000:0.0:1789762795.934515:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200407565577 time 200407669747 state 0x0 ref 1 00000100:00100000:0.0:1789762795.934548:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140672768:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762795.934608:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 77594624, mtime: 0x6aad9ceb, atime: 0x6aad9cdc, ctime: 0x6aad9ceb, blocks: 0x2500d 00010000:00010000:0.0:1789762795.934632:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f054 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762795.934649:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=200s v=(0 0) 00010000:00010000:0.0:1789762795.934653:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762795.934659:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762795.934673:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762795.952604:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967528 is committed 00002000:00010000:2.0:1789762795.952642:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:2.0:1789762795.952650:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 151565 -> 153613 00010000:00010000:2.0:1789762795.952665:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.952701:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f054 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.952713:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f054 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.952720:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762795.952724:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f054 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.952732:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f054 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.952779:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f054 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762795.952787:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000021678ce/0xd08452c77c56f054 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762795.952908:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140672768:12345-192.168.203.31@tcp:4:dd.500 Request processed in 18372us (195687us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1789762795.952921:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:2.0:1789762795.952930:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200407565577 time 200407669747 state 0x2 ref 0 00000100:00100000:3.0:1789762795.956233:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762795.956326:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140672896 00000100:00100000:2.0:1789762795.956346:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140672896 00000100:00100000:2.0:1789762795.956409:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200407565577 time 200407669747 state 0x0 ref 1 00000100:00100000:2.0:1789762795.956423:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200607669747 time 200407669747 state 0x1 ref 1 00000100:00100000:0.0:1789762796.134641:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200607669747 time 200607794313 state 0x0 ref 1 00000100:00100000:0.0:1789762796.134676:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140672896:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762796.134738:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 78643200, mtime: 0x6aad9ceb, atime: 0x6aad9cdc, ctime: 0x6aad9ceb, blocks: 0x2580d 00010000:00010000:0.0:1789762796.134749:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f05b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762796.134768:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=200s v=(0 0) 00010000:00010000:0.0:1789762796.134773:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762796.134779:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f05b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762796.134794:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f05b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762796.152927:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 78643200 -> 79691776 00002000:00010000:2.0:1789762796.152937:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 153613 -> 155661 00000001:00080000:1.0:1789762796.152947:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967529 is committed 00010000:00010000:2.0:1789762796.152954:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f05b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.152972:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f05b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.152986:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f05b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.152997:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762796.153004:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f05b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.153016:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f05b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.153038:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f05b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.153050:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56f05b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762796.153162:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140672896:12345-192.168.203.31@tcp:4:dd.500 Request processed in 18497us (196927us total) trans 4294967529 rc 0/0 00000100:00100000:2.0:1789762796.153178:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:2.0:1789762796.153188:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200607669747 time 200607794313 state 0x2 ref 0 00000100:00100000:3.0:1789762796.156940:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762796.156991:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140673024 00000100:00100000:2.0:1789762796.157003:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140673024 00000100:00100000:2.0:1789762796.157053:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200607669747 time 200607794313 state 0x0 ref 1 00000100:00100000:2.0:1789762796.157069:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200807794313 time 200607794313 state 0x1 ref 1 00000100:00100000:2.0:1789762796.334742:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200807794313 time 200807878417 state 0x0 ref 1 00000100:00100000:2.0:1789762796.334778:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140673024:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762796.334838:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 79691776, mtime: 0x6aad9ceb, atime: 0x6aad9cdc, ctime: 0x6aad9ceb, blocks: 0x2600d 00010000:00010000:2.0:1789762796.334883:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f062 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.334900:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=200s v=(0 0) 00010000:00010000:2.0:1789762796.334905:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762796.334912:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.334928:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762796.351033:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967530 is committed 00002000:00010000:2.0:1789762796.351125:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:2.0:1789762796.351131:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 155661 -> 157709 00010000:00010000:2.0:1789762796.351145:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.351159:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.351169:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f062 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.351177:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762796.351182:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f062 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.351193:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f062 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.351215:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f062 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.351223:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f062 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762796.351311:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140673024:12345-192.168.203.31@tcp:4:dd.500 Request processed in 16543us (194368us total) trans 4294967530 rc 0/0 00000100:00100000:2.0:1789762796.351326:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:2.0:1789762796.351333:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200807794313 time 200807878417 state 0x2 ref 0 00000100:00100000:3.0:1789762796.354387:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762796.354452:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140673152 00000100:00100000:0.0:1789762796.354477:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140673152 00000100:00100000:0.0:1789762796.354512:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 200807794313 time 200807878417 state 0x0 ref 1 00000100:00100000:0.0:1789762796.354524:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201007878417 time 200807878417 state 0x1 ref 1 00000100:00100000:2.0:1789762796.534886:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201007878417 time 201007995227 state 0x0 ref 1 00000100:00100000:2.0:1789762796.534921:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140673152:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762796.534982:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 80740352, mtime: 0x6aad9ceb, atime: 0x6aad9cdc, ctime: 0x6aad9ceb, blocks: 0x2680d 00010000:00010000:2.0:1789762796.534992:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f069 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.535009:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=201s v=(0 0) 00010000:00010000:2.0:1789762796.535015:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762796.535023:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.535043:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762796.549892:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967531 is committed 00002000:00010000:2.0:1789762796.549913:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 80740352 -> 81788928 00002000:00010000:2.0:1789762796.549920:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 157709 -> 159757 00010000:00010000:2.0:1789762796.549933:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.549945:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.549965:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.549971:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762796.549975:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.549983:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f069 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.549999:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f069 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.550005:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f069 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762796.550073:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140673152:12345-192.168.203.31@tcp:4:dd.500 Request processed in 15166us (195686us total) trans 4294967531 rc 0/0 00000100:00100000:2.0:1789762796.550083:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:2.0:1789762796.550090:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201007878417 time 201007995227 state 0x2 ref 0 00000100:00100000:3.0:1789762796.552744:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762796.552801:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140673280 00000100:00100000:0.0:1789762796.552811:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140673280 00000100:00100000:0.0:1789762796.552886:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201007878417 time 201007995227 state 0x0 ref 1 00000100:00100000:0.0:1789762796.552902:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201207995227 time 201007995227 state 0x1 ref 1 00010000:00010000:1.0:1789762796.582955:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762796.734915:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201207995227 time 201208070137 state 0x0 ref 1 00000100:00100000:0.0:1789762796.734948:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140673280:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762796.735004:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 81788928, mtime: 0x6aad9ceb, atime: 0x6aad9cdc, ctime: 0x6aad9ceb, blocks: 0x2700d 00010000:00010000:0.0:1789762796.735013:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f070 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762796.735029:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=201s v=(0 0) 00010000:00010000:0.0:1789762796.735033:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762796.735038:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f070 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762796.735052:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f070 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762796.752689:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967532 is committed 00002000:00010000:2.0:1789762796.752720:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 81788928 -> 82837504 00002000:00010000:2.0:1789762796.752727:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762795 -> 1789762796 00002000:00010000:2.0:1789762796.752730:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762795 -> 1789762796 00002000:00010000:2.0:1789762796.752734:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 159757 -> 161805 00010000:00010000:2.0:1789762796.752763:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f070 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.752781:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.752795:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.752807:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762796.752814:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.752828:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f070 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.752874:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f070 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.752882:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000106dbd49/0xd08452c77c56f070 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762796.752970:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140673280:12345-192.168.203.31@tcp:4:dd.500 Request processed in 18034us (200224us total) trans 4294967532 rc 0/0 00000100:00100000:2.0:1789762796.752981:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:2.0:1789762796.752990:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201207995227 time 201208070137 state 0x2 ref 0 00000100:00100000:1.0:1789762796.755955:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762796.755997:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140673408 00000100:00100000:2.0:1789762796.756016:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140673408 00000100:00100000:2.0:1789762796.756057:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201207995227 time 201208070137 state 0x0 ref 1 00000100:00100000:2.0:1789762796.756068:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201408070137 time 201208070137 state 0x1 ref 1 00000100:00100000:0.0:1789762796.935058:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201408070137 time 201408212722 state 0x0 ref 1 00000100:00100000:0.0:1789762796.935090:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140673408:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762796.935149:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 82837504, mtime: 0x6aad9cec, atime: 0x6aad9cdc, ctime: 0x6aad9cec, blocks: 0x2780d 00010000:00010000:0.0:1789762796.935159:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f077 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762796.935174:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=201s v=(0 0) 00010000:00010000:0.0:1789762796.935178:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762796.935184:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762796.935211:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762796.947091:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967533 is committed 00002000:00010000:2.0:1789762796.947106:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:2.0:1789762796.947111:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 161805 -> 163853 00010000:00010000:2.0:1789762796.947121:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.947131:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f077 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.947138:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f077 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.947143:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002aa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762796.947147:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f077 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.947153:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f077 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.947167:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f077 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762796.947172:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b36d728b/0xd08452c77c56f077 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762796.947239:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140673408:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12162us (191302us total) trans 4294967533 rc 0/0 00000100:00100000:2.0:1789762796.947248:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:2.0:1789762796.947253:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201408070137 time 201408212722 state 0x2 ref 0 00000100:00100000:1.0:1789762796.949794:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762796.949903:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140673536 00000100:00100000:2.0:1789762796.949911:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140673536 00000100:00100000:2.0:1789762796.949944:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201408070137 time 201408212722 state 0x0 ref 1 00000100:00100000:2.0:1789762796.949953:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201608212722 time 201408212722 state 0x1 ref 1 00000100:00100000:2.0:1789762797.135117:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201608212722 time 201608273650 state 0x0 ref 1 00000100:00100000:2.0:1789762797.135158:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140673536:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:0.0:1789762797.135213:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789762797.135229:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 83886080, mtime: 0x6aad9cec, atime: 0x6aad9cdc, ctime: 0x6aad9cec, blocks: 0x2800d 00010000:00010000:2.0:1789762797.135241:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f07e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762797.135259:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=201s v=(0 0) 00010000:00010000:2.0:1789762797.135265:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762797.135270:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f07e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762797.135282:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f07e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762797.148758:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967534 is committed 00002000:00010000:0.0:1789762797.148783:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:0.0:1789762797.148788:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 163853 -> 165901 00010000:00010000:0.0:1789762797.148799:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f07e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.148810:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f07e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.148817:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f07e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.148855:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762797.148859:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f07e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.148867:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f07e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.148883:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f07e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.148889:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa65203f/0xd08452c77c56f07e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762797.148965:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140673536:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13829us (199167us total) trans 4294967534 rc 0/0 00000100:00100000:0.0:1789762797.148978:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:0.0:1789762797.148986:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201608212722 time 201608273650 state 0x2 ref 0 00000100:00100000:3.0:1789762797.151207:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762797.151246:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140673664 00000100:00100000:0.0:1789762797.151254:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140673664 00000100:00100000:0.0:1789762797.151290:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201608212722 time 201608273650 state 0x0 ref 1 00000100:00100000:0.0:1789762797.151299:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201808273650 time 201608273650 state 0x1 ref 1 00000100:00100000:2.0:1789762797.335245:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201808273650 time 201808400368 state 0x0 ref 1 00000100:00100000:2.0:1789762797.335273:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140673664:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762797.335324:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 84934656, mtime: 0x6aad9cec, atime: 0x6aad9cdc, ctime: 0x6aad9cec, blocks: 0x2880d 00010000:00010000:2.0:1789762797.335331:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f085 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762797.335344:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=201s v=(0 0) 00010000:00010000:2.0:1789762797.335347:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762797.335352:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762797.335364:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762797.346096:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967535 is committed 00002000:00010000:0.0:1789762797.346160:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:0.0:1789762797.346165:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 165901 -> 167949 00010000:00010000:0.0:1789762797.346183:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.346193:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.346200:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f085 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.346205:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762797.346209:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f085 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.346217:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f085 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.346236:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f085 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.346245:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f085 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762797.346321:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140673664:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11057us (195111us total) trans 4294967535 rc 0/0 00000100:00100000:0.0:1789762797.346330:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:0.0:1789762797.346337:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201808273650 time 201808400368 state 0x2 ref 0 00000100:00100000:3.0:1789762797.348482:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762797.348530:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140673792 00000100:00100000:0.0:1789762797.348548:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140673792 00000100:00100000:0.0:1789762797.348589:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 201808273650 time 201808400368 state 0x0 ref 1 00000100:00100000:0.0:1789762797.348603:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202008400368 time 201808400368 state 0x1 ref 1 00000100:00100000:0.0:1789762797.535283:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202008400368 time 202008439203 state 0x0 ref 1 00000100:00100000:0.0:1789762797.535308:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140673792:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762797.535368:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 85983232, mtime: 0x6aad9cec, atime: 0x6aad9cdc, ctime: 0x6aad9cec, blocks: 0x2900d 00010000:00010000:0.0:1789762797.535378:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f08c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.535394:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=202s v=(0 0) 00010000:00010000:0.0:1789762797.535400:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762797.535407:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f08c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.535424:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f08c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762797.546419:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967536 is committed 00002000:00010000:1.0:1789762797.546483:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:1.0:1789762797.546488:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 167949 -> 169997 00010000:00010000:1.0:1789762797.546500:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f08c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762797.546513:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f08c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762797.546523:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f08c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762797.546542:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762797.546547:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f08c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762797.546557:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f08c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762797.546575:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f08c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762797.546583:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074e7fcff/0xd08452c77c56f08c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762797.546652:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140673792:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11352us (198169us total) trans 4294967536 rc 0/0 00000100:00100000:1.0:1789762797.546671:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:1.0:1789762797.546677:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202008400368 time 202008439203 state 0x2 ref 0 00000100:00100000:3.0:1789762797.548651:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762797.548691:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140673920 00000100:00100000:2.0:1789762797.548709:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140673920 00000100:00100000:2.0:1789762797.548748:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202008400368 time 202008439203 state 0x0 ref 1 00000100:00100000:2.0:1789762797.548757:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202208439203 time 202008439203 state 0x1 ref 1 00010000:00010000:1.0:1789762797.606924:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762797.735324:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202208439203 time 202208482023 state 0x0 ref 1 00000100:00100000:0.0:1789762797.735347:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140673920:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762797.735398:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 87031808, mtime: 0x6aad9cec, atime: 0x6aad9cdc, ctime: 0x6aad9cec, blocks: 0x2980d 00010000:00010000:0.0:1789762797.735406:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f093 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.735453:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=202s v=(0 0) 00010000:00010000:0.0:1789762797.735457:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762797.735464:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.735476:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762797.748634:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 87031808 -> 88080384 00002000:00010000:3.0:1789762797.748639:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762796 -> 1789762797 00002000:00010000:3.0:1789762797.748641:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762796 -> 1789762797 00002000:00010000:3.0:1789762797.748643:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 169997 -> 172045 00010000:00010000:3.0:1789762797.748654:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762797.748664:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762797.748671:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f093 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762797.748677:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002bc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762797.748681:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f093 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762797.748684:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967537 is committed 00010000:00010000:3.0:1789762797.748690:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f093 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762797.748719:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f093 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762797.748725:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f093 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762797.748795:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140673920:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13453us (200142us total) trans 4294967537 rc 0/0 00000100:00100000:3.0:1789762797.748802:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:3.0:1789762797.748809:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202208439203 time 202208482023 state 0x2 ref 0 00000100:00100000:2.0:1789762797.751399:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762797.751461:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140674048 00000100:00100000:0.0:1789762797.751470:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140674048 00000100:00100000:0.0:1789762797.751506:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202208439203 time 202208482023 state 0x0 ref 1 00000100:00100000:0.0:1789762797.751516:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202408482023 time 202208482023 state 0x1 ref 1 00000100:00100000:2.0:1789762797.935453:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202408482023 time 202408609347 state 0x0 ref 1 00000100:00100000:2.0:1789762797.935484:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140674048:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762797.935558:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 88080384, mtime: 0x6aad9ced, atime: 0x6aad9cdc, ctime: 0x6aad9ced, blocks: 0x2a00d 00010000:00010000:2.0:1789762797.935565:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f09a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762797.935579:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=202s v=(0 0) 00010000:00010000:2.0:1789762797.935583:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762797.935588:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f09a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762797.935599:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f09a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762797.948534:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967538 is committed 00002000:00010000:0.0:1789762797.948575:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:0.0:1789762797.948580:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 172045 -> 174093 00010000:00010000:0.0:1789762797.948593:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f09a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.948604:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f09a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.948610:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f09a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.948615:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762797.948619:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f09a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.948633:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f09a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.948648:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f09a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762797.948655:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f09a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762797.948749:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140674048:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13275us (197345us total) trans 4294967538 rc 0/0 00000100:00100000:0.0:1789762797.948763:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:0.0:1789762797.948772:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202408482023 time 202408609347 state 0x2 ref 0 00000100:00100000:1.0:1789762797.951206:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762797.951241:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140674176 00000100:00100000:0.0:1789762797.951249:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140674176 00000100:00100000:0.0:1789762797.951284:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202408482023 time 202408609347 state 0x0 ref 1 00000100:00100000:0.0:1789762797.951294:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202608609347 time 202408609347 state 0x1 ref 1 00000100:00100000:0.0:1789762798.135547:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202608609347 time 202608702183 state 0x0 ref 1 00000100:00100000:0.0:1789762798.135577:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140674176:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762798.135630:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 89128960, mtime: 0x6aad9ced, atime: 0x6aad9cdc, ctime: 0x6aad9ced, blocks: 0x2a80d 00010000:00010000:0.0:1789762798.135637:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.135663:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=202s v=(0 0) 00010000:00010000:0.0:1789762798.135667:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762798.135672:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.135682:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762798.147048:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967539 is committed 00002000:00010000:0.0:1789762798.147076:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:0.0:1789762798.147083:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 174093 -> 176141 00010000:00010000:0.0:1789762798.147096:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.147110:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.147121:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.147130:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762798.147135:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.147146:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.147181:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.147191:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762798.147267:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140674176:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11700us (196058us total) trans 4294967539 rc 0/0 00000100:00100000:0.0:1789762798.147278:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:0.0:1789762798.147286:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202608609347 time 202608702183 state 0x2 ref 0 00000100:00100000:2.0:1789762798.149495:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762798.149539:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140674304 00000100:00100000:1.0:1789762798.149554:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140674304 00000100:00100000:1.0:1789762798.149588:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202608609347 time 202608702183 state 0x0 ref 1 00000100:00100000:1.0:1789762798.149598:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202808702183 time 202608702183 state 0x1 ref 1 00000100:00100000:3.0:1789762798.246999:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149011840:0@lo:400:kworker.0 00000100:00100000:1.0:1789762798.247000:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149011712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762798.247031:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149012096:0@lo:400:kworker.0 00000100:00100000:2.0:1789762798.247074:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149011968:0@lo:400:kworker.0 00000100:00100000:1.0:1789762798.247075:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762798.247083:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762798.247087:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762798.247127:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762798.247139:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149012224:0@lo:400:kworker.0 00000100:00100000:3.0:1789762798.247147:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149012352:0@lo:400:kworker.0 00000100:00100000:2.0:1789762798.247156:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149012480:0@lo:400:kworker.0 00000100:00100000:1.0:1789762798.247172:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762798.247185:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149011712 00000100:00100000:3.0:1789762798.247191:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762798.247194:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149011712 00000100:00100000:1.0:1789762798.247220:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149012096 00000100:00100000:1.0:1789762798.247225:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149012096 00000100:00100000:3.0:1789762798.247245:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149011840 00000100:00100000:3.0:1789762798.247252:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149011840 00000100:00100000:1.0:1789762798.247265:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149011968 00000100:00100000:1.0:1789762798.247269:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149011968 00000100:00100000:0.0:1789762798.247270:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789762798.247285:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149011712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762798.247294:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789762798.247298:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149012352 00000100:00100000:1.0:1789762798.247302:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149012352 00000100:00100000:3.0:1789762798.247308:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149011840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762798.247320:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00002000:00000024:0.0:1789762798.247324:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762798.247330:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149012096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762798.247385:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149011840:12345-0@lo:400:kworker.0 Request processed in 80us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762798.247396:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789762798.247404:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149011712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762798.247407:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149012096:12345-0@lo:400:kworker.0 Request processed in 79us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762798.247416:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789762798.247419:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789762798.247457:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1789762798.247459:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762798.247464:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762798.247469:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789762798.247471:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149011968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762798.247491:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149012352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762798.247499:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149012224 00000100:00100000:0.0:1789762798.247504:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149012224 00000100:00100000:0.0:1789762798.247546:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789762798.247549:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149012352:12345-0@lo:400:kworker.0 Request processed in 62us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762798.247561:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789762798.247565:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149012224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762798.247608:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149011968:12345-0@lo:400:kworker.0 Request processed in 139us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762798.247612:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149012224:12345-0@lo:400:kworker.0 Request processed in 49us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762798.247627:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789762798.247628:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1789762798.247666:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762798.247671:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149012096:0@lo:400:kworker.0 00000100:00100000:0.0:1789762798.247802:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762798.247809:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149012224:0@lo:400:kworker.0 00000100:00100000:3.0:1789762798.247809:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149012352:0@lo:400:kworker.0 00000100:00100000:1.0:1789762798.247851:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149011712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762798.247889:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149011968:0@lo:400:kworker.0 00000100:00100000:1.0:1789762798.247901:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149012480 00000100:00100000:1.0:1789762798.247905:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149012480 00000100:00100000:1.0:1789762798.247938:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789762798.247945:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149012480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762798.247967:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149011840:0@lo:400:kworker.0 00000100:00100000:1.0:1789762798.247989:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149012480:12345-0@lo:400:kworker.0 Request processed in 43us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762798.247995:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789762798.248025:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149012480:0@lo:400:kworker.0 00000100:00100000:0.0:1789762798.335669:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202808702183 time 202808824933 state 0x0 ref 1 00000100:00100000:0.0:1789762798.335695:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140674304:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762798.335756:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 90177536, mtime: 0x6aad9ced, atime: 0x6aad9cdc, ctime: 0x6aad9ced, blocks: 0x2b00d 00010000:00010000:0.0:1789762798.335763:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.335776:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=202s v=(0 0) 00010000:00010000:0.0:1789762798.335779:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762798.335784:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.335795:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762798.346435:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967540 is committed 00002000:00010000:0.0:1789762798.346447:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:0.0:1789762798.346455:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 176141 -> 178189 00010000:00010000:0.0:1789762798.346469:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.346489:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.346496:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.346501:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762798.346505:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.346511:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.346526:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.346531:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f0a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762798.346594:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140674304:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10909us (197098us total) trans 4294967540 rc 0/0 00000100:00100000:0.0:1789762798.346603:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:0.0:1789762798.346609:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202808702183 time 202808824933 state 0x2 ref 0 00000100:00100000:1.0:1789762798.348682:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762798.348730:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140674432 00000100:00100000:3.0:1789762798.348739:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140674432 00000100:00100000:3.0:1789762798.348776:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 202808702183 time 202808824933 state 0x0 ref 1 00000100:00100000:3.0:1789762798.348785:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203008824933 time 202808824933 state 0x1 ref 1 00000100:00100000:2.0:1789762798.452408:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762798.452460:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762798.452480:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140674560 00000100:00100000:2.0:1789762798.452497:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762798.452503:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140674560 00000100:00100000:1.0:1789762798.452518:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140674688 00000100:00100000:1.0:1789762798.452526:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140674688 00000100:00100000:2.0:1789762798.452544:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762798.452550:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140674816 00000100:00100000:3.0:1789762798.452556:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140674816 00000100:00100000:0.0:1789762798.452578:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:1.0:1789762798.452588:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140674944 00000100:00100000:1.0:1789762798.452594:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140674944 00000100:00100000:0.0:1789762798.452595:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140674560:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:2.0:1789762798.452599:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762798.452601:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00080000:2.0:1789762798.452606:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762798.452616:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140674816:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762798.452635:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:2.0:1789762798.452643:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:1.0:1789762798.452647:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2342:x1876702140674688:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762798.452656:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140674944:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762798.452687:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140674560:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 92us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762798.452688:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2342:x1876702140674688:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 40us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762798.452688:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140674816:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 68us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762798.452701:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140674944:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762798.452710:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:1.0:1789762798.452711:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:3.0:1789762798.452711:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:2.0:1789762798.452721:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:1.0:1789762798.535754:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203008824933 time 203008908625 state 0x0 ref 1 00000100:00100000:1.0:1789762798.535794:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140674432:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762798.535866:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 91226112, mtime: 0x6aad9ced, atime: 0x6aad9cdc, ctime: 0x6aad9ced, blocks: 0x2b80d 00010000:00010000:1.0:1789762798.535874:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56f0af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762798.535889:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=203s v=(0 0) 00010000:00010000:1.0:1789762798.535895:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762798.535901:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56f0af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762798.535918:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56f0af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762798.546737:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967541 is committed 00002000:00010000:0.0:1789762798.546755:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:0.0:1789762798.546761:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 178189 -> 180237 00010000:00010000:0.0:1789762798.546775:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56f0af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.546789:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56f0af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.546799:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56f0af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.546808:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762798.546813:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56f0af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.546823:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56f0af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.546858:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56f0af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.546879:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b7d5437/0xd08452c77c56f0af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762798.546952:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140674432:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11165us (198269us total) trans 4294967541 rc 0/0 00000100:00100000:0.0:1789762798.546960:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:0.0:1789762798.546967:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203008824933 time 203008908625 state 0x2 ref 0 00000100:00100000:2.0:1789762798.549190:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762798.549259:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140675072 00000100:00100000:0.0:1789762798.549268:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140675072 00000100:00100000:0.0:1789762798.549302:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203008824933 time 203008908625 state 0x0 ref 1 00000100:00100000:0.0:1789762798.549311:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203208908625 time 203008908625 state 0x1 ref 1 00010000:00010000:3.0:1789762798.630955:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762798.735880:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203208908625 time 203209035235 state 0x0 ref 1 00000100:00100000:3.0:1789762798.735909:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140675072:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762798.735958:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 92274688, mtime: 0x6aad9ced, atime: 0x6aad9cdc, ctime: 0x6aad9ced, blocks: 0x2c00d 00010000:00010000:3.0:1789762798.735965:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f0b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762798.735994:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=203s v=(0 0) 00010000:00010000:3.0:1789762798.735997:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762798.736002:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762798.736013:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762798.747216:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967542 is committed 00002000:00010000:0.0:1789762798.747240:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 92274688 -> 93323264 00002000:00010000:0.0:1789762798.747245:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762797 -> 1789762798 00002000:00010000:0.0:1789762798.747247:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762797 -> 1789762798 00002000:00010000:0.0:1789762798.747249:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 180237 -> 182285 00010000:00010000:0.0:1789762798.747260:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.747270:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f0b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.747277:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f0b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.747292:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762798.747296:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f0b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.747302:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f0b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.747317:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f0b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.747322:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c56f0b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762798.747395:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140675072:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11498us (198203us total) trans 4294967542 rc 0/0 00000100:00100000:0.0:1789762798.747404:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:0.0:1789762798.747410:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203208908625 time 203209035235 state 0x2 ref 0 00000100:00100000:2.0:1789762798.749471:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762798.749507:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140675200 00000100:00100000:0.0:1789762798.749515:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140675200 00000100:00100000:0.0:1789762798.749564:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203208908625 time 203209035235 state 0x0 ref 1 00000100:00100000:0.0:1789762798.749576:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203409035235 time 203209035235 state 0x1 ref 1 00000100:00100000:1.0:1789762798.759006:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149012608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762798.759054:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762798.759100:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149012608 00000100:00100000:3.0:1789762798.759108:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149012608 00000100:00100000:3.0:1789762798.759158:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789762798.759170:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149012608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762798.759192:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 420806656 pending 0 free 3773825024 avail 3764387840 00000100:00100000:3.0:1789762798.759244:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149012608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762798.759253:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789762798.759284:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149012608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762798.935958:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203409035235 time 203409113105 state 0x0 ref 1 00000100:00100000:0.0:1789762798.935985:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140675200:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762798.936047:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 93323264, mtime: 0x6aad9cee, atime: 0x6aad9cdc, ctime: 0x6aad9cee, blocks: 0x2c80d 00010000:00010000:0.0:1789762798.936055:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.936068:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=203s v=(0 0) 00010000:00010000:0.0:1789762798.936072:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762798.936076:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.936087:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762798.946521:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967543 is committed 00002000:00010000:0.0:1789762798.946543:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 93323264 -> 94371840 00002000:00010000:0.0:1789762798.946548:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 182285 -> 184333 00010000:00010000:0.0:1789762798.946559:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.946569:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.946576:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.946581:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762798.946584:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.946601:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.946616:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762798.946621:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762798.946690:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140675200:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10714us (197216us total) trans 4294967543 rc 0/0 00000100:00100000:0.0:1789762798.946698:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:0.0:1789762798.946704:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203409035235 time 203409113105 state 0x2 ref 0 00000100:00100000:2.0:1789762798.948728:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762798.948767:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140675328 00000100:00100000:0.0:1789762798.948775:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140675328 00000100:00100000:0.0:1789762798.948808:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203409035235 time 203409113105 state 0x0 ref 1 00000100:00100000:0.0:1789762798.948817:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203609113105 time 203409113105 state 0x1 ref 1 00000100:00100000:0.0:1789762799.136044:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203609113105 time 203609197622 state 0x0 ref 1 00000100:00100000:0.0:1789762799.136091:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140675328:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762799.136142:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 94371840, mtime: 0x6aad9cee, atime: 0x6aad9cdc, ctime: 0x6aad9cee, blocks: 0x2d00d 00000100:00080000:2.0:1789762799.136148:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762799.136150:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.136178:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=203s v=(0 0) 00010000:00010000:0.0:1789762799.136181:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762799.136186:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.136197:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762799.146634:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967544 is committed 00002000:00010000:0.0:1789762799.146690:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 94371840 -> 95420416 00002000:00010000:0.0:1789762799.146695:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 184333 -> 186381 00010000:00010000:0.0:1789762799.146705:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.146714:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.146721:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.146726:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762799.146730:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.146736:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.146759:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.146765:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762799.146822:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140675328:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10759us (198094us total) trans 4294967544 rc 0/0 00000100:00100000:0.0:1789762799.146830:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:0.0:1789762799.146868:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203609113105 time 203609197622 state 0x2 ref 0 00000100:00100000:1.0:1789762799.148886:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762799.148910:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140675456 00000100:00100000:0.0:1789762799.148918:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140675456 00000100:00100000:0.0:1789762799.148949:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203609113105 time 203609197622 state 0x0 ref 1 00000100:00100000:0.0:1789762799.148958:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203809197622 time 203609197622 state 0x1 ref 1 00000100:00100000:3.0:1789762799.336137:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203809197622 time 203809292262 state 0x0 ref 1 00000100:00100000:3.0:1789762799.336168:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140675456:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762799.336220:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 95420416, mtime: 0x6aad9cee, atime: 0x6aad9cdc, ctime: 0x6aad9cee, blocks: 0x2d80d 00010000:00010000:3.0:1789762799.336230:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762799.336247:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=203s v=(0 0) 00010000:00010000:3.0:1789762799.336253:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762799.336270:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762799.336282:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762799.347242:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967545 is committed 00002000:00010000:3.0:1789762799.347250:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 95420416 -> 96468992 00002000:00010000:3.0:1789762799.347255:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 186381 -> 188429 00010000:00010000:3.0:1789762799.347267:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762799.347278:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762799.347284:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762799.347289:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762799.347292:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762799.347299:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762799.347314:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762799.347328:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762799.347395:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140675456:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11239us (198507us total) trans 4294967545 rc 0/0 00000100:00100000:3.0:1789762799.347404:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:3.0:1789762799.347411:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203809197622 time 203809292262 state 0x2 ref 0 00000100:00100000:2.0:1789762799.349670:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762799.349725:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140675584 00000100:00100000:0.0:1789762799.349749:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140675584 00000100:00100000:0.0:1789762799.349786:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 203809197622 time 203809292262 state 0x0 ref 1 00000100:00100000:0.0:1789762799.349796:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204009292262 time 203809292262 state 0x1 ref 1 00000100:00100000:0.0:1789762799.536184:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204009292262 time 204009340990 state 0x0 ref 1 00000100:00100000:0.0:1789762799.536213:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140675584:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762799.536263:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 96468992, mtime: 0x6aad9cee, atime: 0x6aad9cdc, ctime: 0x6aad9cee, blocks: 0x2e00d 00010000:00010000:0.0:1789762799.536282:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.536296:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=204s v=(0 0) 00010000:00010000:0.0:1789762799.536299:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762799.536304:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.536317:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762799.547076:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967546 is committed 00002000:00010000:2.0:1789762799.547084:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:2.0:1789762799.547091:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 188429 -> 190477 00010000:00010000:2.0:1789762799.547104:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762799.547118:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762799.547126:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762799.547131:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762799.547134:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762799.547140:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762799.547166:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762799.547172:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009515bd57/0xd08452c77c56f0d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762799.547233:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140675584:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11031us (197561us total) trans 4294967546 rc 0/0 00000100:00100000:2.0:1789762799.547240:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:2.0:1789762799.547246:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204009292262 time 204009340990 state 0x2 ref 0 00000100:00100000:0.0:1789762799.549296:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762799.549341:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140675712 00000100:00100000:2.0:1789762799.549350:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140675712 00000100:00100000:2.0:1789762799.549385:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204009292262 time 204009340990 state 0x0 ref 1 00000100:00100000:2.0:1789762799.549395:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204209340990 time 204009340990 state 0x1 ref 1 00010000:00010000:1.0:1789762799.654958:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762799.736287:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204209340990 time 204209444145 state 0x0 ref 1 00000100:00100000:0.0:1789762799.736317:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140675712:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762799.736369:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 97517568, mtime: 0x6aad9cee, atime: 0x6aad9cdc, ctime: 0x6aad9cee, blocks: 0x2e80d 00010000:00010000:0.0:1789762799.736376:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.736390:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=204s v=(0 0) 00010000:00010000:0.0:1789762799.736394:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762799.736398:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.736409:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762799.747532:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 97517568 -> 98566144 00000001:00080000:3.0:1789762799.747533:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967547 is committed 00002000:00010000:0.0:1789762799.747540:0:11722:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762798 -> 1789762799 00002000:00010000:0.0:1789762799.747544:0:11722:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762798 -> 1789762799 00002000:00010000:0.0:1789762799.747547:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 190477 -> 192525 00010000:00010000:0.0:1789762799.747560:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.747576:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.747586:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.747593:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762799.747598:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.747608:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.747640:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.747648:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762799.747738:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140675712:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11432us (198441us total) trans 4294967547 rc 0/0 00000100:00100000:0.0:1789762799.747750:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:0.0:1789762799.747757:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204209340990 time 204209444145 state 0x2 ref 0 00000100:00100000:1.0:1789762799.750137:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762799.750189:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140675840 00000100:00100000:2.0:1789762799.750198:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140675840 00000100:00100000:2.0:1789762799.750232:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204209340990 time 204209444145 state 0x0 ref 1 00000100:00100000:2.0:1789762799.750241:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204409444145 time 204209444145 state 0x1 ref 1 00000100:00100000:2.0:1789762799.936354:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204409444145 time 204409510323 state 0x0 ref 1 00000100:00100000:2.0:1789762799.936381:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140675840:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762799.936453:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 98566144, mtime: 0x6aad9cef, atime: 0x6aad9cdc, ctime: 0x6aad9cef, blocks: 0x2f00d 00010000:00010000:2.0:1789762799.936472:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f0e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762799.936490:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=204s v=(0 0) 00010000:00010000:2.0:1789762799.936493:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762799.936498:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762799.936511:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762799.947199:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967548 is committed 00002000:00010000:0.0:1789762799.947255:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:0.0:1789762799.947260:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 192525 -> 194575 00010000:00010000:0.0:1789762799.947271:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.947281:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f0e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.947287:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f0e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.947292:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762799.947296:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f0e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.947303:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f0e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.947317:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f0e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762799.947333:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cd70fa7/0xd08452c77c56f0e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762799.947404:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140675840:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11031us (197264us total) trans 4294967548 rc 0/0 00000100:00100000:0.0:1789762799.947428:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:0.0:1789762799.947435:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204409444145 time 204409510323 state 0x2 ref 0 00000100:00100000:1.0:1789762799.949607:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762799.949653:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140675968 00000100:00100000:3.0:1789762799.949661:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140675968 00000100:00100000:3.0:1789762799.949700:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204409444145 time 204409510323 state 0x0 ref 1 00000100:00100000:3.0:1789762799.949712:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204609510323 time 204409510323 state 0x1 ref 1 00000100:00100000:2.0:1789762800.136488:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204609510323 time 204609642908 state 0x0 ref 1 00000100:00100000:2.0:1789762800.136517:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140675968:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762800.136575:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 99614720, mtime: 0x6aad9cef, atime: 0x6aad9cdc, ctime: 0x6aad9cef, blocks: 0x2f80f 00010000:00010000:2.0:1789762800.136582:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f0e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762800.136595:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=204s v=(0 0) 00010000:00010000:2.0:1789762800.136599:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762800.136604:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f0e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762800.136615:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f0e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762800.148117:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967549 is committed 00002000:00010000:0.0:1789762800.148155:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:0.0:1789762800.148160:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 194575 -> 196623 00010000:00010000:0.0:1789762800.148173:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f0e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.148185:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f0e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.148194:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f0e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.148202:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148888800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762800.148207:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f0e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.148217:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f0e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.148248:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f0e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.148257:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9769a86/0xd08452c77c56f0e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762800.148340:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140675968:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11832us (198729us total) trans 4294967549 rc 0/0 00000100:00100000:0.0:1789762800.148352:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:0.0:1789762800.148361:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204609510323 time 204609642908 state 0x2 ref 0 00000100:00100000:2.0:1789762800.150687:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762800.150732:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140676096 00000100:00100000:0.0:1789762800.150742:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140676096 00000100:00100000:0.0:1789762800.150782:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204609510323 time 204609642908 state 0x0 ref 1 00000100:00100000:0.0:1789762800.150791:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204809642908 time 204609642908 state 0x1 ref 1 00000100:00100000:3.0:1789762800.336615:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204809642908 time 204809770148 state 0x0 ref 1 00000100:00100000:3.0:1789762800.336645:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140676096:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762800.336698:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 100663296, mtime: 0x6aad9cef, atime: 0x6aad9cdc, ctime: 0x6aad9cef, blocks: 0x3000f 00010000:00010000:3.0:1789762800.336705:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.336719:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=204s v=(0 0) 00010000:00010000:3.0:1789762800.336735:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762800.336740:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.336751:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762800.348191:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:3.0:1789762800.348196:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 196623 -> 198671 00010000:00010000:3.0:1789762800.348207:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762800.348210:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967550 is committed 00010000:00010000:3.0:1789762800.348221:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.348229:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.348235:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762800.348239:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.348245:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.348259:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.348274:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f0ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762800.348336:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140676096:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11705us (197649us total) trans 4294967550 rc 0/0 00000100:00100000:3.0:1789762800.348343:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:3.0:1789762800.348349:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204809642908 time 204809770148 state 0x2 ref 0 00000100:00100000:1.0:1789762800.350420:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762800.350480:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140676224 00000100:00100000:0.0:1789762800.350487:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140676224 00000100:00100000:0.0:1789762800.350524:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 204809642908 time 204809770148 state 0x0 ref 1 00000100:00100000:0.0:1789762800.350535:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205009770148 time 204809770148 state 0x1 ref 1 00000100:00100000:0.0:1789762800.536689:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205009770148 time 205009844652 state 0x0 ref 1 00000100:00100000:0.0:1789762800.536718:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140676224:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762800.536786:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 101711872, mtime: 0x6aad9cef, atime: 0x6aad9cdc, ctime: 0x6aad9cef, blocks: 0x3080f 00010000:00010000:0.0:1789762800.536793:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.536806:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=205s v=(0 0) 00010000:00010000:0.0:1789762800.536810:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762800.536814:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.536826:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762800.549661:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 101711872 -> 102760448 00002000:00010000:0.0:1789762800.549667:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 198671 -> 200719 00010000:00010000:0.0:1789762800.549679:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.549690:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.549699:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.549707:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762800.549711:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.549734:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.549752:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.549761:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762800.549829:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140676224:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13122us (199420us total) trans 4294967551 rc 0/0 00000100:00100000:0.0:1789762800.549878:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:0.0:1789762800.549886:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205009770148 time 205009844652 state 0x2 ref 0 00000001:00080000:1.0:1789762800.549893:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967551 is committed 00000100:00100000:1.0:1789762800.551902:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762800.551967:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140676352 00000100:00100000:2.0:1789762800.551977:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140676352 00000100:00100000:2.0:1789762800.552013:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205009770148 time 205009844652 state 0x0 ref 1 00000100:00100000:2.0:1789762800.552022:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205209844652 time 205009844652 state 0x1 ref 1 00010000:00010000:1.0:1789762800.678930:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762800.736830:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205209844652 time 205209981928 state 0x0 ref 1 00000100:00100000:0.0:1789762800.736937:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140676352:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762800.737027:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 102760448, mtime: 0x6aad9cef, atime: 0x6aad9cdc, ctime: 0x6aad9cef, blocks: 0x3100f 00010000:00010000:0.0:1789762800.737042:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.737061:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=205s v=(0 0) 00010000:00010000:0.0:1789762800.737066:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762800.737074:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.737120:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762800.751949:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967552 is committed 00002000:00010000:0.0:1789762800.751984:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:0.0:1789762800.751990:0:11722:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 1789762799 -> 1789762800 00002000:00010000:0.0:1789762800.751993:0:11722:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 1789762799 -> 1789762800 00002000:00010000:0.0:1789762800.751996:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 200719 -> 202767 00010000:00010000:0.0:1789762800.752009:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.752020:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.752027:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.752032:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762800.752036:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.752043:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.752058:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.752076:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f0fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762800.752152:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140676352:12345-192.168.203.31@tcp:4:dd.500 Request processed in 15240us (200248us total) trans 4294967552 rc 0/0 00000100:00100000:0.0:1789762800.752161:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:0.0:1789762800.752169:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205209844652 time 205209981928 state 0x2 ref 0 00000100:00100000:2.0:1789762800.754565:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762800.754612:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140676480 00000100:00100000:0.0:1789762800.754621:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140676480 00000100:00100000:0.0:1789762800.754661:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205209844652 time 205209981928 state 0x0 ref 1 00000100:00100000:0.0:1789762800.754670:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205409981928 time 205209981928 state 0x1 ref 1 00000100:00100000:2.0:1789762800.936924:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205409981928 time 205410079472 state 0x0 ref 1 00000100:00100000:2.0:1789762800.936949:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140676480:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762800.937008:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 103809024, mtime: 0x6aad9cf0, atime: 0x6aad9cdc, ctime: 0x6aad9cf0, blocks: 0x3180f 00010000:00010000:2.0:1789762800.937018:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56f103 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762800.937034:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=205s v=(0 0) 00010000:00010000:2.0:1789762800.937039:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762800.937045:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56f103 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762800.937060:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56f103 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762800.948856:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967553 is committed 00002000:00010000:0.0:1789762800.948885:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:0.0:1789762800.948891:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 202767 -> 204815 00010000:00010000:0.0:1789762800.948905:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56f103 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.948918:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56f103 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.948930:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56f103 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.948938:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762800.948950:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56f103 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.948960:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56f103 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.948979:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56f103 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.948988:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000540d88e/0xd08452c77c56f103 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762800.949059:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140676480:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12118us (194494us total) trans 4294967553 rc 0/0 00000100:00100000:0.0:1789762800.949070:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:0.0:1789762800.949078:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205409981928 time 205410079472 state 0x2 ref 0 00000100:00100000:3.0:1789762800.950497:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762800.950534:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140676736 00000100:00100000:1.0:1789762800.950541:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140676736 00000100:00100000:1.0:1789762800.950585:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:1.0:1789762800.950596:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+8:11137:x1876702140676736:12345-192.168.203.31@tcp:35:dd.500 00000100:00080000:2.0:1789762800.950598:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789762800.950805:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000100:00100000:1.0:1789762800.950895:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+10:11137:x1876702140676736:12345-192.168.203.31@tcp:35:dd.500 Request processed in 301us (398us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1789762800.950902:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000020:00080000:1.0:1789762800.950905:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789762800.991390:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762800.991446:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140676992 00000100:00100000:3.0:1789762800.991455:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140676992 00000100:00100000:3.0:1789762800.991502:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:3.0:1789762800.991511:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+10:11155:x1876702140676992:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:3.0:1789762800.991531:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762800.991547:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f10a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e780 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.991604:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f111 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.991617:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.991628:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.991644:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f118 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.991662:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.991670:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992109:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f11f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992119:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992128:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762800.992138:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x15:0x0]: returning size 104857600 00010000:00010000:3.0:1789762800.992227:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992236:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f111 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992244:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992251:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762800.992256:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992264:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f111 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992290:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:3.0:1789762800.992293:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762800.992298:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f111 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992306:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f111 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992321:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992329:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f118 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992335:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992342:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762800.992345:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992352:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f118 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992361:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff95d15055dd00) 00010000:00010000:3.0:1789762800.992364:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762800.992367:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f118 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992373:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992430:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f10a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e780 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992441:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f11f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e780 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762800.992447:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:3.0:1789762800.992449:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762800.992450:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140031800, rc 0) 00000100:00100000:3.0:1789762800.992498:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+12:11155:x1876702140676992:12345-192.168.203.31@tcp:101:dd.500 Request processed in 989us (1117us total) trans 4294967405 rc 0/0 00000100:00100000:3.0:1789762800.992504:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:2.0:1789762800.993663:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762800.993721:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140677120 00000100:00100000:0.0:1789762800.993727:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140677120 00000100:00100000:0.0:1789762800.993770:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:0.0:1789762800.993780:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140677120:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762800.993790:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762800.993804:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f12d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e787 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762800.993827:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 104857600, mtime: 0x6aad9cf0, atime: 0x6aad9cdc, ctime: 0x6aad9cf0, blocks: 0x3200f 00010000:00010000:0.0:1789762800.993872:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=205s v=(0 0) 00010000:00010000:0.0:1789762800.993884:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762800.993894:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f12d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e787 expref: 6 pid: 8803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.993911:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f12d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e787 expref: 6 pid: 8803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762800.993924:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16002b800, rc 0) 00000100:00100000:0.0:1789762800.993958:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140677120:12345-192.168.203.31@tcp:101:dd.500 Request processed in 180us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762800.993966:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:1.0:1789762800.996028:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762800.996071:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140677248 00000100:00100000:3.0:1789762800.996076:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140677248 00000100:00100000:3.0:1789762800.996103:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205409981928 time 205410079472 state 0x0 ref 1 00000100:00100000:3.0:1789762800.996112:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205610079472 time 205410079472 state 0x1 ref 1 00000100:00100000:0.0:1789762801.137045:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205610079472 time 205610194368 state 0x0 ref 1 00000100:00100000:0.0:1789762801.137109:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140677248:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:2.0:1789762801.137142:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762801.137161:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f134 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.137183:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762801.137188:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762801.137195:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f134 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.137213:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f134 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.141466:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f134 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.141504:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f134 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.141513:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f134 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.141520:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762801.141525:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f134 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.141532:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f134 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.141557:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f134 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.141562:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f134 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762801.141672:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140677248:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4596us (145636us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762801.141685:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:0.0:1789762801.141696:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205610079472 time 205610194368 state 0x2 ref 0 00000100:00100000:2.0:1789762801.143777:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762801.143863:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140677376 00000100:00100000:0.0:1789762801.143882:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140677376 00000100:00100000:0.0:1789762801.143967:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205610079472 time 205610194368 state 0x0 ref 1 00000100:00100000:0.0:1789762801.143983:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205810194368 time 205610194368 state 0x1 ref 1 00000100:00100000:3.0:1789762801.337187:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205810194368 time 205810330808 state 0x0 ref 1 00000100:00100000:3.0:1789762801.337227:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140677376:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762801.337278:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56f13b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762801.337297:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762801.337301:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762801.337306:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56f13b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762801.337336:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56f13b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762801.340776:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56f13b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762801.340788:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56f13b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762801.340795:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56f13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762801.340800:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762801.340805:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56f13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762801.340811:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56f13b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762801.340826:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56f13b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762801.340847:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c56f13b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762801.340905:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140677376:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3698us (197137us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762801.340920:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:3.0:1789762801.340927:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205810194368 time 205810330808 state 0x2 ref 0 00000100:00100000:2.0:1789762801.342707:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762801.342792:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140677504 00000100:00100000:0.0:1789762801.342804:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140677504 00000100:00100000:0.0:1789762801.342891:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 205810194368 time 205810330808 state 0x0 ref 1 00000100:00100000:0.0:1789762801.342902:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206010330808 time 205810330808 state 0x1 ref 1 00000100:00100000:0.0:1789762801.537214:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206010330808 time 206010371335 state 0x0 ref 1 00000100:00100000:0.0:1789762801.537240:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140677504:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762801.537278:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f142 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.537292:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762801.537295:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762801.537300:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f142 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.537312:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f142 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.540023:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f142 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.540037:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f142 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.540065:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f142 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.540074:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762801.540079:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f142 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.540089:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f142 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.540108:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f142 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.540117:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f142 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762801.540178:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140677504:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2946us (197476us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762801.540189:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:0.0:1789762801.540197:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206010330808 time 206010371335 state 0x2 ref 0 00000100:00100000:2.0:1789762801.542026:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762801.542071:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140677632 00000100:00100000:0.0:1789762801.542081:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140677632 00000100:00100000:0.0:1789762801.542118:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206010330808 time 206010371335 state 0x0 ref 1 00000100:00100000:0.0:1789762801.542130:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206210371335 time 206010371335 state 0x1 ref 1 00010000:00010000:1.0:1789762801.702958:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762801.737312:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206210371335 time 206210464927 state 0x0 ref 1 00000100:00100000:0.0:1789762801.737347:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140677632:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762801.737395:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f149 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.737437:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762801.737442:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762801.737466:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f149 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.737478:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f149 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.740767:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f149 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.740784:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f149 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.740796:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f149 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.740806:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762801.740811:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f149 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.740848:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f149 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.740865:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f149 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.740871:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f149 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762801.740925:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140677632:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3594us (198900us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762801.740933:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:0.0:1789762801.740956:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206210371335 time 206210464927 state 0x2 ref 0 00000100:00100000:1.0:1789762801.742823:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762801.742885:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140677760 00000100:00100000:0.0:1789762801.742894:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140677760 00000100:00100000:0.0:1789762801.742927:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206210371335 time 206210464927 state 0x0 ref 1 00000100:00100000:0.0:1789762801.742954:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206410464927 time 206210464927 state 0x1 ref 1 00000100:00100000:0.0:1789762801.937476:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206410464927 time 206410631178 state 0x0 ref 1 00000100:00100000:0.0:1789762801.937509:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140677760:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762801.937576:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f150 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.937625:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762801.937631:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762801.937640:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f150 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.937657:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f150 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.941955:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f150 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.941988:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f150 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.942000:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f150 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.942010:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762801.942015:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f150 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.942027:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f150 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.942051:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f150 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762801.942076:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f150 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762801.942192:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140677760:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4693us (199364us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762801.942209:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:0.0:1789762801.942221:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206410464927 time 206410631178 state 0x2 ref 0 00000100:00100000:3.0:1789762801.945220:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762801.945301:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140677888 00000100:00100000:0.0:1789762801.945316:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140677888 00000100:00100000:0.0:1789762801.945370:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206410464927 time 206410631178 state 0x0 ref 1 00000100:00100000:0.0:1789762801.945384:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206610631178 time 206410631178 state 0x1 ref 1 00000100:00100000:0.0:1789762802.137610:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206610631178 time 206610761723 state 0x0 ref 1 00000100:00100000:0.0:1789762802.137649:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140677888:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762802.137722:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f157 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.137741:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762802.137745:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762802.137753:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f157 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.137784:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f157 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.141316:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f157 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.141350:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f157 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.141360:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f157 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.141366:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762802.141371:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f157 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.141379:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f157 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.141412:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f157 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.141420:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f157 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762802.141486:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140677888:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3857us (196273us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762802.141494:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:0.0:1789762802.141524:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206610631178 time 206610761723 state 0x2 ref 0 00000100:00100000:3.0:1789762802.143821:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762802.143875:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140678016 00000100:00100000:2.0:1789762802.143901:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140678016 00000100:00100000:2.0:1789762802.143948:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206610631178 time 206610761723 state 0x0 ref 1 00000100:00100000:2.0:1789762802.143960:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206810761723 time 206610761723 state 0x1 ref 1 00000100:00100000:0.0:1789762802.337699:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206810761723 time 206810854417 state 0x0 ref 1 00000100:00100000:0.0:1789762802.337728:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140678016:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762802.337764:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f15e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.337779:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762802.337791:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762802.337796:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f15e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.337807:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f15e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.340896:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f15e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.340907:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f15e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.340919:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f15e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.340929:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762802.340934:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f15e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.340961:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f15e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.340980:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f15e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.340987:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f15e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762802.341038:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140678016:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3323us (197217us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762802.341046:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:0.0:1789762802.341051:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206810761723 time 206810854417 state 0x2 ref 0 00000100:00100000:3.0:1789762802.342888:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762802.342937:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140678144 00000100:00100000:0.0:1789762802.342947:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140678144 00000100:00100000:0.0:1789762802.342980:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 206810761723 time 206810854417 state 0x0 ref 1 00000100:00100000:0.0:1789762802.342989:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207010854417 time 206810854417 state 0x1 ref 1 00000100:00100000:2.0:1789762802.537812:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207010854417 time 207010967883 state 0x0 ref 1 00000100:00100000:2.0:1789762802.537869:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140678144:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762802.537909:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000031f7e1df/0xd08452c77c56f165 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762802.537922:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762802.537926:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762802.537930:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031f7e1df/0xd08452c77c56f165 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762802.537943:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031f7e1df/0xd08452c77c56f165 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762802.540645:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000031f7e1df/0xd08452c77c56f165 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762802.540656:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031f7e1df/0xd08452c77c56f165 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762802.540675:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031f7e1df/0xd08452c77c56f165 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762802.540681:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d151b45a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762802.540684:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f7e1df/0xd08452c77c56f165 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762802.540690:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f7e1df/0xd08452c77c56f165 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762802.540703:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031f7e1df/0xd08452c77c56f165 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762802.540709:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031f7e1df/0xd08452c77c56f165 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762802.540773:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140678144:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2944us (197937us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762802.540781:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:2.0:1789762802.540786:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207010854417 time 207010967883 state 0x2 ref 0 00000100:00100000:2.0:1789762802.542650:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762802.542703:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140678272 00000100:00100000:0.0:1789762802.542714:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140678272 00000100:00100000:0.0:1789762802.542765:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207010854417 time 207010967883 state 0x0 ref 1 00000100:00100000:0.0:1789762802.542776:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207210967883 time 207010967883 state 0x1 ref 1 00010000:00010000:3.0:1789762802.726985:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762802.737883:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207210967883 time 207211039303 state 0x0 ref 1 00000100:00100000:0.0:1789762802.737940:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140678272:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762802.737991:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f16c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.738008:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762802.738013:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762802.738018:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f16c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.738037:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f16c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.741159:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f16c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.741171:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f16c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.741179:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f16c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.741185:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762802.741189:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f16c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.741196:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f16c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.741222:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f16c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.741229:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f16c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762802.741287:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140678272:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3361us (198646us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762802.741295:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:0.0:1789762802.741302:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207210967883 time 207211039303 state 0x2 ref 0 00000100:00100000:2.0:1789762802.743195:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762802.743275:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140678400 00000100:00100000:0.0:1789762802.743285:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140678400 00000100:00100000:0.0:1789762802.743326:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207210967883 time 207211039303 state 0x0 ref 1 00000100:00100000:0.0:1789762802.743337:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207411039303 time 207211039303 state 0x1 ref 1 00000001:00080000:1.0:1789762802.863543:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967404 is committed 00000001:00080000:1.0:1789762802.863568:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967405 is committed 00000100:00100000:0.0:1789762802.938018:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207411039303 time 207411169355 state 0x0 ref 1 00000100:00100000:0.0:1789762802.938068:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140678400:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762802.938122:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f173 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.938140:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762802.938145:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762802.938150:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f173 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.938183:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f173 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.941325:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f173 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.941337:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f173 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.941346:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f173 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.941352:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762802.941356:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f173 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.941364:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f173 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.941381:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f173 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762802.941386:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f173 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762802.941468:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140678400:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3429us (198273us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762802.941490:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:0.0:1789762802.941497:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207411039303 time 207411169355 state 0x2 ref 0 00000100:00100000:2.0:1789762802.943437:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762802.943483:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140678528 00000100:00100000:3.0:1789762802.943493:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140678528 00000100:00100000:3.0:1789762802.943537:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207411039303 time 207411169355 state 0x0 ref 1 00000100:00100000:3.0:1789762802.943548:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207611169355 time 207411169355 state 0x1 ref 1 00000100:00100000:0.0:1789762803.138167:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207611169355 time 207611319178 state 0x0 ref 1 00000100:00100000:0.0:1789762803.138235:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140678528:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:2.0:1789762803.138264:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762803.138299:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f17a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.138323:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762803.138330:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762803.138337:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f17a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.138355:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f17a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.141512:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f17a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.141523:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f17a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.141530:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f17a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.141554:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762803.141559:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f17a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.141566:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f17a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.141582:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f17a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.141588:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f17a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762803.141647:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140678528:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3460us (198211us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762803.141656:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:0.0:1789762803.141662:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207611169355 time 207611319178 state 0x2 ref 0 00000100:00100000:1.0:1789762803.143906:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762803.143966:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140678656 00000100:00100000:2.0:1789762803.143985:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140678656 00000100:00100000:2.0:1789762803.144025:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207611169355 time 207611319178 state 0x0 ref 1 00000100:00100000:2.0:1789762803.144036:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207811319178 time 207611319178 state 0x1 ref 1 00000100:00100000:3.0:1789762803.338307:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207811319178 time 207811463724 state 0x0 ref 1 00000100:00100000:3.0:1789762803.338338:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140678656:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762803.338376:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d5e85003/0xd08452c77c56f181 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762803.338405:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762803.338408:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762803.338414:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e85003/0xd08452c77c56f181 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762803.338425:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5e85003/0xd08452c77c56f181 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762803.341674:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d5e85003/0xd08452c77c56f181 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762803.341693:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e85003/0xd08452c77c56f181 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762803.341701:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5e85003/0xd08452c77c56f181 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762803.341706:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d151b42600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762803.341710:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e85003/0xd08452c77c56f181 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762803.341717:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e85003/0xd08452c77c56f181 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762803.341731:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5e85003/0xd08452c77c56f181 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762803.341736:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5e85003/0xd08452c77c56f181 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762803.341789:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140678656:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3465us (197887us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762803.341801:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:3.0:1789762803.341808:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207811319178 time 207811463724 state 0x2 ref 0 00000100:00100000:3.0:1789762803.343855:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762803.343904:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140678784 00000100:00100000:0.0:1789762803.343913:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140678784 00000100:00100000:0.0:1789762803.343945:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 207811319178 time 207811463724 state 0x0 ref 1 00000100:00100000:0.0:1789762803.343957:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208011463724 time 207811463724 state 0x1 ref 1 00000100:00100000:0.0:1789762803.367007:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789762803.367028:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149012736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762803.367041:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149012864:0@lo:400:kworker.0 00000100:00100000:1.0:1789762803.367117:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762803.367129:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762803.367198:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149013376:0@lo:400:kworker.0 00000100:00100000:0.0:1789762803.367200:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149013120:0@lo:400:kworker.0 00000100:00100000:2.0:1789762803.367211:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149012864 00000100:00100000:2.0:1789762803.367225:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149012864 00000100:00100000:1.0:1789762803.367239:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762803.367250:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149012992:0@lo:400:kworker.0 00000100:00100000:0.0:1789762803.367288:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762803.367306:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149013376 00000100:00100000:2.0:1789762803.367312:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789762803.367318:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149013376 00000100:00100000:0.0:1789762803.367319:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149013504:0@lo:400:kworker.0 00000100:00100000:2.0:1789762803.367334:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149012864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762803.367349:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762803.367400:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149012992 00000100:00100000:1.0:1789762803.367405:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149012992 00000100:00100000:0.0:1789762803.367407:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149012736 00000100:00100000:0.0:1789762803.367412:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149012736 00000100:00100000:2.0:1789762803.367454:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149012864:12345-0@lo:400:kworker.0 Request processed in 131us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762803.367463:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789762803.367479:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789762803.367479:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789762803.367482:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149013376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762803.367515:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149012736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789762803.367548:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762803.367598:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149012736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762803.367603:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789762803.367642:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789762803.367643:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149013504 00000100:00100000:0.0:1789762803.367651:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762803.367654:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149013376:12345-0@lo:400:kworker.0 Request processed in 181us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762803.367656:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149013504 00000100:00100000:2.0:1789762803.367664:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149012992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762803.367675:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789762803.367710:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149012736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762803.367711:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149013120 00000100:00100000:1.0:1789762803.367719:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149013120 00000100:00100000:2.0:1789762803.367729:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149012992:12345-0@lo:400:kworker.0 Request processed in 73us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762803.367735:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789762803.367748:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789762803.367753:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789762803.367762:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148df5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149013248:0@lo:400:kworker.0 00000100:00100000:2.0:1789762803.367784:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789762803.367786:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149013504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762803.367796:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149013120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762803.367807:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762803.367829:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149013376:0@lo:400:kworker.0 00000100:00100000:1.0:1789762803.367898:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149012864:0@lo:400:kworker.0 00000100:00100000:0.0:1789762803.367914:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149013248 00000100:00100000:0.0:1789762803.367919:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149013248 00000100:00100000:3.0:1789762803.367924:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149013504:12345-0@lo:400:kworker.0 Request processed in 156us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762803.367933:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789762803.367940:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149013120:12345-0@lo:400:kworker.0 Request processed in 144us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762803.367954:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789762803.367963:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789762803.367980:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149013248:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789762803.368015:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762803.368016:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149012992:0@lo:400:kworker.0 00000100:00080000:2.0:1789762803.368025:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789762803.368032:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762803.368044:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149013504:0@lo:400:kworker.0 00000100:00100000:3.0:1789762803.368046:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149013248:12345-0@lo:400:kworker.0 Request processed in 73us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762803.368055:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789762803.368128:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148df5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149013248:0@lo:400:kworker.0 00000100:00100000:1.0:1789762803.368141:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149013120:0@lo:400:kworker.0 00000100:00100000:2.0:1789762803.538422:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208011463724 time 208011572844 state 0x0 ref 1 00000100:00100000:2.0:1789762803.538462:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140678784:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762803.538534:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56f188 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762803.538552:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762803.538557:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762803.538563:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56f188 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762803.538580:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56f188 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.543525:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56f188 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.543562:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56f188 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.543574:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56f188 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.543582:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762803.543587:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56f188 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.543598:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56f188 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.543618:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56f188 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.543624:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d53f7907/0xd08452c77c56f188 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762803.543693:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140678784:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5249us (199855us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762803.543702:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:0.0:1789762803.543709:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208011463724 time 208011572844 state 0x2 ref 0 00000100:00100000:3.0:1789762803.545699:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762803.545737:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140678912 00000100:00100000:0.0:1789762803.545752:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140678912 00000100:00100000:0.0:1789762803.545788:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208011463724 time 208011572844 state 0x0 ref 1 00000100:00100000:0.0:1789762803.545798:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208211572844 time 208011572844 state 0x1 ref 1 00000100:00100000:2.0:1789762803.572290:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762803.572324:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762803.572376:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140679040 00000100:00100000:0.0:1789762803.572399:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140679040 00000100:00100000:3.0:1789762803.572430:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140679168 00000100:00100000:3.0:1789762803.572436:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140679168 00000100:00100000:0.0:1789762803.572459:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:0.0:1789762803.572471:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140679040:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762803.572501:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00080000:1.0:1789762803.572505:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762803.572513:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140679168:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762803.572543:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140679040:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 75us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762803.572551:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:3.0:1789762803.572557:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140679168:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 46us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762803.572564:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:3.0:1789762803.574473:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762803.574524:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140679296 00000100:00100000:0.0:1789762803.574529:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140679296 00000100:00100000:3.0:1789762803.574542:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762803.574576:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00080000:1.0:1789762803.574579:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762803.574586:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2341:x1876702140679296:12345-192.168.203.31@tcp:9:kworker.0 00000100:00100000:2.0:1789762803.574593:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140679424 00000100:00100000:2.0:1789762803.574599:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140679424 00000020:00000080:0.0:1789762803.574606:0:8803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd08452c77c56eaf1 00000100:00080000:0.0:1789762803.574615:0:8803:0:(import.c:65:import_set_state_nolock()) ffff95d148e77000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789762803.574645:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762803.574646:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000001:00000004:0.0:1789762803.574650:0:8803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967344 00000100:00080000:1.0:1789762803.574653:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762803.574658:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140679424:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762803.574699:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140679424:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 45us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762803.574705:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:0.0:1789762803.574877:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+2:2341:x1876702140679296:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 293us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762803.574883:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:0.0:1789762803.738492:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208211572844 time 208211648490 state 0x0 ref 1 00000100:00100000:0.0:1789762803.738527:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140678912:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762803.738565:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f18f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.738596:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762803.738600:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762803.738605:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f18f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.738616:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f18f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.741335:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f18f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.741346:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f18f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.741354:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f18f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.741360:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762803.741364:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f18f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.741370:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f18f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.741398:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f18f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.741415:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f18f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762803.741467:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140678912:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2960us (195770us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762803.741477:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:0.0:1789762803.741483:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208211572844 time 208211648490 state 0x2 ref 0 00000100:00100000:3.0:1789762803.743158:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762803.743200:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140679552 00000100:00100000:2.0:1789762803.743209:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140679552 00000100:00100000:2.0:1789762803.743242:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208211572844 time 208211648490 state 0x0 ref 1 00000100:00100000:2.0:1789762803.743251:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208411648490 time 208211648490 state 0x1 ref 1 00010000:00010000:1.0:1789762803.750895:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762803.879017:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149013632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762803.879077:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762803.879172:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149013632 00000100:00100000:3.0:1789762803.879181:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149013632 00000100:00100000:3.0:1789762803.879230:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789762803.879240:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149013632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762803.879285:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 439549952 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789762803.879344:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149013632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762803.879354:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789762803.879401:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149013632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762803.938598:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208411648490 time 208411753040 state 0x0 ref 1 00000100:00100000:0.0:1789762803.938627:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140679552:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762803.938668:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f196 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.938685:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762803.938690:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762803.938697:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f196 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.938713:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f196 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.941523:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f196 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.941545:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f196 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.941552:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f196 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.941557:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762803.941560:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f196 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.941567:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f196 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.941580:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f196 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762803.941585:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f196 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762803.941647:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140679552:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3032us (198489us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762803.941655:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:0.0:1789762803.941661:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208411648490 time 208411753040 state 0x2 ref 0 00000100:00100000:3.0:1789762803.943505:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762803.943549:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140679680 00000100:00100000:0.0:1789762803.943563:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140679680 00000100:00100000:0.0:1789762803.943595:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208411648490 time 208411753040 state 0x0 ref 1 00000100:00100000:0.0:1789762803.943607:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208611753040 time 208411753040 state 0x1 ref 1 00000100:00100000:2.0:1789762804.138711:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208611753040 time 208611867999 state 0x0 ref 1 00000100:00100000:2.0:1789762804.138752:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140679680:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762804.138791:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f19d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762804.138805:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762804.138808:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762804.138813:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f19d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762804.138823:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f19d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762804.141647:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f19d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762804.141661:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f19d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762804.141671:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f19d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762804.141680:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762804.141686:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f19d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762804.141697:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f19d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762804.141725:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f19d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762804.141736:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f19d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762804.141789:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140679680:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3046us (198284us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762804.141800:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:2.0:1789762804.141807:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208611753040 time 208611867999 state 0x2 ref 0 00000100:00100000:3.0:1789762804.143572:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762804.143628:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140679808 00000100:00100000:0.0:1789762804.143639:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140679808 00000100:00100000:0.0:1789762804.143674:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208611753040 time 208611867999 state 0x0 ref 1 00000100:00100000:0.0:1789762804.143683:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208811867999 time 208611867999 state 0x1 ref 1 00000100:00100000:0.0:1789762804.338768:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208811867999 time 208811924007 state 0x0 ref 1 00000100:00100000:0.0:1789762804.338797:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140679808:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762804.338857:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1a4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.338871:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762804.338875:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762804.338880:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.338891:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.341702:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.341713:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.341729:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.341735:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762804.341739:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.341746:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.341759:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.341772:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762804.341821:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140679808:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3037us (198249us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762804.341829:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:0.0:1789762804.341871:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208811867999 time 208811924007 state 0x2 ref 0 00000100:00100000:3.0:1789762804.343558:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762804.343599:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140679936 00000100:00100000:2.0:1789762804.343608:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140679936 00000100:00100000:2.0:1789762804.343642:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 208811867999 time 208811924007 state 0x0 ref 1 00000100:00100000:2.0:1789762804.343651:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209011924007 time 208811924007 state 0x1 ref 1 00000100:00100000:0.0:1789762804.538901:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209011924007 time 209012056934 state 0x0 ref 1 00000100:00100000:0.0:1789762804.538931:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140679936:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762804.538968:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.538995:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762804.539006:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762804.539011:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.539026:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.541632:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.541647:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.541655:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.541661:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762804.541664:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.541670:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.541685:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.541702:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762804.541754:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140679936:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2835us (198195us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762804.541761:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:0.0:1789762804.541766:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209011924007 time 209012056934 state 0x2 ref 0 00000100:00100000:1.0:1789762804.543677:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762804.543722:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140680064 00000100:00100000:2.0:1789762804.543730:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140680064 00000100:00100000:2.0:1789762804.543764:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209011924007 time 209012056934 state 0x0 ref 1 00000100:00100000:2.0:1789762804.543773:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209212056934 time 209012056934 state 0x1 ref 1 00000100:00100000:2.0:1789762804.738999:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209212056934 time 209212154520 state 0x0 ref 1 00000100:00100000:2.0:1789762804.739027:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140680064:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762804.739065:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f1b2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762804.739091:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762804.739095:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762804.739099:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f1b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762804.739111:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f1b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.741970:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f1b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.741982:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f1b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.741990:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f1b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.741995:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762804.741999:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f1b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.742006:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f1b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.742020:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f1b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.742032:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4d43cbd/0xd08452c77c56f1b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762804.742082:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140680064:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3068us (198407us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762804.742091:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:0.0:1789762804.742097:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209212056934 time 209212154520 state 0x2 ref 0 00000100:00100000:2.0:1789762804.743800:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762804.743851:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140680192 00000100:00100000:0.0:1789762804.743859:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140680192 00000100:00100000:0.0:1789762804.743890:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209212056934 time 209212154520 state 0x0 ref 1 00000100:00100000:0.0:1789762804.743898:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209412154520 time 209212154520 state 0x1 ref 1 00010000:00010000:1.0:1789762804.774925:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762804.939095:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209412154520 time 209412243855 state 0x0 ref 1 00000100:00100000:2.0:1789762804.939126:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140680192:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762804.939165:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56f1b9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762804.939180:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762804.939183:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762804.939188:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56f1b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762804.939198:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56f1b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.942019:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56f1b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.942031:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56f1b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.942039:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56f1b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.942044:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f4400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762804.942048:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56f1b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.942071:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56f1b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.942087:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56f1b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762804.942092:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045b791c2/0xd08452c77c56f1b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762804.942143:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140680192:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3030us (198345us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762804.942151:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:0.0:1789762804.942156:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209412154520 time 209412243855 state 0x2 ref 0 00000100:00100000:3.0:1789762804.943909:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762804.943943:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140680320 00000100:00100000:0.0:1789762804.943952:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140680320 00000100:00100000:0.0:1789762804.943990:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209412154520 time 209412243855 state 0x0 ref 1 00000100:00100000:0.0:1789762804.944001:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209612243855 time 209412243855 state 0x1 ref 1 00000100:00100000:0.0:1789762805.139160:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209612243855 time 209612316147 state 0x0 ref 1 00000100:00100000:0.0:1789762805.139200:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140680320:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762805.139238:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789762805.139239:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762805.139270:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762805.139273:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762805.139279:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.139290:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.141935:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.141945:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.141951:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.141957:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762805.141961:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.141968:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.141982:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.141998:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762805.142045:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140680320:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2868us (198136us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762805.142052:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:0.0:1789762805.142058:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209612243855 time 209612316147 state 0x2 ref 0 00000100:00100000:3.0:1789762805.143893:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762805.143938:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140680448 00000100:00100000:2.0:1789762805.143946:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140680448 00000100:00100000:2.0:1789762805.143980:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209612243855 time 209612316147 state 0x0 ref 1 00000100:00100000:2.0:1789762805.143993:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209812316147 time 209612316147 state 0x1 ref 1 00000100:00100000:0.0:1789762805.339308:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209812316147 time 209812463554 state 0x0 ref 1 00000100:00100000:0.0:1789762805.339336:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140680448:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762805.339387:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.339401:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762805.339405:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762805.339410:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.339422:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.342505:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.342537:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.342547:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.342555:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762805.342560:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.342571:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.342586:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.342595:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762805.342648:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140680448:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3325us (198756us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762805.342655:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:0.0:1789762805.342661:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209812316147 time 209812463554 state 0x2 ref 0 00000100:00100000:2.0:1789762805.344410:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762805.344447:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140680576 00000100:00100000:0.0:1789762805.344461:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140680576 00000100:00100000:0.0:1789762805.344491:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 209812316147 time 209812463554 state 0x0 ref 1 00000100:00100000:0.0:1789762805.344500:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210012463554 time 209812463554 state 0x1 ref 1 00000100:00100000:2.0:1789762805.539424:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210012463554 time 210012580265 state 0x0 ref 1 00000100:00100000:2.0:1789762805.539448:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140680576:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762805.539486:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f1ce lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762805.539500:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762805.539503:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762805.539508:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f1ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762805.539520:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f1ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.542814:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f1ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.542825:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f1ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.542862:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f1ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.542873:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762805.542879:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f1ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.542890:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f1ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.542908:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f1ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.542914:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c56f1ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762805.542968:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140680576:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3529us (198557us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762805.542991:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:0.0:1789762805.542998:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210012463554 time 210012580265 state 0x2 ref 0 00000100:00100000:1.0:1789762805.545382:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762805.545427:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140680704 00000100:00100000:0.0:1789762805.545437:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140680704 00000100:00100000:0.0:1789762805.545471:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210012463554 time 210012580265 state 0x0 ref 1 00000100:00100000:0.0:1789762805.545480:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210212580265 time 210012580265 state 0x1 ref 1 00000100:00100000:0.0:1789762805.739494:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210212580265 time 210212650327 state 0x0 ref 1 00000100:00100000:0.0:1789762805.739526:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140680704:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762805.739564:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1d5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.739579:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762805.739582:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762805.739587:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.739598:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.742521:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.742538:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.742574:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.742580:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762805.742584:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.742590:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.742603:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.742609:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762805.742661:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140680704:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3146us (197292us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762805.742668:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:0.0:1789762805.742674:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210212580265 time 210212650327 state 0x2 ref 0 00000100:00100000:3.0:1789762805.744780:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762805.744872:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140680832 00000100:00100000:2.0:1789762805.744880:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140680832 00000100:00100000:2.0:1789762805.744913:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210212580265 time 210212650327 state 0x0 ref 1 00000100:00100000:2.0:1789762805.744922:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210412650327 time 210212650327 state 0x1 ref 1 00010000:00010000:3.0:1789762805.799000:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762805.939630:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210412650327 time 210412783420 state 0x0 ref 1 00000100:00100000:0.0:1789762805.939664:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140680832:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762805.939710:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1dc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.939742:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762805.939746:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762805.939751:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.939769:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.942637:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.942649:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.942656:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.942662:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762805.942665:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.942672:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.942686:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762805.942702:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762805.942752:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140680832:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3103us (197973us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762805.942760:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:0.0:1789762805.942767:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210412650327 time 210412783420 state 0x2 ref 0 00000100:00100000:2.0:1789762805.944931:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762805.944973:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140680960 00000100:00100000:3.0:1789762805.944981:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140680960 00000100:00100000:3.0:1789762805.945020:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210412650327 time 210412783420 state 0x0 ref 1 00000100:00100000:3.0:1789762805.945030:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210612783420 time 210412783420 state 0x1 ref 1 00000100:00100000:2.0:1789762806.139735:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210612783420 time 210612890690 state 0x0 ref 1 00000100:00100000:2.0:1789762806.139772:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140680960:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762806.139827:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c56f1e3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762806.139870:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762806.139874:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762806.139879:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c56f1e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762806.139891:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c56f1e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.143058:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c56f1e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.143074:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c56f1e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.143085:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c56f1e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.143094:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762806.143100:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c56f1e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.143111:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c56f1e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.143130:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c56f1e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.143149:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c56f1e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762806.143209:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140680960:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3448us (198277us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762806.143221:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:0.0:1789762806.143228:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210612783420 time 210612890690 state 0x2 ref 0 00000100:00100000:1.0:1789762806.146035:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762806.146074:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140681088 00000100:00100000:0.0:1789762806.146085:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140681088 00000100:00100000:0.0:1789762806.146124:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210612783420 time 210612890690 state 0x0 ref 1 00000100:00100000:0.0:1789762806.146135:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210812890690 time 210612890690 state 0x1 ref 1 00000100:00100000:3.0:1789762806.339896:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210812890690 time 210813052315 state 0x0 ref 1 00000100:00100000:3.0:1789762806.339926:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140681088:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762806.339964:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f1ea lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762806.339978:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762806.339981:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762806.339986:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f1ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762806.340014:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f1ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762806.342826:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f1ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762806.342877:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f1ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762806.342888:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f1ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762806.342898:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762806.342903:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f1ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762806.342914:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f1ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762806.342933:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f1ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762806.342943:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f1ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762806.343022:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140681088:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3109us (196990us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762806.343033:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:3.0:1789762806.343041:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210812890690 time 210813052315 state 0x2 ref 0 00000100:00100000:3.0:1789762806.345280:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762806.345331:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140681216 00000100:00100000:0.0:1789762806.345339:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140681216 00000100:00100000:0.0:1789762806.345387:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 210812890690 time 210813052315 state 0x0 ref 1 00000100:00100000:0.0:1789762806.345400:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211013052315 time 210813052315 state 0x1 ref 1 00000100:00100000:0.0:1789762806.539969:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211013052315 time 211013125662 state 0x0 ref 1 00000100:00100000:0.0:1789762806.539998:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140681216:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762806.540044:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.540057:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762806.540073:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762806.540078:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.540090:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.542516:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.542527:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.542534:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.542539:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762806.542542:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.542549:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.542561:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.542566:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762806.542623:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140681216:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2638us (197345us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762806.542631:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:0.0:1789762806.542636:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211013052315 time 211013125662 state 0x2 ref 0 00000100:00100000:2.0:1789762806.544693:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762806.544739:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140681344 00000100:00100000:0.0:1789762806.544747:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140681344 00000100:00100000:0.0:1789762806.544785:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211013052315 time 211013125662 state 0x0 ref 1 00000100:00100000:0.0:1789762806.544793:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211213125662 time 211013125662 state 0x1 ref 1 00000100:00100000:0.0:1789762806.740047:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211213125662 time 211213202919 state 0x0 ref 1 00000100:00100000:0.0:1789762806.740074:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140681344:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762806.740109:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.740123:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762806.740127:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762806.740131:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.740142:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.743086:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.743102:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.743109:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.743121:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762806.743125:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.743132:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.743147:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.743153:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762806.743200:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140681344:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3137us (198506us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762806.743208:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:0.0:1789762806.743213:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211213125662 time 211213202919 state 0x2 ref 0 00000100:00100000:1.0:1789762806.745191:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762806.745253:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140681472 00000100:00100000:2.0:1789762806.745262:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140681472 00000100:00100000:2.0:1789762806.745302:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211213125662 time 211213202919 state 0x0 ref 1 00000100:00100000:2.0:1789762806.745314:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211413202919 time 211213202919 state 0x1 ref 1 00010000:00010000:1.0:1789762806.822926:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762806.940176:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211413202919 time 211413332127 state 0x0 ref 1 00000100:00100000:0.0:1789762806.940218:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140681472:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762806.940254:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ff lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.940268:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762806.940272:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762806.940276:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.940288:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.942994:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.943009:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.943020:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.943028:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762806.943034:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.943043:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.943069:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762806.943078:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f1ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762806.943137:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140681472:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2928us (197946us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762806.943147:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:0.0:1789762806.943154:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211413202919 time 211413332127 state 0x2 ref 0 00000100:00100000:3.0:1789762806.944951:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762806.944994:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140681600 00000100:00100000:0.0:1789762806.945004:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140681600 00000100:00100000:0.0:1789762806.945040:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211413202919 time 211413332127 state 0x0 ref 1 00000100:00100000:0.0:1789762806.945051:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211613332127 time 211413332127 state 0x1 ref 1 00000100:00100000:2.0:1789762807.140278:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211613332127 time 211613433400 state 0x0 ref 1 00000100:00100000:2.0:1789762807.140319:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140681600:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762807.140364:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f5fc55c2/0xd08452c77c56f206 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.140380:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762807.140383:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762807.140389:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5fc55c2/0xd08452c77c56f206 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789762807.140393:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762807.140418:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5fc55c2/0xd08452c77c56f206 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.143052:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f5fc55c2/0xd08452c77c56f206 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.143063:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5fc55c2/0xd08452c77c56f206 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.143071:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5fc55c2/0xd08452c77c56f206 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.143076:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d150474a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762807.143080:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5fc55c2/0xd08452c77c56f206 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.143087:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5fc55c2/0xd08452c77c56f206 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.143101:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5fc55c2/0xd08452c77c56f206 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.143107:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5fc55c2/0xd08452c77c56f206 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762807.143172:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140681600:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2878us (198220us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762807.143180:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:2.0:1789762807.143186:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211613332127 time 211613433400 state 0x2 ref 0 00000100:00100000:2.0:1789762807.144920:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762807.144967:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140681728 00000100:00100000:0.0:1789762807.144975:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140681728 00000100:00100000:0.0:1789762807.145008:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211613332127 time 211613433400 state 0x0 ref 1 00000100:00100000:0.0:1789762807.145018:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211813433400 time 211613433400 state 0x1 ref 1 00000100:00100000:0.0:1789762807.340365:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211813433400 time 211813511289 state 0x0 ref 1 00000100:00100000:0.0:1789762807.340396:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140681728:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762807.340433:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f20d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.340459:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762807.340462:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762807.340467:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f20d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.340478:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f20d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.343249:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f20d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.343259:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f20d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.343265:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f20d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.343270:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762807.343273:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f20d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.343279:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f20d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.343292:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f20d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.343308:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f20d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762807.343353:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140681728:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2971us (198434us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762807.343377:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:0.0:1789762807.343382:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211813433400 time 211813511289 state 0x2 ref 0 00000100:00100000:2.0:1789762807.345425:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762807.345461:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140681856 00000100:00100000:0.0:1789762807.345469:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140681856 00000100:00100000:0.0:1789762807.345497:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 211813433400 time 211813511289 state 0x0 ref 1 00000100:00100000:0.0:1789762807.345506:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212013511289 time 211813511289 state 0x1 ref 1 00000100:00100000:0.0:1789762807.540440:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212013511289 time 212013593112 state 0x0 ref 1 00000100:00100000:0.0:1789762807.540471:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140681856:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762807.540526:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f214 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.540543:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762807.540548:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762807.540555:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f214 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.540572:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f214 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.543641:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f214 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.543658:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f214 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.543668:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.543675:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762807.543680:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.543690:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f214 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.543708:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f214 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.543717:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f214 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762807.543778:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140681856:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3318us (198351us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762807.543789:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:0.0:1789762807.543805:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212013511289 time 212013593112 state 0x2 ref 0 00000100:00100000:3.0:1789762807.545555:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762807.545601:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140681984 00000100:00100000:2.0:1789762807.545609:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140681984 00000100:00100000:2.0:1789762807.545643:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212013511289 time 212013593112 state 0x0 ref 1 00000100:00100000:2.0:1789762807.545653:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212213593112 time 212013593112 state 0x1 ref 1 00000100:00100000:0.0:1789762807.740561:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212213593112 time 212213715575 state 0x0 ref 1 00000100:00100000:0.0:1789762807.740593:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140681984:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762807.740632:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f21b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.740648:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762807.740653:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762807.740659:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f21b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.740673:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f21b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.743279:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f21b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.743292:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f21b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.743301:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f21b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.743308:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762807.743313:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f21b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.743334:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f21b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.743363:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f21b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762807.743373:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f21b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762807.743428:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140681984:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2850us (197876us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762807.743438:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:0.0:1789762807.743445:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212213593112 time 212213715575 state 0x2 ref 0 00000100:00100000:1.0:1789762807.745316:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762807.745372:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140682112 00000100:00100000:2.0:1789762807.745380:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140682112 00000100:00100000:2.0:1789762807.745409:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212213593112 time 212213715575 state 0x0 ref 1 00000100:00100000:2.0:1789762807.745418:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212413715575 time 212213715575 state 0x1 ref 1 00010000:00010000:1.0:1789762807.846988:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762807.940645:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212413715575 time 212413801180 state 0x0 ref 1 00000100:00100000:2.0:1789762807.940672:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140682112:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762807.940710:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f222 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.940723:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762807.940727:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762807.940743:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f222 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.940754:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f222 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.943496:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f222 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.943506:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f222 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.943513:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f222 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.943518:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762807.943522:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f222 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.943528:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f222 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.943544:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f222 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762807.943550:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f222 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762807.943605:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140682112:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2945us (198289us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762807.943613:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:2.0:1789762807.943618:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212413715575 time 212413801180 state 0x2 ref 0 00000100:00100000:2.0:1789762807.945323:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762807.945399:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140682240 00000100:00100000:0.0:1789762807.945408:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140682240 00000100:00100000:0.0:1789762807.945445:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212413715575 time 212413801180 state 0x0 ref 1 00000100:00100000:0.0:1789762807.945456:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212613801180 time 212413801180 state 0x1 ref 1 00000100:00100000:2.0:1789762808.140750:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212613801180 time 212613903030 state 0x0 ref 1 00000100:00100000:2.0:1789762808.140784:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140682240:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762808.140858:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f229 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.140877:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762808.140882:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762808.140889:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f229 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.140901:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f229 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.143585:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f229 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.143598:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f229 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.143607:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f229 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.143625:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762808.143630:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f229 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.143641:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f229 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.143658:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f229 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.143666:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c56f229 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762808.143725:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140682240:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2955us (198401us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762808.143736:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 170 00000100:00100000:0.0:1789762808.143743:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212613801180 time 212613903030 state 0x2 ref 0 00000100:00100000:3.0:1789762808.145523:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762808.145569:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140682368 00000100:00100000:0.0:1789762808.145578:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140682368 00000100:00100000:0.0:1789762808.145613:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212613801180 time 212613903030 state 0x0 ref 1 00000100:00100000:0.0:1789762808.145624:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212813903030 time 212613903030 state 0x1 ref 1 00000100:00100000:2.0:1789762808.340908:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212813903030 time 212814064659 state 0x0 ref 1 00000100:00100000:2.0:1789762808.340937:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140682368:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762808.340975:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f230 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.341004:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762808.341007:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762808.341012:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f230 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.341023:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f230 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.343623:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f230 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.343635:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f230 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.343643:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f230 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.343649:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762808.343653:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f230 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.343659:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f230 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.343672:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f230 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.343690:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f230 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762808.343740:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140682368:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2817us (198219us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762808.343747:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:2.0:1789762808.343753:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212813903030 time 212814064659 state 0x2 ref 0 00000100:00100000:1.0:1789762808.345604:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762808.345662:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140682496 00000100:00100000:0.0:1789762808.345671:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140682496 00000100:00100000:0.0:1789762808.345710:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 212813903030 time 212814064659 state 0x0 ref 1 00000100:00100000:0.0:1789762808.345729:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213014064659 time 212814064659 state 0x1 ref 1 00000100:00100000:1.0:1789762808.487021:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149013888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762808.487021:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149013760:0@lo:400:kworker.0 00000100:00100000:0.0:1789762808.487055:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149014144:0@lo:400:kworker.0 00000100:00100000:2.0:1789762808.487110:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762808.487113:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762808.487114:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762808.487190:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17410b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149014400:0@lo:400:kworker.0 00000100:00100000:2.0:1789762808.487190:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149014272:0@lo:400:kworker.0 00000100:00100000:0.0:1789762808.487225:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149014016:0@lo:400:kworker.0 00000100:00100000:2.0:1789762808.487235:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762808.487241:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762808.487267:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762808.487296:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149014528:0@lo:400:kworker.0 00000100:00100000:2.0:1789762808.487296:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149014272 00000100:00100000:2.0:1789762808.487306:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149014272 00000100:00100000:3.0:1789762808.487325:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149014144 00000100:00100000:3.0:1789762808.487332:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149014144 00000100:00100000:0.0:1789762808.487333:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762808.487336:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149014400 00000100:00100000:1.0:1789762808.487341:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149014400 00000100:00100000:3.0:1789762808.487389:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149014016 00000100:00100000:3.0:1789762808.487394:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149014016 00000100:00100000:0.0:1789762808.487397:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149013888 00000100:00100000:2.0:1789762808.487398:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149014528 00000100:00100000:1.0:1789762808.487404:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789762808.487405:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149013888 00000100:00100000:2.0:1789762808.487407:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149014528 00000100:00100000:1.0:1789762808.487416:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149014144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762808.487426:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789762808.487438:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149014400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762808.487456:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789762808.487472:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789762808.487472:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149014272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762808.487478:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149014144:12345-0@lo:400:kworker.0 Request processed in 62us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762808.487487:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789762808.487493:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149013888:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762808.487494:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149014400:12345-0@lo:400:kworker.0 Request processed in 60us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762808.487506:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789762808.487515:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789762808.487526:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149014016:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789762808.487530:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762808.487531:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149014272:12345-0@lo:400:kworker.0 Request processed in 65us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762808.487542:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789762808.487563:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789762808.487571:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149014528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762808.487577:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149014016:12345-0@lo:400:kworker.0 Request processed in 54us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762808.487584:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789762808.487593:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149013888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762808.487603:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1789762808.487606:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762808.487611:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149014528:12345-0@lo:400:kworker.0 Request processed in 41us (279us total) trans 0 rc 0/0 00000100:00080000:1.0:1789762808.487612:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762808.487617:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762808.487633:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789762808.487669:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149013760 00000100:00100000:2.0:1789762808.487672:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149013760 00000100:00100000:0.0:1789762808.487681:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149014144:0@lo:400:kworker.0 00000100:00100000:2.0:1789762808.487708:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789762808.487717:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149013760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762808.487739:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17410b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149014400:0@lo:400:kworker.0 00000100:00100000:0.0:1789762808.487769:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149013888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762808.487771:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149013760:12345-0@lo:400:kworker.0 Request processed in 56us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762808.487784:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789762808.487825:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149014016:0@lo:400:kworker.0 00000100:00100000:2.0:1789762808.487873:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149014272:0@lo:400:kworker.0 00000100:00100000:0.0:1789762808.487877:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149014528:0@lo:400:kworker.0 00000100:00100000:2.0:1789762808.487900:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149013760:0@lo:400:kworker.0 00000001:00100000:0.0:1789762808.496168:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:0.0:1789762808.496173:0:7606:0:(genops.c:885:class_export_put()) final put ffff95d148e74000/77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:1.0:1789762808.496207:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d148e74000/77777931-b235-4c03-82d2-4b1d12553008 for lustre-OST0001 00000020:00000080:1.0:1789762808.496244:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d148e77000 for lustre-OST0001 00000100:00100000:0.0:1789762808.540978:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213014064659 time 213014134795 state 0x0 ref 1 00000100:00100000:0.0:1789762808.541003:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140682496:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762808.541041:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f237 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.541055:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762808.541058:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762808.541062:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.541075:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.543534:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.543545:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f237 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.543552:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f237 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.543558:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762808.543561:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f237 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.543583:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f237 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.543597:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f237 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.543603:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f237 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762808.543649:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140682496:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2657us (198046us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762808.543656:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:0.0:1789762808.543662:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213014064659 time 213014134795 state 0x2 ref 0 00000100:00100000:1.0:1789762808.545432:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762808.545480:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140682624 00000100:00100000:2.0:1789762808.545490:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140682624 00000100:00100000:2.0:1789762808.545526:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213014064659 time 213014134795 state 0x0 ref 1 00000100:00100000:2.0:1789762808.545536:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213214134795 time 213014134795 state 0x1 ref 1 00000100:00100000:3.0:1789762808.692272:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762808.692308:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762808.692328:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762808.692378:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140682752 00000100:00100000:0.0:1789762808.692379:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140682880 00000100:00100000:1.0:1789762808.692386:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140683008 00000100:00100000:0.0:1789762808.692389:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140682880 00000100:00100000:2.0:1789762808.692389:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140682752 00000100:00100000:1.0:1789762808.692393:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140683008 00000100:00100000:2.0:1789762808.692443:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 255 00000100:00080000:3.0:1789762808.692450:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762808.692460:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140682752:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762808.692461:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:1.0:1789762808.692473:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:0.0:1789762808.692476:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140682880:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762808.692498:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140683008:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762808.692527:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140682752:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762808.692536:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140682880:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 60us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762808.692537:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140683008:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 41us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762808.692537:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 255 00000100:00100000:1.0:1789762808.692555:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:0.0:1789762808.692565:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:0.0:1789762808.741088:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213214134795 time 213214243672 state 0x0 ref 1 00000100:00100000:0.0:1789762808.741115:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140682624:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762808.741161:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f23e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.741187:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762808.741191:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762808.741196:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f23e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.741207:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f23e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.743881:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f23e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.743893:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f23e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.743902:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f23e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.743911:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762808.743916:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f23e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.743928:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f23e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.743948:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f23e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762808.743964:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f23e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762808.744014:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140682624:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2910us (198582us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762808.744029:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:0.0:1789762808.744035:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213214134795 time 213214243672 state 0x2 ref 0 00000100:00100000:3.0:1789762808.745885:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762808.745925:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140683136 00000100:00100000:2.0:1789762808.745934:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140683136 00000100:00100000:2.0:1789762808.745966:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213214134795 time 213214243672 state 0x0 ref 1 00000100:00100000:2.0:1789762808.745982:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213414243672 time 213214243672 state 0x1 ref 1 00010000:00010000:1.0:1789762808.870948:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762808.941156:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213414243672 time 213414311909 state 0x0 ref 1 00000100:00100000:2.0:1789762808.941183:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140683136:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762808.941220:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f245 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.941234:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762808.941237:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762808.941242:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f245 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.941253:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f245 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.944269:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f245 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.944286:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f245 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.944294:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.944300:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762808.944304:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.944321:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f245 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.944335:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f245 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762808.944340:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f245 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762808.944403:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140683136:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3230us (198518us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762808.944411:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:2.0:1789762808.944417:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213414243672 time 213414311909 state 0x2 ref 0 00000100:00100000:1.0:1789762808.946456:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762808.946506:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140683264 00000100:00100000:0.0:1789762808.946513:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140683264 00000100:00100000:0.0:1789762808.946545:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213414243672 time 213414311909 state 0x0 ref 1 00000100:00100000:0.0:1789762808.946554:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213614311909 time 213414311909 state 0x1 ref 1 00000100:00100000:2.0:1789762808.998985:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789762808.999008:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149014656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762808.999066:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762808.999106:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149014656 00000100:00100000:3.0:1789762808.999115:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149014656 00000100:00100000:3.0:1789762808.999157:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789762808.999166:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149014656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762808.999210:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 439549952 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789762808.999252:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149014656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762808.999258:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789762808.999291:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149014656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762809.141288:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213614311909 time 213614441130 state 0x0 ref 1 00000100:00100000:2.0:1789762809.141335:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140683264:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:3.0:1789762809.141383:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762809.141390:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f24c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.141405:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762809.141421:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762809.141426:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f24c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.141437:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f24c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.144222:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f24c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.144233:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f24c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.144240:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f24c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.144245:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762809.144249:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f24c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.144255:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f24c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.144269:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f24c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.144274:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c56f24c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762809.144331:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140683264:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3025us (197876us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762809.144340:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:2.0:1789762809.144356:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213614311909 time 213614441130 state 0x2 ref 0 00000100:00100000:3.0:1789762809.146079:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762809.146123:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140683392 00000100:00100000:0.0:1789762809.146131:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140683392 00000100:00100000:0.0:1789762809.146165:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213614311909 time 213614441130 state 0x0 ref 1 00000100:00100000:0.0:1789762809.146175:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213814441130 time 213614441130 state 0x1 ref 1 00000100:00100000:0.0:1789762809.341370:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213814441130 time 213814526284 state 0x0 ref 1 00000100:00100000:0.0:1789762809.341399:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140683392:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762809.341436:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f253 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.341450:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762809.341465:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762809.341471:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f253 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.341483:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f253 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.344296:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f253 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.344309:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f253 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.344316:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.344322:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762809.344327:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.344334:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f253 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.344358:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f253 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.344364:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f253 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762809.344417:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140683392:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3030us (198338us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762809.344425:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:0.0:1789762809.344430:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213814441130 time 213814526284 state 0x2 ref 0 00000100:00100000:3.0:1789762809.346237:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762809.346306:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140683520 00000100:00100000:0.0:1789762809.346314:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140683520 00000100:00100000:0.0:1789762809.346360:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 213814441130 time 213814526284 state 0x0 ref 1 00000100:00100000:0.0:1789762809.346370:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214014526284 time 213814526284 state 0x1 ref 1 00000100:00100000:0.0:1789762809.541434:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214014526284 time 214014592339 state 0x0 ref 1 00000100:00100000:0.0:1789762809.541457:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140683520:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762809.541493:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f25a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.541507:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762809.541511:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762809.541516:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f25a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.541528:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f25a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.544351:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f25a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.544372:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f25a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.544379:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f25a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.544385:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762809.544389:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f25a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.544396:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f25a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.544410:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f25a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.544415:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f25a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762809.544460:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140683520:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3012us (198224us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762809.544468:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:0.0:1789762809.544473:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214014526284 time 214014592339 state 0x2 ref 0 00000100:00100000:3.0:1789762809.546326:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762809.546376:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140683648 00000100:00100000:2.0:1789762809.546384:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140683648 00000100:00100000:2.0:1789762809.546415:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214014526284 time 214014592339 state 0x0 ref 1 00000100:00100000:2.0:1789762809.546423:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214214592339 time 214014592339 state 0x1 ref 1 00000100:00100000:0.0:1789762809.741585:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214214592339 time 214214739164 state 0x0 ref 1 00000100:00100000:0.0:1789762809.741631:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140683648:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762809.741675:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f261 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.741694:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762809.741699:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762809.741705:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f261 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.741721:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f261 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.744580:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f261 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.744594:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f261 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.744602:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.744608:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762809.744612:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.744619:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f261 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.744643:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f261 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762809.744649:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f261 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762809.744699:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140683648:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3079us (198372us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762809.744707:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:0.0:1789762809.744713:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214214592339 time 214214739164 state 0x2 ref 0 00000100:00100000:3.0:1789762809.746450:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762809.746505:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140683776 00000100:00100000:2.0:1789762809.746515:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140683776 00000100:00100000:2.0:1789762809.746554:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214214592339 time 214214739164 state 0x0 ref 1 00000100:00100000:2.0:1789762809.746567:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214414739164 time 214214739164 state 0x1 ref 1 00010000:00010000:3.0:1789762809.895061:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762809.941665:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214414739164 time 214414820439 state 0x0 ref 1 00000100:00100000:2.0:1789762809.941694:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140683776:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762809.941733:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f268 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.941748:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762809.941751:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762809.941756:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f268 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.941783:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f268 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.944859:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f268 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.944874:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f268 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.944884:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f268 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.944892:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762809.944897:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f268 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.944908:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f268 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.944927:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f268 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762809.944932:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f268 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762809.944996:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140683776:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3315us (198547us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762809.945004:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:2.0:1789762809.945010:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214414739164 time 214414820439 state 0x2 ref 0 00000100:00100000:3.0:1789762809.946806:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762809.946865:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140683904 00000100:00100000:0.0:1789762809.946873:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140683904 00000100:00100000:0.0:1789762809.946905:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214414739164 time 214414820439 state 0x0 ref 1 00000100:00100000:0.0:1789762809.946914:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214614820439 time 214414820439 state 0x1 ref 1 00000100:00100000:2.0:1789762810.141788:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214614820439 time 214614940000 state 0x0 ref 1 00000100:00100000:2.0:1789762810.141820:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140683904:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762810.141885:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f26f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.141899:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762810.141903:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762810.141914:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.141926:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.144884:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.144911:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f26f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.144936:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.144944:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747f5600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762810.144950:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.144961:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f26f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.144980:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f26f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.144989:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baf0f257/0xd08452c77c56f26f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762810.145053:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140683904:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3243us (198246us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762810.145065:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:2.0:1789762810.145073:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214614820439 time 214614940000 state 0x2 ref 0 00000100:00100000:3.0:1789762810.146982:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762810.147038:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140684032 00000100:00100000:0.0:1789762810.147047:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140684032 00000100:00100000:0.0:1789762810.147085:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214614820439 time 214614940000 state 0x0 ref 1 00000100:00100000:0.0:1789762810.147098:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214814940000 time 214614940000 state 0x1 ref 1 00000100:00100000:0.0:1789762810.341944:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214814940000 time 214815099404 state 0x0 ref 1 00000100:00100000:0.0:1789762810.341970:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140684032:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762810.342020:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f276 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.342051:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762810.342056:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762810.342063:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f276 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.342079:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f276 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.344664:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f276 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.344686:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f276 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.344694:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f276 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.344699:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762810.344703:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f276 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.344710:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f276 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.344724:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f276 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.344740:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f276 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762810.344792:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140684032:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2832us (197809us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762810.344800:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:0.0:1789762810.344805:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214814940000 time 214815099404 state 0x2 ref 0 00000100:00100000:3.0:1789762810.346476:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762810.346510:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140684160 00000100:00100000:0.0:1789762810.346518:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140684160 00000100:00100000:0.0:1789762810.346550:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 214814940000 time 214815099404 state 0x0 ref 1 00000100:00100000:0.0:1789762810.346559:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215015099404 time 214815099404 state 0x1 ref 1 00000100:00100000:0.0:1789762810.542014:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215015099404 time 215015169630 state 0x0 ref 1 00000100:00100000:0.0:1789762810.542042:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140684160:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762810.542078:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f27d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.542092:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762810.542096:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762810.542100:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f27d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.542112:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f27d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.544884:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f27d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.544893:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f27d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.544900:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f27d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.544905:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762810.544909:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f27d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.544915:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f27d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.544930:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f27d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.544936:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f27d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762810.544983:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140684160:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2953us (198506us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762810.544992:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:0.0:1789762810.545006:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215015099404 time 215015169630 state 0x2 ref 0 00000100:00100000:3.0:1789762810.546687:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762810.546728:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140684288 00000100:00100000:2.0:1789762810.546736:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140684288 00000100:00100000:2.0:1789762810.546777:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215015099404 time 215015169630 state 0x0 ref 1 00000100:00100000:2.0:1789762810.546785:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215215169630 time 215015169630 state 0x1 ref 1 00000100:00100000:0.0:1789762810.742100:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215215169630 time 215215255145 state 0x0 ref 1 00000100:00100000:0.0:1789762810.742129:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140684288:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762810.742167:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f284 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.742185:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762810.742190:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762810.742196:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f284 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.742213:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f284 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.745160:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f284 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.745170:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f284 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.745177:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f284 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.745182:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762810.745186:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f284 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.745200:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f284 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.745215:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f284 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.745220:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f284 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762810.745267:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140684288:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3151us (198582us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762810.745275:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:0.0:1789762810.745281:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215215169630 time 215215255145 state 0x2 ref 0 00000100:00100000:2.0:1789762810.747016:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762810.747058:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140684416 00000100:00100000:0.0:1789762810.747068:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140684416 00000100:00100000:0.0:1789762810.747104:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215215169630 time 215215255145 state 0x0 ref 1 00000100:00100000:0.0:1789762810.747117:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215415255145 time 215215255145 state 0x1 ref 1 00010000:00010000:1.0:1789762810.918951:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762810.942190:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215415255145 time 215415346635 state 0x0 ref 1 00000100:00100000:2.0:1789762810.942224:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140684416:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762810.942267:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019013c0f/0xd08452c77c56f28b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.942285:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762810.942290:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762810.942297:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019013c0f/0xd08452c77c56f28b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.942311:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019013c0f/0xd08452c77c56f28b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.945311:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019013c0f/0xd08452c77c56f28b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.945337:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019013c0f/0xd08452c77c56f28b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.945349:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019013c0f/0xd08452c77c56f28b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.945375:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d173d3a800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762810.945381:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019013c0f/0xd08452c77c56f28b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.945389:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019013c0f/0xd08452c77c56f28b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.945402:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019013c0f/0xd08452c77c56f28b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.945407:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019013c0f/0xd08452c77c56f28b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762810.945456:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140684416:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3247us (198440us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762810.945463:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:0.0:1789762810.945469:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215415255145 time 215415346635 state 0x2 ref 0 00000100:00100000:1.0:1789762810.947516:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762810.947560:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140684544 00000100:00100000:0.0:1789762810.947568:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140684544 00000100:00100000:0.0:1789762810.947599:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215415255145 time 215415346635 state 0x0 ref 1 00000100:00100000:0.0:1789762810.947608:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215615346635 time 215415346635 state 0x1 ref 1 00000100:00100000:0.0:1789762811.142279:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215615346635 time 215615433069 state 0x0 ref 1 00000100:00100000:0.0:1789762811.142350:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140684544:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:3.0:1789762811.142394:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762811.142407:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f292 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.142422:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762811.142426:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762811.142431:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f292 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.142443:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f292 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.145236:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f292 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.145247:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f292 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.145255:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f292 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.145262:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762811.145266:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f292 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.145273:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f292 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.145299:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f292 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.145305:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f292 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762811.145367:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140684544:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3068us (197851us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762811.145373:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:0.0:1789762811.145379:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215615346635 time 215615433069 state 0x2 ref 0 00000100:00100000:3.0:1789762811.147203:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762811.147276:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140684672 00000100:00100000:2.0:1789762811.147284:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140684672 00000100:00100000:2.0:1789762811.147317:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215615346635 time 215615433069 state 0x0 ref 1 00000100:00100000:2.0:1789762811.147341:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215815433069 time 215615433069 state 0x1 ref 1 00000100:00100000:0.0:1789762811.342440:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215815433069 time 215815595554 state 0x0 ref 1 00000100:00100000:0.0:1789762811.342468:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140684672:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762811.342505:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f299 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.342519:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762811.342522:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762811.342527:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f299 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.342539:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f299 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.345514:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f299 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.345523:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f299 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.345529:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.345534:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762811.345538:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.345544:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f299 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.345556:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f299 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.345561:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f299 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762811.345608:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140684672:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3153us (198407us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762811.345614:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:0.0:1789762811.345625:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215815433069 time 215815595554 state 0x2 ref 0 00000100:00100000:3.0:1789762811.347556:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762811.347589:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140684800 00000100:00100000:0.0:1789762811.347597:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140684800 00000100:00100000:0.0:1789762811.347626:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 215815433069 time 215815595554 state 0x0 ref 1 00000100:00100000:0.0:1789762811.347634:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216015595554 time 215815595554 state 0x1 ref 1 00000100:00100000:2.0:1789762811.542550:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216015595554 time 216015704545 state 0x0 ref 1 00000100:00100000:2.0:1789762811.542579:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140684800:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762811.542617:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2a0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762811.542647:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762811.542650:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762811.542655:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762811.542668:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762811.545603:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762811.545617:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762811.545627:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762811.545634:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d151b44400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762811.545640:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762811.545649:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762811.545666:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762811.545688:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762811.545739:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140684800:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3173us (198184us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762811.545750:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:2.0:1789762811.545756:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216015595554 time 216015704545 state 0x2 ref 0 00000100:00100000:1.0:1789762811.548066:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762811.548116:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140684928 00000100:00100000:0.0:1789762811.548124:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140684928 00000100:00100000:0.0:1789762811.548156:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216015595554 time 216015704545 state 0x0 ref 1 00000100:00100000:0.0:1789762811.548165:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216215704545 time 216015704545 state 0x1 ref 1 00000100:00100000:0.0:1789762811.742628:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216215704545 time 216215773172 state 0x0 ref 1 00000100:00100000:0.0:1789762811.742659:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140684928:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762811.742702:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2a7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.742721:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762811.742726:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762811.742732:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.742743:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.746198:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.746223:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.746230:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.746235:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762811.746239:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.746245:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.746257:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.746262:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762811.746311:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140684928:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3668us (198245us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762811.746319:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:0.0:1789762811.746336:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216215704545 time 216215773172 state 0x2 ref 0 00000100:00100000:3.0:1789762811.748416:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762811.748462:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140685056 00000100:00100000:2.0:1789762811.748471:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140685056 00000100:00100000:2.0:1789762811.748502:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216215704545 time 216215773172 state 0x0 ref 1 00000100:00100000:2.0:1789762811.748510:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216415773172 time 216215773172 state 0x1 ref 1 00000100:00100000:0.0:1789762811.942725:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216415773172 time 216415878615 state 0x0 ref 1 00000100:00100000:0.0:1789762811.942785:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140685056:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762811.942828:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2ae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.942874:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762811.942879:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762811.942887:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.942903:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762811.942969:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762811.946315:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.946341:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.946351:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.946359:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762811.946364:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.946375:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.946403:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.946412:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762811.946463:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140685056:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3691us (198046us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762811.946473:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:0.0:1789762811.946480:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216415773172 time 216415878615 state 0x2 ref 0 00000100:00100000:3.0:1789762811.948900:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762811.948953:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140685184 00000100:00100000:2.0:1789762811.948961:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140685184 00000100:00100000:2.0:1789762811.948995:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216415773172 time 216415878615 state 0x0 ref 1 00000100:00100000:2.0:1789762811.949005:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216615878615 time 216415878615 state 0x1 ref 1 00000100:00100000:2.0:1789762812.142795:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216615878615 time 216615950705 state 0x0 ref 1 00000100:00100000:2.0:1789762812.142826:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140685184:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762812.142890:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2b5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.142904:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762812.142920:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762812.142925:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.142937:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.146636:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.146657:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.146668:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.146677:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d151b44400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762812.146681:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.146689:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.146705:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.146710:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762812.146786:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140685184:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3970us (197883us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762812.146797:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:2.0:1789762812.146805:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216615878615 time 216615950705 state 0x2 ref 0 00000100:00100000:3.0:1789762812.149076:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762812.149123:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140685312 00000100:00100000:0.0:1789762812.149132:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140685312 00000100:00100000:0.0:1789762812.149170:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216615878615 time 216615950705 state 0x0 ref 1 00000100:00100000:0.0:1789762812.149183:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216815950705 time 216615950705 state 0x1 ref 1 00000100:00100000:2.0:1789762812.343561:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216815950705 time 216816711132 state 0x0 ref 1 00000100:00100000:2.0:1789762812.343597:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140685312:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762812.343655:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2bc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.343673:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762812.343678:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762812.343685:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.343699:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.347034:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.347050:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.347072:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.347078:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d151b44400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762812.347082:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.347090:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.347105:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.347111:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762812.347174:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140685312:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3589us (198097us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762812.347186:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:2.0:1789762812.347195:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216815950705 time 216816711132 state 0x2 ref 0 00000100:00100000:3.0:1789762812.350249:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762812.350314:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140685440 00000100:00100000:0.0:1789762812.350336:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140685440 00000100:00100000:0.0:1789762812.350378:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 216815950705 time 216816711132 state 0x0 ref 1 00000100:00100000:0.0:1789762812.350387:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217016711132 time 216816711132 state 0x1 ref 1 00000100:00100000:0.0:1789762812.543617:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217016711132 time 217016773169 state 0x0 ref 1 00000100:00100000:0.0:1789762812.543647:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140685440:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762812.543685:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2c3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.543720:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762812.543724:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762812.543729:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.543742:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.546800:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.546817:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.546825:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.546846:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762812.546850:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.546857:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.546870:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.546887:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f2c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762812.546936:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140685440:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3304us (196695us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762812.546943:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:0.0:1789762812.546949:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217016711132 time 217016773169 state 0x2 ref 0 00000100:00100000:1.0:1789762812.549372:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762812.549421:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140685568 00000100:00100000:2.0:1789762812.549430:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140685568 00000100:00100000:2.0:1789762812.549463:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217016711132 time 217016773169 state 0x0 ref 1 00000100:00100000:2.0:1789762812.549472:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217216773169 time 217016773169 state 0x1 ref 1 00000100:00100000:0.0:1789762812.743760:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217216773169 time 217216915549 state 0x0 ref 1 00000100:00100000:0.0:1789762812.743789:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140685568:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762812.743828:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ca lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.743878:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762812.743882:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762812.743887:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.743899:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.746463:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.746488:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.746495:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.746501:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762812.746505:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.746512:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.746525:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.746530:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762812.746576:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140685568:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2801us (197205us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762812.746584:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:0.0:1789762812.746590:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217216773169 time 217216915549 state 0x2 ref 0 00000100:00100000:1.0:1789762812.748923:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762812.748970:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140685696 00000100:00100000:2.0:1789762812.748978:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140685696 00000100:00100000:2.0:1789762812.749010:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217216773169 time 217216915549 state 0x0 ref 1 00000100:00100000:2.0:1789762812.749019:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217416915549 time 217216915549 state 0x1 ref 1 00000100:00100000:2.0:1789762812.943872:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217416915549 time 217416997417 state 0x0 ref 1 00000100:00100000:2.0:1789762812.943907:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140685696:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762812.943949:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.943966:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762812.943971:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762812.943977:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.943992:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.947078:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.947092:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.947101:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.947121:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d151b44400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762812.947126:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.947137:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.947155:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.947165:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762812.947223:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140685696:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3330us (198298us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762812.947233:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:2.0:1789762812.947240:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217416915549 time 217416997417 state 0x2 ref 0 00000100:00100000:1.0:1789762812.949202:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762812.949246:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140685824 00000100:00100000:0.0:1789762812.949258:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140685824 00000100:00100000:0.0:1789762812.949289:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217416915549 time 217416997417 state 0x0 ref 1 00000100:00100000:0.0:1789762812.949301:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217616997417 time 217416997417 state 0x1 ref 1 00010000:00010000:1.0:1789762812.966960:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762813.143960:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217616997417 time 217617116022 state 0x0 ref 1 00000100:00100000:2.0:1789762813.144004:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140685824:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:3.0:1789762813.144034:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762813.144049:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.144064:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762813.144080:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762813.144086:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.144098:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.150484:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.150500:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.150511:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.150520:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d151b44400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762813.150525:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.150534:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.150551:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.150560:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762813.150645:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140685824:12345-192.168.203.31@tcp:3:dd.500 Request processed in 6666us (201440us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762813.150655:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:2.0:1789762813.150662:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217616997417 time 217617116022 state 0x2 ref 0 00000100:00100000:3.0:1789762813.152675:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762813.152727:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140685952 00000100:00100000:0.0:1789762813.152737:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140685952 00000100:00100000:0.0:1789762813.152776:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217616997417 time 217617116022 state 0x0 ref 1 00000100:00100000:0.0:1789762813.152786:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217817116022 time 217617116022 state 0x1 ref 1 00000100:00100000:0.0:1789762813.344038:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217817116022 time 217817193277 state 0x0 ref 1 00000100:00100000:0.0:1789762813.344066:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140685952:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762813.344102:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2df lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.344117:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762813.344121:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762813.344125:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.344137:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.347009:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.347020:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.347035:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.347041:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762813.347044:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.347051:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.347064:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.347070:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762813.347120:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140685952:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3067us (194447us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762813.347127:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:0.0:1789762813.347133:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217817116022 time 217817193277 state 0x2 ref 0 00000100:00100000:3.0:1789762813.349155:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762813.349221:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140686080 00000100:00100000:0.0:1789762813.349229:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140686080 00000100:00100000:0.0:1789762813.349259:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 217817116022 time 217817193277 state 0x0 ref 1 00000100:00100000:0.0:1789762813.349269:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218017193277 time 217817193277 state 0x1 ref 1 00000100:00100000:0.0:1789762813.544087:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218017193277 time 218017242867 state 0x0 ref 1 00000100:00100000:0.0:1789762813.544111:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140686080:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762813.544146:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.544160:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762813.544163:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762813.544168:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.544180:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.547055:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.547069:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.547081:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.547091:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762813.547096:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.547122:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.547136:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.547142:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762813.547185:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140686080:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3083us (198030us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762813.547192:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:0.0:1789762813.547197:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218017193277 time 218017242867 state 0x2 ref 0 00000100:00100000:3.0:1789762813.548946:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762813.548982:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140686208 00000100:00100000:2.0:1789762813.548996:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140686208 00000100:00100000:2.0:1789762813.549030:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218017193277 time 218017242867 state 0x0 ref 1 00000100:00100000:2.0:1789762813.549043:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218217242867 time 218017242867 state 0x1 ref 1 00000100:00100000:1.0:1789762813.607055:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149015168:0@lo:400:kworker.0 00000100:00100000:2.0:1789762813.607055:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17410b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149015040:0@lo:400:kworker.0 00000100:00100000:0.0:1789762813.607091:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149014784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762813.607132:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762813.607146:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762813.607147:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149014912:0@lo:400:kworker.0 00000100:00100000:1.0:1789762813.607187:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762813.607195:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17410a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149015296:0@lo:400:kworker.0 00000100:00100000:2.0:1789762813.607204:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149015552:0@lo:400:kworker.0 00000100:00100000:3.0:1789762813.607218:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149015040 00000100:00100000:1.0:1789762813.607227:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149015424:0@lo:400:kworker.0 00000100:00100000:0.0:1789762813.607232:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762813.607234:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149015040 00000100:00100000:2.0:1789762813.607250:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762813.607288:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149015296 00000100:00100000:1.0:1789762813.607294:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149015296 00000100:00100000:0.0:1789762813.607296:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762813.607333:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149015168 00000100:00100000:2.0:1789762813.607335:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762813.607351:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149015168 00000100:00100000:0.0:1789762813.607364:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149015552 00000100:00100000:0.0:1789762813.607369:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149015552 00000100:00100000:1.0:1789762813.607377:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789762813.607390:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149015296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762813.607392:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149015424 00000100:00100000:2.0:1789762813.607398:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789762813.607404:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149015424 00000100:00100000:0.0:1789762813.607408:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789762813.607412:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149015040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762813.607421:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149015552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762813.607433:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789762813.607444:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149015168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762813.607456:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149015296:12345-0@lo:400:kworker.0 Request processed in 69us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762813.607457:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149015040:12345-0@lo:400:kworker.0 Request processed in 50us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762813.607466:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789762813.607466:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789762813.607471:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149015552:12345-0@lo:400:kworker.0 Request processed in 53us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762813.607491:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789762813.607498:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789762813.607499:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149015168:12345-0@lo:400:kworker.0 Request processed in 55us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762813.607502:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149014784 00000100:00100000:1.0:1789762813.607510:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149014784 00000100:00100000:3.0:1789762813.607511:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789762813.607514:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149015424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762813.607538:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149015552:0@lo:400:kworker.0 00000100:00080000:3.0:1789762813.607542:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762813.607548:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762813.607551:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762813.607553:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789762813.607556:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17410b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149015040:0@lo:400:kworker.0 00000100:00100000:1.0:1789762813.607567:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149014784:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762813.607570:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149015424:12345-0@lo:400:kworker.0 Request processed in 60us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762813.607579:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149015168:0@lo:400:kworker.0 00000100:00100000:2.0:1789762813.607594:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00002000:00000024:1.0:1789762813.607595:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762813.607611:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17410a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149015296:0@lo:400:kworker.0 00000100:00100000:3.0:1789762813.607622:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149014912 00000100:00100000:3.0:1789762813.607626:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149014912 00000100:00100000:2.0:1789762813.607642:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149015424:0@lo:400:kworker.0 00000100:00100000:1.0:1789762813.607644:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149014784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762813.607656:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149014784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762813.607656:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789762813.607657:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789762813.607670:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149014912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762813.607709:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149014912:12345-0@lo:400:kworker.0 Request processed in 42us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762813.607715:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789762813.607754:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149014912:0@lo:400:kworker.0 00000100:00100000:0.0:1789762813.744207:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218217242867 time 218217363037 state 0x0 ref 1 00000100:00100000:0.0:1789762813.744235:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140686208:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762813.744281:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.744295:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762813.744298:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762813.744303:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.744326:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.747237:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.747251:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.747284:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.747293:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762813.747299:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.747324:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.747343:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.747358:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f2ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762813.747412:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140686208:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3188us (198464us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762813.747421:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:0.0:1789762813.747427:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218217242867 time 218217363037 state 0x2 ref 0 00000100:00100000:3.0:1789762813.749254:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762813.749301:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140686336 00000100:00100000:2.0:1789762813.749325:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140686336 00000100:00100000:2.0:1789762813.749359:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218217242867 time 218217363037 state 0x0 ref 1 00000100:00100000:2.0:1789762813.749369:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218417363037 time 218217363037 state 0x1 ref 1 00000100:00100000:1.0:1789762813.812173:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762813.812207:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762813.812230:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762813.812230:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140686464 00000100:00100000:2.0:1789762813.812240:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140686464 00000100:00100000:3.0:1789762813.812253:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140686592 00000100:00100000:3.0:1789762813.812261:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140686592 00000100:00100000:0.0:1789762813.812289:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140686720 00000100:00100000:0.0:1789762813.812295:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140686720 00000100:00100000:2.0:1789762813.812299:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 257 00000100:00080000:1.0:1789762813.812325:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762813.812329:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140686464:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762813.812339:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:0.0:1789762813.812352:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:3.0:1789762813.812353:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+9:2345:x1876702140686592:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762813.812363:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140686720:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762813.812402:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140686464:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762813.812404:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+9:2345:x1876702140686592:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 54us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762813.812410:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140686720:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 48us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762813.812416:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 257 00000100:00100000:0.0:1789762813.812425:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:3.0:1789762813.812432:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:2.0:1789762813.944254:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218417363037 time 218417410769 state 0x0 ref 1 00000100:00100000:2.0:1789762813.944279:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140686336:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762813.944325:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2f4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.944339:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762813.944342:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762813.944347:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.944373:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.947034:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.947045:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.947052:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.947058:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d151b44400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762813.947068:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.947075:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.947091:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.947097:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762813.947150:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140686336:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2881us (197897us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762813.947159:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:2.0:1789762813.947164:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218417363037 time 218417410769 state 0x2 ref 0 00000100:00100000:2.0:1789762813.948998:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762813.949044:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140686848 00000100:00100000:0.0:1789762813.949053:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140686848 00000100:00100000:0.0:1789762813.949084:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218417363037 time 218417410769 state 0x0 ref 1 00000100:00100000:0.0:1789762813.949094:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218617410769 time 218417410769 state 0x1 ref 1 00010000:00010000:3.0:1789762813.990954:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762814.119010:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17410a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149015680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762814.119071:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762814.119116:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149015680 00000100:00100000:2.0:1789762814.119126:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149015680 00000100:00100000:2.0:1789762814.119177:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789762814.119187:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149015680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762814.119218:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 439549952 pending 0 free 3754950656 avail 3752853504 00000100:00100000:2.0:1789762814.119269:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149015680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762814.119276:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789762814.119340:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17410a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149015680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762814.144362:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218617410769 time 218617519089 state 0x0 ref 1 00000100:00100000:2.0:1789762814.144386:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140686848:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762814.144422:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2fb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.144436:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762814.144440:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762814.144444:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.144472:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.147008:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.147024:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.147035:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.147044:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d151b44400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762814.147049:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.147059:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.147076:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.147097:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006abb09f3/0xd08452c77c56f2fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762814.147148:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140686848:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2771us (198150us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762814.147156:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:0.0:1789762814.147161:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218617410769 time 218617519089 state 0x2 ref 0 00000100:00100000:2.0:1789762814.148872:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762814.148902:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140686976 00000100:00100000:0.0:1789762814.148910:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140686976 00000100:00100000:0.0:1789762814.148939:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218617410769 time 218617519089 state 0x0 ref 1 00000100:00100000:0.0:1789762814.148948:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218817519089 time 218617519089 state 0x1 ref 1 00000100:00100000:0.0:1789762814.344431:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218817519089 time 218817587139 state 0x0 ref 1 00000100:00100000:0.0:1789762814.344460:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140686976:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762814.344497:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f302 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.344510:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762814.344514:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762814.344519:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f302 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.344529:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f302 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.347502:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f302 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.347511:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f302 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.347518:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f302 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.347525:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762814.347529:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f302 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.347535:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f302 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.347548:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f302 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.347553:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f302 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762814.347597:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140686976:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3150us (198725us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762814.347605:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:0.0:1789762814.347616:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218817519089 time 218817587139 state 0x2 ref 0 00000100:00100000:2.0:1789762814.349260:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762814.349293:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140687104 00000100:00100000:3.0:1789762814.349312:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140687104 00000100:00100000:3.0:1789762814.349343:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 218817519089 time 218817587139 state 0x0 ref 1 00000100:00100000:3.0:1789762814.349351:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219017587139 time 218817587139 state 0x1 ref 1 00000100:00100000:0.0:1789762814.544536:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219017587139 time 219017692319 state 0x0 ref 1 00000100:00100000:0.0:1789762814.544565:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140687104:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762814.544604:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f309 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.544622:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762814.544627:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762814.544633:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f309 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.544650:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f309 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.547412:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f309 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.547425:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f309 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.547434:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f309 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.547443:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762814.547448:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f309 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.547466:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f309 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.547479:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f309 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.547485:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f309 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762814.547533:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140687104:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2982us (198275us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762814.547539:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 202 00000100:00100000:0.0:1789762814.547544:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219017587139 time 219017692319 state 0x2 ref 0 00000100:00100000:2.0:1789762814.549556:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762814.549598:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140687232 00000100:00100000:0.0:1789762814.549608:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140687232 00000100:00100000:0.0:1789762814.549645:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219017587139 time 219017692319 state 0x0 ref 1 00000100:00100000:0.0:1789762814.549654:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219217692319 time 219017692319 state 0x1 ref 1 00000100:00100000:3.0:1789762814.744653:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219217692319 time 219217808672 state 0x0 ref 1 00000100:00100000:3.0:1789762814.744681:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140687232:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762814.744719:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f310 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.744732:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762814.744735:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762814.744740:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f310 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.744751:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f310 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.747357:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f310 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.747378:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f310 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.747384:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f310 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.747389:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762814.747393:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f310 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.747399:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f310 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.747413:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f310 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.747418:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f310 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762814.747463:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140687232:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2796us (197910us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762814.747470:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:3.0:1789762814.747474:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219217692319 time 219217808672 state 0x2 ref 0 00000100:00100000:2.0:1789762814.749179:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762814.749223:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140687360 00000100:00100000:0.0:1789762814.749230:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140687360 00000100:00100000:0.0:1789762814.749268:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219217692319 time 219217808672 state 0x0 ref 1 00000100:00100000:0.0:1789762814.749277:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219417808672 time 219217808672 state 0x1 ref 1 00000100:00100000:0.0:1789762814.944715:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219417808672 time 219417871162 state 0x0 ref 1 00000100:00100000:0.0:1789762814.944762:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140687360:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762814.944807:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f317 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.944825:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762814.944828:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762814.944862:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f317 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.944875:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f317 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.947870:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f317 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.947882:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f317 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.947889:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f317 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.947895:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762814.947898:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f317 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.947904:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f317 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.947925:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f317 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.947931:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f317 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762814.947982:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140687360:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3233us (198803us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762814.947989:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:0.0:1789762814.947995:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219417808672 time 219417871162 state 0x2 ref 0 00000100:00100000:1.0:1789762814.949726:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762814.949768:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140687488 00000100:00100000:2.0:1789762814.949776:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140687488 00000100:00100000:2.0:1789762814.949808:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219417808672 time 219417871162 state 0x0 ref 1 00000100:00100000:2.0:1789762814.949817:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219617871162 time 219417871162 state 0x1 ref 1 00010000:00010000:1.0:1789762815.014929:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762815.144827:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219617871162 time 219617983951 state 0x0 ref 1 00000100:00100000:0.0:1789762815.144887:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140687488:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:1.0:1789762815.144915:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762815.144926:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f31e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.144940:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762815.144944:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762815.144949:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f31e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.144960:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f31e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.147692:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f31e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.147702:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f31e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.147710:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f31e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.147716:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762815.147720:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f31e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.147727:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f31e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.147739:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f31e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.147745:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f31e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762815.147798:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140687488:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2932us (198073us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762815.147808:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:0.0:1789762815.147823:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219617871162 time 219617983951 state 0x2 ref 0 00000100:00100000:1.0:1789762815.149523:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762815.149568:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140687616 00000100:00100000:2.0:1789762815.149577:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140687616 00000100:00100000:2.0:1789762815.149607:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219617871162 time 219617983951 state 0x0 ref 1 00000100:00100000:2.0:1789762815.149616:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219817983951 time 219617983951 state 0x1 ref 1 00000100:00100000:3.0:1789762815.344966:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219817983951 time 219818120377 state 0x0 ref 1 00000100:00100000:3.0:1789762815.345013:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140687616:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762815.345053:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f325 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.345068:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762815.345073:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762815.345080:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f325 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.345095:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f325 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.348226:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f325 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.348240:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f325 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.348248:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f325 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.348256:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762815.348262:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f325 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.348271:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f325 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.348311:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f325 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.348321:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c56f325 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762815.348378:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140687616:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3378us (198854us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762815.348388:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:3.0:1789762815.348395:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219817983951 time 219818120377 state 0x2 ref 0 00000100:00100000:2.0:1789762815.350260:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762815.350323:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140687744 00000100:00100000:0.0:1789762815.350331:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140687744 00000100:00100000:0.0:1789762815.350364:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 219817983951 time 219818120377 state 0x0 ref 1 00000100:00100000:0.0:1789762815.350373:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220018120377 time 219818120377 state 0x1 ref 1 00000100:00100000:2.0:1789762815.545060:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220018120377 time 220018216016 state 0x0 ref 1 00000100:00100000:2.0:1789762815.545091:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140687744:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762815.545128:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a9508f4/0xd08452c77c56f32c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.545141:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762815.545157:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762815.545162:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a9508f4/0xd08452c77c56f32c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.545176:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a9508f4/0xd08452c77c56f32c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.548131:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a9508f4/0xd08452c77c56f32c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.548151:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a9508f4/0xd08452c77c56f32c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.548162:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a9508f4/0xd08452c77c56f32c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.548172:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0430ccc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762815.548178:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a9508f4/0xd08452c77c56f32c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.548190:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a9508f4/0xd08452c77c56f32c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.548211:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a9508f4/0xd08452c77c56f32c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.548220:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a9508f4/0xd08452c77c56f32c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762815.548320:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140687744:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3238us (198054us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762815.548335:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:0.0:1789762815.548345:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220018120377 time 220018216016 state 0x2 ref 0 00000100:00100000:3.0:1789762815.550057:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762815.550099:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140687872 00000100:00100000:0.0:1789762815.550107:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140687872 00000100:00100000:0.0:1789762815.550142:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220018120377 time 220018216016 state 0x0 ref 1 00000100:00100000:0.0:1789762815.550152:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220218216016 time 220018216016 state 0x1 ref 1 00000100:00100000:0.0:1789762815.745131:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220218216016 time 220218284836 state 0x0 ref 1 00000100:00100000:0.0:1789762815.745165:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140687872:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762815.745207:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f333 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.745221:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762815.745225:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762815.745230:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f333 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.745241:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f333 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.748230:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f333 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.748248:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.748255:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f333 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.748260:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762815.748264:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f333 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.748270:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f333 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.748283:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f333 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.748288:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f333 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762815.748359:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140687872:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3209us (198301us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762815.748366:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 208 00000100:00100000:0.0:1789762815.748371:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220218216016 time 220218284836 state 0x2 ref 0 00000100:00100000:3.0:1789762815.750061:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762815.750100:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140688000 00000100:00100000:2.0:1789762815.750108:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140688000 00000100:00100000:2.0:1789762815.750139:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220218216016 time 220218284836 state 0x0 ref 1 00000100:00100000:2.0:1789762815.750148:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220418284836 time 220218284836 state 0x1 ref 1 00000100:00100000:0.0:1789762815.945267:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220418284836 time 220418424212 state 0x0 ref 1 00000100:00100000:0.0:1789762815.945329:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140688000:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762815.945368:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f33a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.945382:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762815.945385:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762815.945390:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f33a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.945401:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f33a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.948111:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f33a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.948122:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f33a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.948130:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f33a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.948135:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762815.948139:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f33a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.948146:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f33a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.948168:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f33a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.948174:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f33a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762815.948222:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140688000:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2904us (198161us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762815.948229:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:0.0:1789762815.948235:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220418284836 time 220418424212 state 0x2 ref 0 00000100:00100000:2.0:1789762815.949970:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762815.950009:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140688128 00000100:00100000:3.0:1789762815.950022:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140688128 00000100:00100000:3.0:1789762815.950061:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220418284836 time 220418424212 state 0x0 ref 1 00000100:00100000:3.0:1789762815.950070:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220618424212 time 220418424212 state 0x1 ref 1 00010000:00010000:1.0:1789762816.038919:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762816.145387:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220618424212 time 220618543069 state 0x0 ref 1 00000100:00100000:2.0:1789762816.145415:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140688128:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762816.145453:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c11b1f0/0xd08452c77c56f341 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.145468:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762816.145471:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762816.145475:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c11b1f0/0xd08452c77c56f341 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.145487:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c11b1f0/0xd08452c77c56f341 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.148555:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c11b1f0/0xd08452c77c56f341 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.148566:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c11b1f0/0xd08452c77c56f341 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.148572:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c11b1f0/0xd08452c77c56f341 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.148577:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0429ad800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762816.148580:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c11b1f0/0xd08452c77c56f341 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.148586:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c11b1f0/0xd08452c77c56f341 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.148612:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c11b1f0/0xd08452c77c56f341 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.148621:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c11b1f0/0xd08452c77c56f341 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762816.148676:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140688128:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3273us (198706us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762816.148684:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:0.0:1789762816.148690:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220618424212 time 220618543069 state 0x2 ref 0 00000100:00100000:1.0:1789762816.150406:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762816.150441:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140688256 00000100:00100000:0.0:1789762816.150448:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140688256 00000100:00100000:0.0:1789762816.150478:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220618424212 time 220618543069 state 0x0 ref 1 00000100:00100000:0.0:1789762816.150486:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220818543069 time 220618543069 state 0x1 ref 1 00000100:00100000:3.0:1789762816.345517:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220818543069 time 220818673553 state 0x0 ref 1 00000100:00100000:3.0:1789762816.345555:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140688256:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762816.345601:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c44ed39/0xd08452c77c56f348 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.345620:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762816.345637:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762816.345642:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c44ed39/0xd08452c77c56f348 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.345654:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c44ed39/0xd08452c77c56f348 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.348439:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c44ed39/0xd08452c77c56f348 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.348449:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c44ed39/0xd08452c77c56f348 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.348455:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c44ed39/0xd08452c77c56f348 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.348460:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0430cfe00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762816.348464:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c44ed39/0xd08452c77c56f348 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.348470:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c44ed39/0xd08452c77c56f348 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.348484:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c44ed39/0xd08452c77c56f348 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.348489:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c44ed39/0xd08452c77c56f348 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762816.348551:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140688256:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3014us (198144us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762816.348561:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:3.0:1789762816.348569:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220818543069 time 220818673553 state 0x2 ref 0 00000100:00100000:3.0:1789762816.350381:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762816.350426:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140688384 00000100:00100000:0.0:1789762816.350434:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140688384 00000100:00100000:0.0:1789762816.350466:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 220818543069 time 220818673553 state 0x0 ref 1 00000100:00100000:0.0:1789762816.350475:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221018673553 time 220818673553 state 0x1 ref 1 00000100:00100000:0.0:1789762816.545585:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221018673553 time 221018731958 state 0x0 ref 1 00000100:00100000:0.0:1789762816.545611:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140688384:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762816.545646:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f34f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.545673:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762816.545677:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762816.545682:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f34f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.545694:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f34f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.548747:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f34f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.548757:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f34f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.548763:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f34f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.548768:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762816.548772:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f34f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.548778:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f34f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.548792:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f34f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.548814:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f34f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762816.548901:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140688384:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3298us (198517us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762816.548912:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:0.0:1789762816.548918:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221018673553 time 221018731958 state 0x2 ref 0 00000100:00100000:3.0:1789762816.550745:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762816.550804:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140688512 00000100:00100000:2.0:1789762816.550812:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140688512 00000100:00100000:2.0:1789762816.550879:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221018673553 time 221018731958 state 0x0 ref 1 00000100:00100000:2.0:1789762816.550889:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221218731958 time 221018731958 state 0x1 ref 1 00000100:00100000:0.0:1789762816.745788:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221218731958 time 221218940264 state 0x0 ref 1 00000100:00100000:0.0:1789762816.745819:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140688512:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762816.745900:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f356 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.745920:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762816.745925:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762816.745931:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f356 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.745947:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f356 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.748733:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f356 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.748765:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f356 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.748778:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f356 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.748787:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762816.748792:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f356 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.748804:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f356 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.748827:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f356 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.748878:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f356 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762816.748942:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140688512:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3135us (198195us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762816.748953:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:0.0:1789762816.748962:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221218731958 time 221218940264 state 0x2 ref 0 00000100:00100000:3.0:1789762816.750899:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762816.750938:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140688640 00000100:00100000:2.0:1789762816.750946:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140688640 00000100:00100000:2.0:1789762816.750980:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221218731958 time 221218940264 state 0x0 ref 1 00000100:00100000:2.0:1789762816.750990:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221418940264 time 221218940264 state 0x1 ref 1 00000100:00100000:2.0:1789762816.945866:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221418940264 time 221419022354 state 0x0 ref 1 00000100:00100000:2.0:1789762816.945893:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14888ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140688640:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762816.945930:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3da3afa/0xd08452c77c56f35d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.945945:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762816.945949:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762816.945953:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3da3afa/0xd08452c77c56f35d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.945964:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3da3afa/0xd08452c77c56f35d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.948937:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3da3afa/0xd08452c77c56f35d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.948961:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3da3afa/0xd08452c77c56f35d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.948972:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3da3afa/0xd08452c77c56f35d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.948981:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d041eaec00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762816.948986:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3da3afa/0xd08452c77c56f35d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.948996:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3da3afa/0xd08452c77c56f35d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.949010:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3da3afa/0xd08452c77c56f35d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.949016:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3da3afa/0xd08452c77c56f35d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762816.949064:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14888ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140688640:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3182us (198169us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762816.949077:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:0.0:1789762816.949082:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221418940264 time 221419022354 state 0x2 ref 0 00000100:00100000:3.0:1789762816.950916:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762816.950950:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140688768 00000100:00100000:0.0:1789762816.950966:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140688768 00000100:00100000:0.0:1789762816.951003:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221418940264 time 221419022354 state 0x0 ref 1 00000100:00100000:0.0:1789762816.951012:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221619022354 time 221419022354 state 0x1 ref 1 00010000:00010000:1.0:1789762817.062945:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762817.145980:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221619022354 time 221619135894 state 0x0 ref 1 00000100:00100000:2.0:1789762817.146032:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140688768:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:1.0:1789762817.146065:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762817.146070:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f364 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.146084:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762817.146087:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762817.146093:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f364 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.146104:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f364 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.148472:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f364 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.148481:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f364 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.148488:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f364 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.148494:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d041eafa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762817.148498:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f364 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.148504:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f364 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.148524:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f364 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.148530:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f364 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762817.148573:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140688768:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2565us (197658us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762817.148580:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:2.0:1789762817.148584:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221619022354 time 221619135894 state 0x2 ref 0 00000100:00100000:3.0:1789762817.150316:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762817.150359:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140688896 00000100:00100000:0.0:1789762817.150368:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140688896 00000100:00100000:0.0:1789762817.150398:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221619022354 time 221619135894 state 0x0 ref 1 00000100:00100000:0.0:1789762817.150407:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221819135894 time 221619135894 state 0x1 ref 1 00000100:00100000:0.0:1789762817.346034:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221819135894 time 221819190188 state 0x0 ref 1 00000100:00100000:0.0:1789762817.346060:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140688896:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762817.346098:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f36b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.346112:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762817.346115:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762817.346120:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f36b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.346131:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f36b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.349020:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f36b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.349035:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f36b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.349056:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f36b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.349065:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762817.349070:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f36b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.349081:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f36b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.349099:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f36b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.349107:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f36b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762817.349162:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140688896:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3113us (198846us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762817.349169:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:0.0:1789762817.349175:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221819135894 time 221819190188 state 0x2 ref 0 00000100:00100000:3.0:1789762817.350992:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762817.351034:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140689024 00000100:00100000:2.0:1789762817.351043:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140689024 00000100:00100000:2.0:1789762817.351075:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 221819135894 time 221819190188 state 0x0 ref 1 00000100:00100000:2.0:1789762817.351084:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222019190188 time 221819190188 state 0x1 ref 1 00000100:00100000:0.0:1789762817.546113:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222019190188 time 222019269538 state 0x0 ref 1 00000100:00100000:0.0:1789762817.546138:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140689024:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762817.546176:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f372 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.546201:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762817.546205:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762817.546209:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f372 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.546231:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f372 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.549225:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f372 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.549235:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f372 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.549242:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f372 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.549248:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762817.549251:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f372 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.549258:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f372 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.549271:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f372 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.549301:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f372 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762817.549347:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140689024:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3219us (198356us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762817.549356:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:0.0:1789762817.549361:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222019190188 time 222019269538 state 0x2 ref 0 00000100:00100000:3.0:1789762817.551164:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762817.551202:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140689152 00000100:00100000:2.0:1789762817.551210:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140689152 00000100:00100000:2.0:1789762817.551239:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222019190188 time 222019269538 state 0x0 ref 1 00000100:00100000:2.0:1789762817.551248:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222219269538 time 222019269538 state 0x1 ref 1 00000100:00100000:2.0:1789762817.746196:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222219269538 time 222219351424 state 0x0 ref 1 00000100:00100000:2.0:1789762817.746224:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140689152:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762817.746261:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f379 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.746301:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762817.746305:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762817.746310:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f379 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.746322:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f379 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.748863:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f379 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.748874:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f379 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.748880:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f379 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.748885:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d041eafa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762817.748889:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f379 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.748895:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f379 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.748907:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f379 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.748922:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f379 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762817.748968:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140689152:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2757us (197805us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762817.748975:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:2.0:1789762817.748980:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222219269538 time 222219351424 state 0x2 ref 0 00000100:00100000:3.0:1789762817.750865:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762817.750894:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140689280 00000100:00100000:0.0:1789762817.750902:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140689280 00000100:00100000:0.0:1789762817.750933:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222219269538 time 222219351424 state 0x0 ref 1 00000100:00100000:0.0:1789762817.750942:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222419351424 time 222219351424 state 0x1 ref 1 00000100:00100000:2.0:1789762817.946325:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222419351424 time 222419481039 state 0x0 ref 1 00000100:00100000:2.0:1789762817.946353:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140689280:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762817.946390:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f380 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.946405:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762817.946410:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762817.946416:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f380 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.946431:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f380 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.949195:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f380 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.949221:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f380 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.949231:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f380 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.949241:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d041eafa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762817.949246:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f380 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.949258:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f380 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.949288:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f380 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.949299:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f380 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762817.949352:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140689280:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3011us (198516us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762817.949360:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:2.0:1789762817.949366:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222419351424 time 222419481039 state 0x2 ref 0 00000100:00100000:3.0:1789762817.951103:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762817.951157:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140689408 00000100:00100000:0.0:1789762817.951165:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140689408 00000100:00100000:0.0:1789762817.951197:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222419351424 time 222419481039 state 0x0 ref 1 00000100:00100000:0.0:1789762817.951206:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222619481039 time 222419481039 state 0x1 ref 1 00010000:00010000:3.0:1789762818.086984:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762818.146405:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222619481039 time 222619559774 state 0x0 ref 1 00000100:00100000:0.0:1789762818.146437:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140689408:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762818.146479:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f387 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.146496:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762818.146513:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762818.146520:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f387 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.146534:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f387 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.149186:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f387 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.149198:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f387 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.149208:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f387 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.149216:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762818.149221:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f387 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.149231:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f387 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.149249:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f387 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.149259:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f387 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762818.149343:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140689408:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2918us (198239us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762818.149353:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:0.0:1789762818.149360:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222619481039 time 222619559774 state 0x2 ref 0 00000100:00100000:3.0:1789762818.151054:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762818.151101:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140689536 00000100:00100000:2.0:1789762818.151116:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140689536 00000100:00100000:2.0:1789762818.151145:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222619481039 time 222619559774 state 0x0 ref 1 00000100:00100000:2.0:1789762818.151154:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222819559774 time 222619559774 state 0x1 ref 1 00000100:00100000:0.0:1789762818.346635:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222819559774 time 222819789823 state 0x0 ref 1 00000100:00100000:0.0:1789762818.346664:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140689536:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762818.346703:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f38e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.346720:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762818.346725:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762818.346731:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f38e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.346746:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f38e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.349828:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f38e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.349865:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f38e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.349883:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f38e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.349889:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762818.349894:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f38e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.349900:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f38e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.349914:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f38e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.349920:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f38e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762818.349972:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140689536:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3318us (198916us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762818.349980:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:0.0:1789762818.349986:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222819559774 time 222819789823 state 0x2 ref 0 00000100:00100000:3.0:1789762818.351881:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762818.351920:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140689664 00000100:00100000:2.0:1789762818.351938:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140689664 00000100:00100000:2.0:1789762818.351972:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 222819559774 time 222819789823 state 0x0 ref 1 00000100:00100000:2.0:1789762818.351981:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223019789823 time 222819789823 state 0x1 ref 1 00000100:00100000:2.0:1789762818.546688:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223019789823 time 223019844728 state 0x0 ref 1 00000100:00100000:2.0:1789762818.546716:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140689664:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762818.546760:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f395 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.546778:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762818.546784:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762818.546790:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f395 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.546803:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f395 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.549480:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f395 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.549494:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f395 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.549515:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f395 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.549520:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d041eafa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762818.549524:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f395 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.549530:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f395 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.549543:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f395 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.549548:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f395 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762818.549596:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140689664:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2892us (197716us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762818.549603:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:2.0:1789762818.549609:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223019789823 time 223019844728 state 0x2 ref 0 00000100:00100000:1.0:1789762818.551897:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762818.551942:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140689792 00000100:00100000:0.0:1789762818.551950:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140689792 00000100:00100000:0.0:1789762818.551981:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223019789823 time 223019844728 state 0x0 ref 1 00000100:00100000:0.0:1789762818.551991:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223219844728 time 223019844728 state 0x1 ref 1 00000100:00100000:1.0:1789762818.726991:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149016064:0@lo:400:kworker.0 00000100:00100000:2.0:1789762818.726991:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17410b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149015936:0@lo:400:kworker.0 00000100:00100000:3.0:1789762818.727004:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17410a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149016192:0@lo:400:kworker.0 00000100:00100000:0.0:1789762818.727026:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149015808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762818.727083:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762818.727086:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762818.727103:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762818.727145:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149016320:0@lo:400:kworker.0 00000100:00100000:1.0:1789762818.727155:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149016576:0@lo:400:kworker.0 00000100:00100000:2.0:1789762818.727163:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149016448:0@lo:400:kworker.0 00000100:00100000:0.0:1789762818.727177:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762818.727199:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149016064 00000100:00100000:1.0:1789762818.727205:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149016064 00000100:00100000:2.0:1789762818.727223:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762818.727236:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149015808 00000100:00100000:0.0:1789762818.727243:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149015808 00000100:00100000:1.0:1789762818.727249:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149016448 00000100:00100000:1.0:1789762818.727254:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149016448 00000100:00100000:2.0:1789762818.727306:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149015936 00000100:00100000:2.0:1789762818.727312:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149015936 00000100:00100000:1.0:1789762818.727316:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789762818.727320:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789762818.727328:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149016064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762818.727334:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149015808:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762818.727351:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00002000:00000024:0.0:1789762818.727361:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762818.727361:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149015936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762818.727371:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762818.727380:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149016064:12345-0@lo:400:kworker.0 Request processed in 54us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762818.727386:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789762818.727403:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149016192 00000100:00100000:1.0:1789762818.727406:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149016192 00000100:00100000:1.0:1789762818.727432:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789762818.727434:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149015808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762818.727440:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149015936:12345-0@lo:400:kworker.0 Request processed in 78us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762818.727442:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149016448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762818.727451:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789762818.727459:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789762818.727472:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789762818.727484:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149016448:12345-0@lo:400:kworker.0 Request processed in 44us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762818.727489:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149016192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762818.727496:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789762818.727512:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149016320 00000100:00100000:0.0:1789762818.727516:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149016320 00000100:00100000:2.0:1789762818.727529:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149016448:0@lo:400:kworker.0 00000100:00100000:2.0:1789762818.727544:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17410b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149015936:0@lo:400:kworker.0 00000100:00100000:3.0:1789762818.727553:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149016192:12345-0@lo:400:kworker.0 Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762818.727562:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1789762818.727564:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762818.727571:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1789762818.727571:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762818.727578:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762818.727582:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149016320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762818.727599:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762818.727604:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17410a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149016192:0@lo:400:kworker.0 00000100:00100000:0.0:1789762818.727636:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149016320:12345-0@lo:400:kworker.0 Request processed in 55us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762818.727644:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789762818.727644:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149016064:0@lo:400:kworker.0 00000100:00100000:0.0:1789762818.727663:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149016576 00000100:00100000:0.0:1789762818.727667:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149016576 00000100:00100000:0.0:1789762818.727696:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789762818.727705:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149016576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762818.727719:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149015808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762818.727732:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149016320:0@lo:400:kworker.0 00000100:00100000:0.0:1789762818.727746:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149016576:12345-0@lo:400:kworker.0 Request processed in 42us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762818.727760:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789762818.727764:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149016576:0@lo:400:kworker.0 00000100:00100000:2.0:1789762818.746774:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223219844728 time 223219931239 state 0x0 ref 1 00000100:00100000:2.0:1789762818.746799:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140689792:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762818.746855:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f39c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.746872:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762818.746877:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762818.746885:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f39c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.746899:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f39c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.749670:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f39c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.749682:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f39c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.749690:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f39c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.749695:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d041eafa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762818.749699:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f39c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.749705:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f39c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.749721:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f39c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.749726:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000579b7181/0xd08452c77c56f39c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762818.749788:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140689792:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2997us (197890us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762818.749796:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:0.0:1789762818.749801:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223219844728 time 223219931239 state 0x2 ref 0 00000100:00100000:1.0:1789762818.751634:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762818.751672:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140689920 00000100:00100000:0.0:1789762818.751688:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140689920 00000100:00100000:0.0:1789762818.751716:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223219844728 time 223219931239 state 0x0 ref 1 00000100:00100000:0.0:1789762818.751724:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223419931239 time 223219931239 state 0x1 ref 1 00000100:00100000:2.0:1789762818.932329:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762818.932371:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762818.932390:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140690176 00000100:00100000:2.0:1789762818.932397:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762818.932400:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140690176 00000100:00100000:0.0:1789762818.932441:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140690048 00000100:00100000:0.0:1789762818.932448:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140690048 00000100:00100000:3.0:1789762818.932467:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140690304 00000100:00100000:3.0:1789762818.932474:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140690304 00000100:00100000:1.0:1789762818.932475:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:0.0:1789762818.932492:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 259 00000100:00100000:1.0:1789762818.932498:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140690176:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:2.0:1789762818.932501:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762818.932507:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140690048:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762818.932523:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:3.0:1789762818.932536:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140690304:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762818.932582:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140690048:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762818.932589:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140690176:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 100us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762818.932590:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140690304:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 56us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762818.932598:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 259 00000100:00100000:1.0:1789762818.932607:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:3.0:1789762818.932613:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:0.0:1789762818.946821:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223419931239 time 223419981119 state 0x0 ref 1 00000100:00100000:0.0:1789762818.946861:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140689920:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762818.946888:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.946902:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762818.946906:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762818.946910:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.946920:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.949350:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.949372:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.949380:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.949385:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762818.949388:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.949402:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.949416:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762818.949421:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762818.949463:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140689920:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2629us (197829us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762818.949471:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:0.0:1789762818.949476:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223419931239 time 223419981119 state 0x2 ref 0 00000100:00100000:3.0:1789762818.951177:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762818.951209:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140690432 00000100:00100000:0.0:1789762818.951221:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140690432 00000100:00100000:0.0:1789762818.951245:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223419931239 time 223419981119 state 0x0 ref 1 00000100:00100000:0.0:1789762818.951253:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223619981119 time 223419981119 state 0x1 ref 1 00010000:00010000:1.0:1789762819.110945:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762819.146899:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223619981119 time 223620056406 state 0x0 ref 1 00000100:00100000:0.0:1789762819.146937:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140690432:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:2.0:1789762819.146966:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762819.146974:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3aa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.146989:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762819.146994:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762819.147001:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.147016:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.149703:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.149714:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.149721:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.149737:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762819.149741:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.149748:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.149761:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.149766:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762819.149812:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140690432:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2899us (198636us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762819.149819:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:0.0:1789762819.149823:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223619981119 time 223620056406 state 0x2 ref 0 00000100:00100000:3.0:1789762819.151798:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762819.151861:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140690560 00000100:00100000:2.0:1789762819.151870:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140690560 00000100:00100000:2.0:1789762819.151902:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223619981119 time 223620056406 state 0x0 ref 1 00000100:00100000:2.0:1789762819.151911:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223820056406 time 223620056406 state 0x1 ref 1 00000100:00100000:3.0:1789762819.239012:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149016704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762819.239084:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762819.239127:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149016704 00000100:00100000:2.0:1789762819.239136:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149016704 00000100:00100000:2.0:1789762819.239195:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789762819.239207:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149016704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762819.239258:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 439549952 pending 0 free 3754950656 avail 3752853504 00000100:00100000:2.0:1789762819.239318:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149016704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762819.239324:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789762819.239370:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149016704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762819.347002:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223820056406 time 223820158283 state 0x0 ref 1 00000100:00100000:0.0:1789762819.347029:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140690560:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762819.347067:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3b1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.347081:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762819.347096:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762819.347101:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.347112:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.349530:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.349539:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.349546:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.349552:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762819.349555:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.349561:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.349573:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.349579:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762819.349634:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140690560:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2617us (197836us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762819.349641:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:0.0:1789762819.349646:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223820056406 time 223820158283 state 0x2 ref 0 00000100:00100000:2.0:1789762819.351410:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762819.351447:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140690688 00000100:00100000:0.0:1789762819.351455:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140690688 00000100:00100000:0.0:1789762819.351485:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 223820056406 time 223820158283 state 0x0 ref 1 00000100:00100000:0.0:1789762819.351494:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224020158283 time 223820158283 state 0x1 ref 1 00000100:00100000:2.0:1789762819.547064:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224020158283 time 224020222514 state 0x0 ref 1 00000100:00100000:2.0:1789762819.547087:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140690688:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762819.547122:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f3b8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.547137:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762819.547141:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762819.547146:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f3b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.547158:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f3b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.549876:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f3b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.549888:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f3b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.549895:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f3b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.549902:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148889e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762819.549905:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f3b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.549912:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f3b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.549927:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f3b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.549932:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096bc1eaa/0xd08452c77c56f3b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762819.549978:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140690688:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2899us (198568us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762819.549986:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:2.0:1789762819.549997:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224020158283 time 224020222514 state 0x2 ref 0 00000100:00100000:2.0:1789762819.551725:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762819.551802:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140690816 00000100:00100000:0.0:1789762819.551811:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140690816 00000100:00100000:0.0:1789762819.551871:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224020158283 time 224020222514 state 0x0 ref 1 00000100:00100000:0.0:1789762819.551885:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224220222514 time 224020222514 state 0x1 ref 1 00000100:00100000:0.0:1789762819.747134:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224220222514 time 224220290519 state 0x0 ref 1 00000100:00100000:0.0:1789762819.747162:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140690816:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762819.747206:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3bf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.747221:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762819.747225:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762819.747229:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.747257:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.750014:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.750026:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.750036:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.750041:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762819.750045:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.750052:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.750066:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.750072:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762819.750127:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140690816:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2979us (198402us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762819.750134:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 228 00000100:00100000:0.0:1789762819.750140:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224220222514 time 224220290519 state 0x2 ref 0 00000100:00100000:3.0:1789762819.751977:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762819.752021:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140690944 00000100:00100000:2.0:1789762819.752029:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140690944 00000100:00100000:2.0:1789762819.752059:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224220222514 time 224220290519 state 0x0 ref 1 00000100:00100000:2.0:1789762819.752068:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224420290519 time 224220290519 state 0x1 ref 1 00000100:00100000:0.0:1789762819.947242:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224420290519 time 224420397801 state 0x0 ref 1 00000100:00100000:0.0:1789762819.947283:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140690944:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762819.947321:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.947335:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762819.947339:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762819.947343:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.947355:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.950105:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.950115:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.950139:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.950145:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762819.950149:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.950155:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.950168:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.950174:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762819.950221:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140690944:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2964us (198245us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762819.950228:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:0.0:1789762819.950234:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224420290519 time 224420397801 state 0x2 ref 0 00000100:00100000:3.0:1789762819.952081:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762819.952119:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140691072 00000100:00100000:0.0:1789762819.952127:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140691072 00000100:00100000:0.0:1789762819.952157:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224420290519 time 224420397801 state 0x0 ref 1 00000100:00100000:0.0:1789762819.952165:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224620397801 time 224420397801 state 0x1 ref 1 00010000:00010000:1.0:1789762820.134933:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762820.147314:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224620397801 time 224620473138 state 0x0 ref 1 00000100:00100000:2.0:1789762820.147339:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140691072:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762820.147375:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c56f3cd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.147389:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762820.147392:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762820.147397:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c56f3cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.147407:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c56f3cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.150198:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c56f3cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.150209:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c56f3cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.150217:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c56f3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.150222:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762820.150225:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c56f3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.150231:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c56f3cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.150244:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c56f3cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.150249:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c56f3cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762820.150313:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140691072:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2985us (198234us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762820.150322:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 230 00000100:00100000:0.0:1789762820.150327:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224620397801 time 224620473138 state 0x2 ref 0 00000100:00100000:2.0:1789762820.152071:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762820.152102:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140691200 00000100:00100000:0.0:1789762820.152109:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140691200 00000100:00100000:0.0:1789762820.152137:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224620397801 time 224620473138 state 0x0 ref 1 00000100:00100000:0.0:1789762820.152145:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224820473138 time 224620473138 state 0x1 ref 1 00000100:00100000:0.0:1789762820.347392:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224820473138 time 224820547108 state 0x0 ref 1 00000100:00100000:0.0:1789762820.347419:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140691200:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762820.347457:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3d4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.347477:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762820.347480:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762820.347485:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.347496:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.350370:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.350381:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.350388:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.350406:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762820.350409:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.350416:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.350429:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.350435:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762820.350481:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140691200:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3074us (198410us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762820.350488:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:0.0:1789762820.350493:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224820473138 time 224820547108 state 0x2 ref 0 00000100:00100000:2.0:1789762820.352364:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762820.352413:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140691328 00000100:00100000:0.0:1789762820.352421:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140691328 00000100:00100000:0.0:1789762820.352450:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 224820473138 time 224820547108 state 0x0 ref 1 00000100:00100000:0.0:1789762820.352459:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 225020547108 time 224820547108 state 0x1 ref 1 00000100:00100000:0.0:1789762820.547453:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 225020547108 time 225020608686 state 0x0 ref 1 00000100:00100000:0.0:1789762820.547482:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140691328:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762820.547533:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3db lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.547547:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762820.547560:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762820.547565:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.547579:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.550639:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.550648:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.550654:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.550659:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762820.550662:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.550670:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.550703:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.550713:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762820.550763:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140691328:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3295us (198400us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762820.550771:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 232 00000100:00100000:0.0:1789762820.550776:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 225020547108 time 225020608686 state 0x2 ref 0 00000100:00100000:2.0:1789762820.552907:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762820.552939:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140691456 00000100:00100000:0.0:1789762820.552947:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140691456 00000100:00100000:0.0:1789762820.552976:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 225020547108 time 225020608686 state 0x0 ref 1 00000100:00100000:0.0:1789762820.552984:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 225220608686 time 225020608686 state 0x1 ref 1 00000100:00100000:0.0:1789762820.747524:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 225220608686 time 225220679639 state 0x0 ref 1 00000100:00100000:0.0:1789762820.747552:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140691456:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762820.747588:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.747602:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762820.747605:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762820.747610:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.747642:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.750436:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.750448:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.750456:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.750462:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762820.750466:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.750473:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.750487:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.750492:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762820.750555:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140691456:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3010us (197644us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762820.750567:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:0.0:1789762820.750573:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 225220608686 time 225220679639 state 0x2 ref 0 00000100:00100000:1.0:1789762820.752417:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762820.752461:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140691584 00000100:00100000:2.0:1789762820.752469:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140691584 00000100:00100000:2.0:1789762820.752502:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 225220608686 time 225220679639 state 0x0 ref 1 00000100:00100000:2.0:1789762820.752517:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 225420679639 time 225220679639 state 0x1 ref 1 00000100:00100000:0.0:1789762820.947604:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 225420679639 time 225420759709 state 0x0 ref 1 00000100:00100000:0.0:1789762820.947632:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140691584:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762820.947683:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.947699:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762820.947703:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762820.947710:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.947725:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.950487:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.950496:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.950514:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.950519:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762820.950522:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.950528:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.950542:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.950547:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c4d52/0xd08452c77c56f3e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762820.950600:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140691584:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2978us (198181us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762820.950611:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:0.0:1789762820.950618:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 225420679639 time 225420759709 state 0x2 ref 0 00000100:00100000:1.0:1789762820.951920:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762820.951953:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140691840 00000100:00100000:0.0:1789762820.951962:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140691840 00000100:00080000:2.0:1789762820.952005:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762820.952007:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1789762820.952017:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+9:11155:x1876702140691840:12345-192.168.203.31@tcp:35:dd.500 00000100:00100000:0.0:1789762820.952359:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+10:11155:x1876702140691840:12345-192.168.203.31@tcp:35:dd.500 Request processed in 343us (440us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789762820.952365:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:2.0:1789762820.972986:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762820.973022:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140691968 00000100:00100000:0.0:1789762820.973030:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140691968 00000100:00100000:0.0:1789762820.973076:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1789762820.973085:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a048450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+6:6029:x1876702140691968:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762820.973097:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762820.973125:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f12d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e787 expref: 6 pid: 8803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.973144:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762820.973183:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a048450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+5:6029:x1876702140691968:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 99us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762820.973192:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1789762820.980879:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762820.980961:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140692096 00000100:00100000:0.0:1789762820.980968:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140692096 00000100:00100000:0.0:1789762820.981001:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:0.0:1789762820.981008:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+10:10188:x1876702140692096:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1789762820.981024:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762820.981037:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b800/0xd08452c77c56f3f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e78e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.981083:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a000/0xd08452c77c56f3f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.981106:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a000/0xd08452c77c56f3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.981115:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a000/0xd08452c77c56f3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762820.981139:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00000004:00200000:0.0:1789762820.981142:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762820.981154:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a000/0xd08452c77c56f3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.981172:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b800/0xd08452c77c56f3f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e78e expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.981183:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a000/0xd08452c77c56f3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e78e expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.981189:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:0.0:1789762820.981192:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762820.981193:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16002a000, rc 0) 00000100:00100000:0.0:1789762820.981223:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+11:10188:x1876702140692096:12345-192.168.203.31@tcp:101:bash.0 Request processed in 216us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762820.981228:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:1.0:1789762820.984456:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762820.984507:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140692352 00000100:00100000:2.0:1789762820.984512:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140692352 00000100:00100000:2.0:1789762820.984542:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:2.0:1789762820.984551:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+11:11170:x1876702140692352:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789762820.984559:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762820.984568:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97600/0xd08452c77c56f3fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e795 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762820.984608:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00010000:00010000:2.0:1789762820.984680:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97600/0xd08452c77c56f3fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e795 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.984688:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f700) 00010000:00010000:2.0:1789762820.984690:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789762820.984693:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97600/0xd08452c77c56f3fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e795 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.984701:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f97600, rc 0) 00000100:00100000:2.0:1789762820.984730:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+12:11170:x1876702140692352:12345-192.168.203.31@tcp:101:rm.0 Request processed in 181us (275us total) trans 4294967407 rc 301/301 00000100:00100000:2.0:1789762820.984739:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:2.0:1789762820.986084:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762820.986121:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140692480 00000100:00100000:3.0:1789762820.986126:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140692480 00000100:00100000:3.0:1789762820.986159:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1789762820.986175:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+12:11170:x1876702140692480:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:2.0:1789762820.988084:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+12:11170:x1876702140692480:12345-192.168.203.31@tcp:37:rm.0 Request processed in 1918us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762820.988097:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:1.0:1789762820.989526:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762820.989573:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140692736 00000100:00100000:0.0:1789762820.989580:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140692736 00000100:00100000:0.0:1789762820.989613:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1789762820.989622:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+12:11170:x1876702140692736:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:0.0:1789762820.989716:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+13:11170:x1876702140692736:12345-192.168.203.31@tcp:35:rm.0 Request processed in 96us (191us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789762820.989729:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:1.0:1789762820.990467:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762820.990509:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140692992 00000100:00100000:3.0:1789762820.990514:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140692992 00000100:00100000:3.0:1789762820.990540:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:3.0:1789762820.990547:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+13:11170:x1876702140692992:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1789762820.990556:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762820.990564:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f40c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e79c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.990607:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f413 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.990615:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f413 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.990622:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f413 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762820.990627:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00010000:00010000:3.0:1789762820.990675:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f40c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e79c expref: 16 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.990690:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f413 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e79c expref: 15 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.990699:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:3.0:1789762820.990702:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789762820.990705:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140031600, rc 0) 00000100:00100000:3.0:1789762820.990739:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+15:11170:x1876702140692992:12345-192.168.203.31@tcp:101:rm.0 Request processed in 192us (273us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789762820.990747:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:3.0:1789762820.991452:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762820.991490:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140693120 00000100:00100000:0.0:1789762820.991498:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140693120 00000100:00100000:0.0:1789762820.991534:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:0.0:1789762820.991545:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+15:11170:x1876702140693120:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:0.0:1789762820.991579:0:5813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7614758912 avail 7610564608 00000100:00100000:0.0:1789762820.991614:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+15:11170:x1876702140693120:12345-192.168.203.31@tcp:41:rm.0 Request processed in 72us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762820.991620:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:1.0:1789762820.992320:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762820.992350:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140693376 00000100:00100000:2.0:1789762820.992354:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140693376 00000100:00100000:2.0:1789762820.992380:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:2.0:1789762820.992386:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+15:11170:x1876702140693376:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762820.992406:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762820.992417:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f11f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e780 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.992431:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c56edd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e75d expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.992438:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:2.0:1789762820.992447:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a000/0xd08452c77c56f3f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e78e expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.992452:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:2.0:1789762820.992454:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762820.992463:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96200/0xd08452c77c56f421 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.992470:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96200/0xd08452c77c56f421 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.992478:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96200/0xd08452c77c56f421 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.992491:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f428 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.992509:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.992516:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.992816:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96a00/0xd08452c77c56f42f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.992824:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96a00/0xd08452c77c56f42f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.992829:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96a00/0xd08452c77c56f42f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762820.993688:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8704 00000004:00080000:2.0:1789762820.993696:0:6681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 225466862177ns, next at 226466860778ns, rc = 0 00010000:00010000:2.0:1789762820.993730:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f436 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993740:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993749:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993757:0:6681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f436 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993765:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f436 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993783:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f436 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993800:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762820.993810:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96a00/0xd08452c77c56f42f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993815:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96a00/0xd08452c77c56f42f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993820:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96a00/0xd08452c77c56f42f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762820.993821:0:6671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762820.993829:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f96a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762820.993830:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f436 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993850:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96a00/0xd08452c77c56f42f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993856:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96a00/0xd08452c77c56f42f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993864:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d142a04200) 00010000:00010000:2.0:1789762820.993870:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762820.993875:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762820.993876:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96a00/0xd08452c77c56f42f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762820.993882:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f436 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993885:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96a00/0xd08452c77c56f42f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762820.993903:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f436 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993908:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96200/0xd08452c77c56f421 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993916:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96200/0xd08452c77c56f421 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762820.993920:0:6671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff95d142a04200) 00010000:00010000:1.0:1789762820.993929:0:6671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762820.993932:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96200/0xd08452c77c56f421 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762820.993934:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f436 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993945:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f96200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762820.993951:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96200/0xd08452c77c56f421 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762820.993952:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f436 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993961:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96200/0xd08452c77c56f421 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993969:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:2.0:1789762820.993973:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762820.993977:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96200/0xd08452c77c56f421 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.993986:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96200/0xd08452c77c56f421 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762820.993996:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fb82571 reply state 00000000857994fc transno 4294967410 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762820.994001:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762820.994002:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789762820.994005:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762820.994008:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762820.994040:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+14:11170:x1876702140693376:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1654us (1720us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1789762820.994046:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 145 00010000:00010000:2.0:1789762820.994563:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.994570:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f428 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.994583:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.994586:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f96800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762820.994589:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.994593:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f428 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.994599:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff95d142a04000) 00010000:00010000:2.0:1789762820.994601:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762820.994603:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f428 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.994607:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f428 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762820.994975:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762820.995002:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140693632 00000100:00100000:2.0:1789762820.995007:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140693632 00000100:00100000:2.0:1789762820.995031:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:2.0:1789762820.995037:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15177d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+13:11170:x1876702140693632:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:2.0:1789762820.995125:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15177d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+14:11170:x1876702140693632:12345-192.168.203.31@tcp:35:rm.0 Request processed in 87us (149us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789762820.995135:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1789762820.995770:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762820.995804:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140693888 00000100:00100000:3.0:1789762820.995810:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140693888 00000100:00100000:3.0:1789762820.995868:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:3.0:1789762820.995876:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+14:11170:x1876702140693888:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:3.0:1789762820.995904:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789762820.995915:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f413 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e79c expref: 14 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.995927:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c56ed9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e74f expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.995934:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:3.0:1789762820.995943:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148888a00/0xd08452c77c56ed3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e73a expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.995948:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d143e3f700) 00010000:00010000:3.0:1789762820.995952:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762820.995962:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f43d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.995968:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f43d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.995973:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f43d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.995980:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f444 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.995985:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f444 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.995989:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f444 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996171:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f44b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996178:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f44b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996183:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f44b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762820.996554:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00010000:00010000:3.0:1789762820.996562:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f44b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996567:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f44b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996571:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f44b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996575:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762820.996577:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f44b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996581:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f44b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996587:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff95d15055dc00) 00010000:00010000:3.0:1789762820.996588:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789762820.996591:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f44b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996602:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f44b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996614:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f43d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996617:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f43d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996621:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f43d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996625:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762820.996627:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f43d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996630:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f43d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996635:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055dd00) 00010000:00010000:3.0:1789762820.996636:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762820.996638:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f43d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.996641:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f43d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762820.996647:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ac74634 reply state 000000008685693e transno 4294967412 ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f444 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762820.996652:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762820.996688:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+13:11170:x1876702140693888:12345-192.168.203.31@tcp:36:rm.0 Request processed in 813us (918us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789762820.996694:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 146 00010000:00010000:2.0:1789762820.997121:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f444 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.997130:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f444 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.997141:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f444 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.997144:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762820.997146:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f444 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.997150:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f444 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.997157:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d15055d200) 00010000:00010000:2.0:1789762820.997160:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762820.997163:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f444 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.997170:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f444 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762821.158942:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789762821.786144:0:12598:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 226259308535ns, next at 226466860778ns, rc = 0 00000001:00080000:1.0:1789762821.794919:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000001:00080000:1.0:1789762821.794932:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000004:00080000:1.0:1789762821.794936:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1789762821.794948:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:1.0:1789762821.794952:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000100:00100000:1.0:1789762821.795063:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149016832:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762821.795117:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762821.795145:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149016832 00000100:00100000:2.0:1789762821.795151:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149016832 00000100:00080000:3.0:1789762821.795184:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762821.795212:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789762821.795225:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149016832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789762821.795265:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:8 count 1 00002000:00010000:2.0:1789762821.795290:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 104857600, mtime: 0x6aad9cf0, atime: 0x6aad9cdc, ctime: 0x6aad9cf0, blocks: 0x3200f 00010000:00010000:2.0:1789762821.795297:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000744b274a/0xd08452c77c56f452 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762821.795310:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=226s v=(0 0) 00010000:00010000:2.0:1789762821.795318:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762821.795323:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000744b274a/0xd08452c77c56f452 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762821.795336:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000744b274a/0xd08452c77c56f452 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762821.795343:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000744b274a/0xd08452c77c56f452 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762821.795349:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000744b274a/0xd08452c77c56f452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762821.795363:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762821.795389:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762821.795396:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000744b274a/0xd08452c77c56f452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762821.795404:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762821.795408:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000744b274a/0xd08452c77c56f452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762821.795416:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000744b274a/0xd08452c77c56f452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762821.795430:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000744b274a/0xd08452c77c56f452 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762821.795436:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000744b274a/0xd08452c77c56f452 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762821.795456:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762821.795458:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762821.795459:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762821.795753:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149016832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 532us (634us total) trans 4294967554 rc 0/0 00000100:00100000:2.0:1789762821.795761:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000004:00080000:1.0:1789762821.795784:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d174109880/2, rc 0, transno 4294967554 00000100:00100000:1.0:1789762821.795797:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149016832:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789762821.795947:0:12598:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 226269111663ns, next at 188360175714ns, rc = 0 00000004:00080000:2.0:1789762821.796805:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:1.0:1789762821.818583:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967554 is committed 00010000:00010000:1.0:1789762822.182915:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762823.206919:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762823.846986:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149017088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762823.846994:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149016960:0@lo:400:kworker.0 00000100:00100000:1.0:1789762823.847058:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149017216:0@lo:400:kworker.0 00000100:00100000:3.0:1789762823.847067:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762823.847068:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762823.847112:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762823.847135:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149017472:0@lo:400:kworker.0 00000100:00100000:3.0:1789762823.847136:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149017600:0@lo:400:kworker.0 00000100:00100000:1.0:1789762823.847140:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149017728:0@lo:400:kworker.0 00000100:00100000:2.0:1789762823.847186:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762823.847187:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149017344:0@lo:400:kworker.0 00000100:00100000:3.0:1789762823.847191:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762823.847250:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762823.847270:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149017216 00000100:00100000:3.0:1789762823.847272:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149017472 00000100:00100000:0.0:1789762823.847279:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149017216 00000100:00100000:3.0:1789762823.847280:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149017472 00000100:00100000:1.0:1789762823.847291:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149016960 00000100:00100000:1.0:1789762823.847296:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149016960 00000100:00100000:0.0:1789762823.847326:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149017600 00000100:00100000:0.0:1789762823.847331:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149017600 00000100:00100000:1.0:1789762823.847335:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789762823.847343:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149016960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762823.847348:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789762823.847361:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149017344 00000100:00100000:3.0:1789762823.847363:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149017472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762823.847365:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149017344 00000100:00100000:0.0:1789762823.847390:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789762823.847399:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149016960:12345-0@lo:400:kworker.0 Request processed in 55us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762823.847406:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149017216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762823.847408:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789762823.847413:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789762823.847423:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149017472:12345-0@lo:400:kworker.0 Request processed in 64us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762823.847424:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149017600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762823.847439:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789762823.847454:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149017088 00000100:00100000:1.0:1789762823.847458:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149017088 00000100:00080000:3.0:1789762823.847468:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762823.847470:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149017216:12345-0@lo:400:kworker.0 Request processed in 70us (357us total) trans 0 rc 0/0 00000100:00080000:3.0:1789762823.847473:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762823.847479:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762823.847482:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789762823.847497:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789762823.847507:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149017088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762823.847512:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789762823.847524:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149017344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762823.847530:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149017600:12345-0@lo:400:kworker.0 Request processed in 110us (345us total) trans 0 rc 0/0 00002000:00000024:1.0:1789762823.847546:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762823.847551:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789762823.847577:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149017344:12345-0@lo:400:kworker.0 Request processed in 57us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762823.847585:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789762823.847596:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149017088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762823.847603:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789762823.847607:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967554 gen 2 00000004:00080000:2.0:1789762823.847612:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d174109880, transno 4294967554 00000100:00100000:2.0:1789762823.847638:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149017472:0@lo:400:kworker.0 00000100:00100000:1.0:1789762823.847646:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762823.847648:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149017344:0@lo:400:kworker.0 00000100:00100000:2.0:1789762823.847674:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149017088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762823.847679:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149017728 00000100:00100000:0.0:1789762823.847683:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149017728 00000100:00100000:1.0:1789762823.847697:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149017216:0@lo:400:kworker.0 00000100:00100000:0.0:1789762823.847716:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789762823.847725:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149017728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762823.847750:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149017600:0@lo:400:kworker.0 00000100:00100000:1.0:1789762823.847764:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149016960:0@lo:400:kworker.0 00000100:00100000:0.0:1789762823.847784:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149017728:12345-0@lo:400:kworker.0 Request processed in 61us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762823.847791:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789762823.847856:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149017728:0@lo:400:kworker.0 00000100:00100000:1.0:1789762824.052373:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762824.052402:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762824.052419:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762824.052445:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140694144 00000100:00100000:1.0:1789762824.052454:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762824.052457:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140694144 00000100:00100000:3.0:1789762824.052464:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140694400 00000100:00100000:0.0:1789762824.052465:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140694016 00000100:00100000:3.0:1789762824.052471:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140694400 00000100:00100000:0.0:1789762824.052472:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140694016 00000100:00100000:1.0:1789762824.052506:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140694272 00000100:00100000:1.0:1789762824.052514:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140694272 00000100:00100000:0.0:1789762824.052523:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 261 00000100:00100000:3.0:1789762824.052537:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:0.0:1789762824.052539:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140694016:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762824.052547:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:3.0:1789762824.052553:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140694400:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762824.052560:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:2.0:1789762824.052564:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140694144:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762824.052574:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140694272:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762824.052619:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140694016:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 75us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762824.052622:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140694400:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 62us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762824.052624:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140694144:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 53us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762824.052625:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140694272:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 46us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762824.052640:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 261 00000100:00100000:3.0:1789762824.052646:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:1.0:1789762824.052647:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:2.0:1789762824.052669:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00080000:3.0:1789762824.052703:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762824.052709:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789762824.230982:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762824.359005:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789762824.359030:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149017856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762824.359104:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762824.359187:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149017856 00000100:00100000:3.0:1789762824.359198:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149017856 00000100:00100000:3.0:1789762824.359269:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789762824.359281:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149017856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762824.359313:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 439549952 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762824.359358:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149017856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762824.359363:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789762824.359411:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149017856:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789762825.254910:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762826.278950:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762827.302933:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762828.326989:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762828.966969:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149017984:0@lo:400:kworker.0 00000100:00100000:3.0:1789762828.966986:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149018240:0@lo:400:kworker.0 00000100:00100000:1.0:1789762828.967013:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149018112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762828.967048:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762828.967052:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149018368:0@lo:400:kworker.0 00000100:00100000:1.0:1789762828.967061:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762828.967069:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762828.967109:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149018624:0@lo:400:kworker.0 00000100:00100000:0.0:1789762828.967110:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762828.967119:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149018496:0@lo:400:kworker.0 00000100:00100000:3.0:1789762828.967119:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149018752:0@lo:400:kworker.0 00000100:00100000:1.0:1789762828.967160:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762828.967166:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762828.967179:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149018240 00000100:00100000:0.0:1789762828.967183:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149018112 00000100:00100000:3.0:1789762828.967186:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149018240 00000100:00100000:0.0:1789762828.967189:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149018112 00000100:00100000:1.0:1789762828.967215:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149018368 00000100:00100000:1.0:1789762828.967220:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149018368 00000100:00100000:2.0:1789762828.967238:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149017984 00000100:00100000:2.0:1789762828.967245:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149017984 00000100:00100000:3.0:1789762828.967251:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149018624 00000100:00100000:3.0:1789762828.967255:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149018624 00000100:00100000:1.0:1789762828.967260:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789762828.967267:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789762828.967273:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149018240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762828.967279:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149018112:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762828.967288:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789762828.967293:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789762828.967299:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149017984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762828.967301:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149018368:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789762828.967307:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762828.967322:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149018240:12345-0@lo:400:kworker.0 Request processed in 53us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762828.967329:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789762828.967352:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789762828.967360:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149018624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762828.967367:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149017984:12345-0@lo:400:kworker.0 Request processed in 68us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762828.967367:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149018368:12345-0@lo:400:kworker.0 Request processed in 65us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762828.967374:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149018112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762828.967380:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789762828.967381:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789762828.967390:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149018624:12345-0@lo:400:kworker.0 Request processed in 31us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762828.967396:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789762828.967401:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789762828.967414:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149018496 00000100:00100000:3.0:1789762828.967420:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149018496 00000100:00100000:3.0:1789762828.967460:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789762828.967472:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149018112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762828.967473:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149018496:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789762828.967474:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762828.967482:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762828.967489:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762828.967491:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149018624:0@lo:400:kworker.0 00000100:00100000:0.0:1789762828.967518:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149018368:0@lo:400:kworker.0 00000100:00100000:3.0:1789762828.967538:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149018496:12345-0@lo:400:kworker.0 Request processed in 68us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762828.967546:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789762828.967571:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762828.967608:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149018240:0@lo:400:kworker.0 00000100:00100000:3.0:1789762828.967651:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149018496:0@lo:400:kworker.0 00000100:00100000:0.0:1789762828.967652:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149018752 00000100:00100000:0.0:1789762828.967658:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149018752 00000100:00100000:3.0:1789762828.967668:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149017984:0@lo:400:kworker.0 00000100:00100000:0.0:1789762828.967697:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789762828.967706:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149018752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762828.967746:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149018752:12345-0@lo:400:kworker.0 Request processed in 43us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762828.967751:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789762828.967779:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149018752:0@lo:400:kworker.0 00000100:00100000:3.0:1789762829.172304:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762829.172333:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762829.172356:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140694528 00000100:00100000:3.0:1789762829.172363:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762829.172367:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140694528 00000100:00100000:1.0:1789762829.172383:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140694656 00000100:00100000:1.0:1789762829.172390:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140694656 00000100:00100000:3.0:1789762829.172397:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762829.172413:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140694784 00000100:00100000:2.0:1789762829.172420:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140694784 00000100:00100000:0.0:1789762829.172435:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 263 00000100:00100000:1.0:1789762829.172449:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140694912 00000100:00100000:0.0:1789762829.172450:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140694528:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762829.172453:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140694912 00000100:00100000:3.0:1789762829.172459:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:2.0:1789762829.172469:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:3.0:1789762829.172475:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140694656:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762829.172484:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140694784:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762829.172490:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:1.0:1789762829.172500:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140694912:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762829.172518:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140694528:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 73us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762829.172526:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140694656:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 54us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762829.172528:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 263 00000100:00100000:2.0:1789762829.172534:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140694784:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 51us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762829.172540:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140694912:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 40us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762829.172550:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:2.0:1789762829.172554:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:1.0:1789762829.172560:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00080000:2.0:1789762829.172610:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789762829.172616:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789762829.350966:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762829.479049:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149018880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762829.479118:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762829.479170:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149018880 00000100:00100000:3.0:1789762829.479181:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149018880 00000100:00100000:3.0:1789762829.479251:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789762829.479264:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149018880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762829.479301:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 439549952 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762829.479356:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149018880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762829.479383:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789762829.479389:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149018880:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789762830.374990:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762831.398927:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762832.422999:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762833.446957:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762834.087061:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149019136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762834.087098:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17412ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149019008:0@lo:400:kworker.0 00000100:00100000:0.0:1789762834.087192:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762834.087193:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762834.087246:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149019008 00000100:00100000:2.0:1789762834.087260:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149019008 00000100:00100000:0.0:1789762834.087278:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17412e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149019648:0@lo:400:kworker.0 00000100:00100000:0.0:1789762834.087317:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762834.087333:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789762834.087346:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149019008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762834.087357:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149019136 00000100:00100000:1.0:1789762834.087368:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149019136 00000100:00100000:2.0:1789762834.087432:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149019008:12345-0@lo:400:kworker.0 Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762834.087440:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789762834.087457:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789762834.087475:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149019136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762834.087492:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149019648 00000100:00100000:0.0:1789762834.087497:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149019648 00002000:00000024:1.0:1789762834.087521:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762834.087539:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17412ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149019008:0@lo:400:kworker.0 00000100:00100000:3.0:1789762834.087552:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17412dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149019520:0@lo:400:kworker.0 00000100:00100000:0.0:1789762834.087563:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789762834.087576:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149019648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762834.087614:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149019136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762834.087628:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762834.087633:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789762834.087642:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149019648:12345-0@lo:400:kworker.0 Request processed in 68us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762834.087650:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789762834.087711:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17412e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149019648:0@lo:400:kworker.0 00000100:00100000:3.0:1789762834.087721:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17412c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149019264:0@lo:400:kworker.0 00000100:00080000:1.0:1789762834.087724:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762834.087735:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762834.087736:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149019136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762834.087767:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762834.087815:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17412c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149019776:0@lo:400:kworker.0 00000100:00100000:3.0:1789762834.087914:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762834.087954:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789762834.087961:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17412f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149019392:0@lo:400:kworker.0 00000100:00100000:0.0:1789762834.087966:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149019520 00000100:00100000:0.0:1789762834.087971:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149019520 00000100:00100000:1.0:1789762834.087978:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149019264 00000100:00100000:1.0:1789762834.087985:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149019264 00000100:00100000:3.0:1789762834.087997:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762834.088031:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149019776 00000100:00100000:0.0:1789762834.088038:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149019776 00000100:00100000:1.0:1789762834.088038:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149019392 00000100:00100000:3.0:1789762834.088045:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789762834.088047:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149019392 00000100:00100000:3.0:1789762834.088058:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149019520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762834.088096:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789762834.088103:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789762834.088105:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149019520:12345-0@lo:400:kworker.0 Request processed in 52us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762834.088109:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149019776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762834.088121:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789762834.088123:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149019264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762834.088169:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789762834.088185:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149019392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762834.088197:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149019776:12345-0@lo:400:kworker.0 Request processed in 90us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762834.088206:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789762834.088213:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149019264:12345-0@lo:400:kworker.0 Request processed in 94us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762834.088225:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789762834.088258:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149019392:12345-0@lo:400:kworker.0 Request processed in 78us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762834.088264:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1789762834.088273:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762834.088277:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762834.088340:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17412dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149019520:0@lo:400:kworker.0 00000100:00100000:3.0:1789762834.088403:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17412f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149019392:0@lo:400:kworker.0 00000100:00100000:3.0:1789762834.088417:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17412c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149019264:0@lo:400:kworker.0 00000100:00100000:3.0:1789762834.088425:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17412c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149019776:0@lo:400:kworker.0 00000100:00100000:1.0:1789762834.292443:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762834.292489:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762834.292513:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140695040 00000100:00100000:1.0:1789762834.292524:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762834.292528:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140695040 00000100:00100000:3.0:1789762834.292536:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140695168 00000100:00100000:3.0:1789762834.292543:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140695168 00000100:00100000:1.0:1789762834.292600:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762834.292605:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 265 00000100:00100000:0.0:1789762834.292621:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140695040:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762834.292626:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140695424 00000100:00100000:2.0:1789762834.292627:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140695296 00000100:00100000:3.0:1789762834.292633:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140695424 00000100:00100000:2.0:1789762834.292642:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140695296 00000100:00100000:1.0:1789762834.292651:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:1.0:1789762834.292668:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140695168:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762834.292684:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:3.0:1789762834.292698:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140695424:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762834.292719:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140695040:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 100us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762834.292727:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140695168:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 61us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762834.292734:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 265 00000100:00100000:2.0:1789762834.292739:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:3.0:1789762834.292752:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140695424:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 52us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762834.292765:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:2.0:1789762834.292767:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140695296:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762834.292782:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00080000:1.0:1789762834.292830:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789762834.292875:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762834.292899:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140695296:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 143us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762834.292908:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00010000:00010000:1.0:1789762834.470995:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762834.599091:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149019904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762834.599204:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762834.599261:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149019904 00000100:00100000:3.0:1789762834.599271:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149019904 00000100:00100000:3.0:1789762834.599332:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789762834.599342:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149019904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762834.599383:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 439549952 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762834.599436:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149019904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762834.599442:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789762834.599491:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149019904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789762835.495935:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762836.277095:0:12972:0:(nrs_tbf.c:670:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff95d147246800 key gid={500} rule@0xffff95d150482000 gen 0 rate 5 depth 3 token 0 deadline 225420679639 time 225420759709 state 0x6 ref 0 00000100:00100000:3.0:1789762836.277108:0:12972:0:(nrs_tbf.c:670:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff95d158361e00 key gid={0} rule@0xffff95d150482e00 gen 0 rate 10000 depth 3 token 2 deadline 183583940388 time 185191345999 state 0x6 ref 0 00000100:00100000:3.0:1789762836.289080:0:12972:0:(nrs_tbf.c:670:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff95d041355800 key gid={0} rule@0xffff95d150482500 gen 0 rate 10000 depth 3 token 2 deadline 183513552625 time 183513506809 state 0x6 ref 0 00010000:00010000:3.0:1789762836.519010:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762837.542909:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762838.566941:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762839.207060:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149020032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762839.207066:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17412c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149020160:0@lo:400:kworker.0 00000100:00100000:3.0:1789762839.207083:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17412c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149020288:0@lo:400:kworker.0 00000100:00100000:2.0:1789762839.207164:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17412f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149020416:0@lo:400:kworker.0 00000100:00100000:1.0:1789762839.207197:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762839.207199:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762839.207203:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762839.207243:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762839.207290:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17412f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149020800:0@lo:400:kworker.0 00000100:00100000:1.0:1789762839.207294:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17412ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149020672:0@lo:400:kworker.0 00000100:00100000:0.0:1789762839.207303:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17412ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149020544:0@lo:400:kworker.0 00000100:00100000:2.0:1789762839.207332:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149020032 00000100:00100000:2.0:1789762839.207343:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149020032 00000100:00100000:3.0:1789762839.207359:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762839.207364:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762839.207391:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149020288 00000100:00100000:0.0:1789762839.207398:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149020288 00000100:00100000:2.0:1789762839.207439:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789762839.207452:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149020032:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762839.207467:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149020416 00000100:00100000:0.0:1789762839.207469:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149020672 00000100:00100000:0.0:1789762839.207478:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149020672 00000100:00100000:1.0:1789762839.207480:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149020416 00000100:00100000:3.0:1789762839.207495:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149020160 00000100:00100000:3.0:1789762839.207501:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149020160 00002000:00000024:2.0:1789762839.207505:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762839.207531:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789762839.207542:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149020288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762839.207545:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789762839.207553:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789762839.207566:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149020672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762839.207568:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149020160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762839.207584:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149020032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762839.207594:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789762839.207614:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149020288:12345-0@lo:400:kworker.0 Request processed in 70us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762839.207621:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789762839.207652:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789762839.207657:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149020160:12345-0@lo:400:kworker.0 Request processed in 93us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762839.207668:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149020672:12345-0@lo:400:kworker.0 Request processed in 106us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762839.207669:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149020416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762839.207681:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789762839.207682:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149020800 00000100:00100000:2.0:1789762839.207694:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149020800 00000100:00100000:1.0:1789762839.207704:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789762839.207753:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149020416:12345-0@lo:400:kworker.0 Request processed in 85us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762839.207758:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789762839.207768:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1789762839.207773:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762839.207779:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149020800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762839.207785:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762839.207791:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17412c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149020288:0@lo:400:kworker.0 00000100:00100000:0.0:1789762839.207884:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17412f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149020416:0@lo:400:kworker.0 00000100:00100000:2.0:1789762839.207893:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149020800:12345-0@lo:400:kworker.0 Request processed in 118us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762839.207902:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17412f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149020800:0@lo:400:kworker.0 00000100:00100000:2.0:1789762839.207912:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789762839.207917:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17412ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149020672:0@lo:400:kworker.0 00000100:00100000:0.0:1789762839.207932:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762839.207944:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17412c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149020160:0@lo:400:kworker.0 00000100:00100000:2.0:1789762839.207972:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149020544 00000100:00100000:2.0:1789762839.207982:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149020544 00000100:00100000:0.0:1789762839.208002:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149020032:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789762839.208011:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762839.208042:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789762839.208058:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149020544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762839.208101:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149020544:12345-0@lo:400:kworker.0 Request processed in 51us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762839.208106:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789762839.208141:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17412ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149020544:0@lo:400:kworker.0 00000100:00100000:1.0:1789762839.412306:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762839.412346:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762839.412377:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762839.412377:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140695680 00000100:00100000:3.0:1789762839.412394:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140695552 00000100:00100000:2.0:1789762839.412396:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140695680 00000100:00100000:3.0:1789762839.412407:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140695552 00000100:00100000:1.0:1789762839.412420:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762839.412456:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140695936 00000100:00100000:0.0:1789762839.412464:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140695936 00000100:00100000:1.0:1789762839.412468:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140695808 00000100:00100000:1.0:1789762839.412474:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140695808 00000100:00100000:3.0:1789762839.412502:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 267 00000100:00100000:3.0:1789762839.412523:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140695552:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762839.412534:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:1.0:1789762839.412545:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:1.0:1789762839.412560:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140695808:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762839.412562:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:2.0:1789762839.412570:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140695680:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762839.412580:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140695936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762839.412614:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140695552:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 99us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762839.412623:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 267 00000100:00100000:1.0:1789762839.412632:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140695808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762839.412643:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:2.0:1789762839.412655:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140695680:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 88us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762839.412663:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140695936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 79us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762839.412673:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:0.0:1789762839.412680:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00080000:3.0:1789762839.412730:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762839.412736:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789762839.590935:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762839.720062:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149020928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762839.720166:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762839.720230:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149020928 00000100:00100000:0.0:1789762839.720243:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149020928 00000100:00100000:0.0:1789762839.720303:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789762839.720317:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149020928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762839.720359:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 439549952 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762839.720435:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149020928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762839.720445:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789762839.720498:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149020928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762840.614940:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762840.770904:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762840.770946:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140696064 00000100:00100000:1.0:1789762840.770956:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140696064 00000100:00100000:1.0:1789762840.771015:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:1.0:1789762840.771029:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+5:10188:x1876702140696064:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1789762840.771048:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762840.771068:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c56f459 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7a3 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.771141:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56f460 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.771167:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56f460 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.771182:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56f460 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762840.771219:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789762840.771224:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762840.771241:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56f460 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.771267:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c56f459 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7a3 expref: 7 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.771283:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56f460 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7a3 expref: 6 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.771293:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2100) 00010000:00010000:1.0:1789762840.771296:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762840.771300:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003f000, rc 0) 00000100:00100000:1.0:1789762840.771361:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+6:10188:x1876702140696064:12345-192.168.203.31@tcp:101:bash.0 Request processed in 335us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762840.771369:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:1.0:1789762840.772401:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762840.772490:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140696192 00000100:00100000:2.0:1789762840.772502:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140696192 00000100:00100000:2.0:1789762840.772555:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:2.0:1789762840.772564:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+6:10188:x1876702140696192:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1789762840.772580:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762840.772596:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97800/0xd08452c77c56f467 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7aa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.772646:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96600/0xd08452c77c56f46e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.772657:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96600/0xd08452c77c56f46e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.772666:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96600/0xd08452c77c56f46e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.772676:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f475 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.772681:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.772697:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.772959:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96600/0xd08452c77c56f46e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.772965:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96600/0xd08452c77c56f46e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.772971:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96600/0xd08452c77c56f46e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.772976:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f96600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762840.772980:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96600/0xd08452c77c56f46e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.772986:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96600/0xd08452c77c56f46e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.772995:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2100) 00010000:00010000:2.0:1789762840.772998:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762840.773001:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96600/0xd08452c77c56f46e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.773006:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96600/0xd08452c77c56f46e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.773014:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.773019:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f475 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.773028:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f475 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.773032:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f96e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762840.773034:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f475 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.773038:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f475 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.773042:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff95d142a04600) 00010000:00010000:2.0:1789762840.773044:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762840.773045:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f475 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.773049:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f475 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.773072:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97800/0xd08452c77c56f467 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7aa expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.773079:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2100) 00010000:00010000:2.0:1789762840.773080:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762840.773083:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97800/0xd08452c77c56f467 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7aa expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.773089:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f97800, rc 0) 00000100:00100000:2.0:1789762840.773153:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+6:10188:x1876702140696192:12345-192.168.203.31@tcp:101:bash.0 Request processed in 590us (754us total) trans 0 rc 301/301 00000100:00100000:2.0:1789762840.773166:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 148 00000001:02000400:3.0:1789762841.285487:0:13167:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 16:20:40 (1789762840) 00010000:00010000:1.0:1789762841.638917:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762841.708592:0:13215:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:3.0:1789762841.708606:0:13215:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d044b75e00 rate 10000 gen 0 00000100:00100000:3.0:1789762841.708636:0:13215:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:3.0:1789762841.708638:0:13215:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d044b75b00 rate 10000 gen 0 00000100:00100000:3.0:1789762841.708787:0:13215:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:3.0:1789762841.708795:0:13215:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:3.0:1789762841.708806:0:13215:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:3.0:1789762841.708810:0:13215:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:3.0:1789762841.708814:0:13215:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:3.0:1789762841.708816:0:13215:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d044b75a00 rate 20 gen 0 00000100:00100000:3.0:1789762841.708818:0:13215:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:3.0:1789762841.708822:0:13215:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:3.0:1789762841.708825:0:13215:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:3.0:1789762841.708829:0:13215:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d044b75700 rate 20 gen 0 00000100:00100000:3.0:1789762841.708944:0:13215:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:3.0:1789762841.708949:0:13215:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:3.0:1789762841.709016:0:13215:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:3.0:1789762841.709021:0:13215:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:3.0:1789762841.709024:0:13215:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:3.0:1789762841.709027:0:13215:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d044b75800 rate 10 gen 0 00000100:00100000:3.0:1789762841.709029:0:13215:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:3.0:1789762841.709032:0:13215:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:3.0:1789762841.709034:0:13215:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:3.0:1789762841.709038:0:13215:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d044b75000 rate 10 gen 0 00000100:00100000:1.0:1789762841.721568:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762841.721614:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140696320 00000100:00100000:0.0:1789762841.721626:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140696320 00000100:00100000:1.0:1789762841.721637:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762841.721685:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140696576 00000100:00100000:0.0:1789762841.721688:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140696576 00000100:00100000:1.0:1789762841.721703:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00080000:3.0:1789762841.721706:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762841.721721:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+7:2342:x1876702140696320:12345-192.168.203.31@tcp:41:mkdir.0 00000100:00100000:3.0:1789762841.721737:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:3.0:1789762841.721748:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+7:12162:x1876702140696576:12345-192.168.203.31@tcp:36:mkdir.0 00000004:00000024:1.0:1789762841.721759:0:7603:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00010000:00010000:3.0:1789762841.721788:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762841.721813:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56f460 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7a3 expref: 7 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762841.721822:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+7:2342:x1876702140696320:12345-192.168.203.31@tcp:41:mkdir.0 Request processed in 101us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762841.721853:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 149 00010000:00010000:3.0:1789762841.722035:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2100) 00010000:00010000:3.0:1789762841.722052:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762841.722303:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f47c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.722319:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f47c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.722331:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f47c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.722348:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f483 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.722357:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f483 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.722365:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f483 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762841.723436:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 16384 00010000:00010000:3.0:1789762841.723446:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f47c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.723452:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f47c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.723458:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f47c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.723462:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762841.723465:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f47c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.723481:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f47c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.723488:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d100) 00010000:00010000:3.0:1789762841.723490:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762841.723493:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f47c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.723498:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f47c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762841.723511:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a64bf55f reply state 00000000950beaac transno 4294967413 ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f483 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762841.723518:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762841.723570:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+7:12162:x1876702140696576:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 1824us (1933us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789762841.723580:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 150 00010000:00010000:3.0:1789762841.724007:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f483 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.724014:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f483 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.724021:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f483 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.724025:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762841.724028:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f483 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.724042:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f483 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.724051:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055d300) 00010000:00010000:3.0:1789762841.724053:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762841.724056:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f483 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.724061:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f483 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762841.730257:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762841.730293:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140696704 00000100:00100000:2.0:1789762841.730309:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140696704 00000100:00100000:2.0:1789762841.730350:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:2.0:1789762841.730360:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+6:12163:x1876702140696704:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762841.730377:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762841.730391:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97800/0xd08452c77c56f48a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7b1 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.730463:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96000/0xd08452c77c56f491 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.730472:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96000/0xd08452c77c56f491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.730480:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96000/0xd08452c77c56f491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762841.730499:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762841.730502:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762841.730516:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96000/0xd08452c77c56f491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.730532:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97800/0xd08452c77c56f48a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7b1 expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.730544:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96000/0xd08452c77c56f491 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7b1 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.730561:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04600) 00010000:00010000:2.0:1789762841.730563:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762841.730565:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f96000, rc 0) 00000100:00100000:2.0:1789762841.730601:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+7:12163:x1876702140696704:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 243us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762841.730607:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:1.0:1789762841.731718:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762841.731761:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140696960 00000100:00100000:2.0:1789762841.731767:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140696960 00000100:00100000:2.0:1789762841.731803:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:2.0:1789762841.731812:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+7:12163:x1876702140696960:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762841.731820:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762841.731822:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789762841.731852:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96000/0xd08452c77c56f491 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7b1 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.731864:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04600) 00010000:00010000:2.0:1789762841.731875:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762841.731884:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f498 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7b8 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.731957:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f49f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.731964:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f49f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.731969:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f49f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.731987:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f4a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.731993:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.731997:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732042:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f4ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732047:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732052:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762841.732057:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 16384 00010000:00010000:2.0:1789762841.732065:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732070:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f4ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732074:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f4ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732079:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762841.732081:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f4ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732095:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f4ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732120:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d142a04900) 00010000:00010000:2.0:1789762841.732122:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762841.732125:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f4ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732130:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56f4ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732143:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f49f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732147:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f49f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732152:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f49f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732155:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762841.732157:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f49f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732161:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f49f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732168:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04500) 00010000:00010000:2.0:1789762841.732171:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762841.732174:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f49f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732193:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f49f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732204:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732211:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f4a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732219:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732225:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762841.732229:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732234:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f4a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732240:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d142a04100) 00010000:00010000:2.0:1789762841.732243:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762841.732245:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f4a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732249:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f4a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732269:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f498 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7b8 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732284:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04500) 00010000:00010000:2.0:1789762841.732286:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762841.732289:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f498 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7b8 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.732297:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f96c00, rc 0) 00000100:00100000:2.0:1789762841.732329:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+6:12163:x1876702140696960:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 519us (612us total) trans 0 rc 301/301 00000100:00100000:2.0:1789762841.732334:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:3.0:1789762841.733311:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762841.733345:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140697088 00000100:00100000:1.0:1789762841.733351:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140697088 00000100:00100000:1.0:1789762841.733384:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:1.0:1789762841.733391:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+6:12163:x1876702140697088:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789762841.733400:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762841.733411:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56f4b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7bf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.733438:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56f4bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.733445:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56f4bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.733451:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56f4bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762841.733464:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789762841.733466:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762841.733476:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56f4bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.733488:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56f4b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7bf expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.733507:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56f4bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7bf expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.733512:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:1.0:1789762841.733514:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762841.733516:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003f600, rc 0) 00000100:00100000:1.0:1789762841.733547:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+7:12163:x1876702140697088:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 156us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762841.733553:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:1.0:1789762841.734517:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762841.734550:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140697344 00000100:00100000:3.0:1789762841.734556:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140697344 00000100:00100000:3.0:1789762841.734587:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:3.0:1789762841.734597:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+7:12163:x1876702140697344:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762841.734605:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762841.734614:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f4c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7c6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734651:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f4c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734662:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f4c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734672:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f4c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734687:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f4d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734698:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734704:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762841.734747:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 16384 00010000:00010000:3.0:1789762841.734800:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f4c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734805:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f4c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734809:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f4c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734812:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762841.734814:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f4c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734818:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f4c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734824:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:3.0:1789762841.734826:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762841.734828:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f4c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734858:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f4c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734875:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734880:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f4d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734884:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f4d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734888:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762841.734890:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f4d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734894:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f4d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734900:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055d300) 00010000:00010000:3.0:1789762841.734901:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762841.734903:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f4d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734907:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f4d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734927:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f4c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7c6 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734933:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:3.0:1789762841.734935:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762841.734943:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f4c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7c6 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.734949:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030800, rc 0) 00000100:00100000:3.0:1789762841.734977:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+8:12163:x1876702140697344:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 384us (461us total) trans 4294967414 rc 301/301 00000100:00100000:3.0:1789762841.734982:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:1.0:1789762841.736088:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762841.736128:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140697600 00000100:00100000:0.0:1789762841.736134:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140697600 00000100:00100000:0.0:1789762841.736166:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:0.0:1789762841.736174:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+8:12163:x1876702140697600:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:0.0:1789762841.736207:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f4de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.736216:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f4de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.736223:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f4de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762841.736343:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6d6d5d9 reply state 00000000cd5b51a5 transno 4294967415 ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f4de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762841.736349:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789762841.736354:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 16384 00000100:00100000:0.0:1789762841.736398:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+10:12163:x1876702140697600:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 226us (312us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789762841.736405:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 155 00010000:00010000:2.0:1789762841.736920:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f4de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.736930:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f4de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.736935:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f4de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.736940:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ac00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762841.736943:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f4de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.736948:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f4de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.736956:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d151e90a00) 00010000:00010000:2.0:1789762841.736959:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789762841.736961:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f4de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.736973:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f4de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762841.737054:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762841.737088:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140697856 00000100:00100000:2.0:1789762841.737093:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140697856 00000100:00100000:2.0:1789762841.737139:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1789762841.737150:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+9:12163:x1876702140697856:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1789762841.737269:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+10:12163:x1876702140697856:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 122us (216us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789762841.737275:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1789762841.741952:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762841.741988:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140697984 00000100:00100000:1.0:1789762841.741996:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140697984 00000100:00100000:1.0:1789762841.742043:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:1.0:1789762841.742055:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+10:12164:x1876702140697984:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:1.0:1789762841.742070:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762841.742081:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56f4e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7cd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742135:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f4ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742146:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f4ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742155:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f4ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742181:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f4f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742189:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742198:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742260:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f4fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742267:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f4fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742272:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f4fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762841.742288:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 16384 00000004:00200000:1.0:1789762841.742290:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762841.742300:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f4fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742307:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f4ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742312:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f4ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742317:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f4ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742329:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fa00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762841.742331:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f4ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742336:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f4ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742346:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:1.0:1789762841.742348:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762841.742351:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f4ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742355:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f4ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742365:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742369:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f4f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742374:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742378:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762841.742380:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742384:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f4f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742399:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d14abf2700) 00010000:00010000:1.0:1789762841.742401:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762841.742403:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f4f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742407:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f4f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742429:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56f4e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7cd expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742446:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f4fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7cd expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.742454:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d14abf2500) 00010000:00010000:1.0:1789762841.742458:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762841.742461:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003ec00, rc 0) 00000100:00100000:1.0:1789762841.742507:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+11:12164:x1876702140697984:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 455us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762841.742517:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:1.0:1789762841.743754:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762841.743792:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140698240 00000100:00100000:3.0:1789762841.743799:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140698240 00000100:00100000:3.0:1789762841.743866:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:3.0:1789762841.743879:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+11:12164:x1876702140698240:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:3.0:1789762841.743905:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762841.743921:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f4fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7cd expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.743937:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d14abf2500) 00010000:00010000:3.0:1789762841.743944:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762841.743959:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f501 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.743966:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.743972:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762841.744082:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000880df593 reply state 0000000044b794d4 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762841.744089:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762841.744115:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 16384 00000100:00100000:3.0:1789762841.744156:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+12:12164:x1876702140698240:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 282us (403us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789762841.744161:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 157 00010000:00010000:3.0:1789762841.744681:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.744689:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f501 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.744694:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f501 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.744697:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762841.744700:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f501 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.744705:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f501 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.744712:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d15055d300) 00010000:00010000:3.0:1789762841.744714:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789762841.744717:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f501 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.744721:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f501 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762841.759915:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762841.759957:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140698368 00000100:00100000:0.0:1789762841.759968:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140698368 00000100:00100000:0.0:1789762841.760023:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:0.0:1789762841.760034:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+11:12168:x1876702140698368:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762841.760052:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762841.760067:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a600/0xd08452c77c56f508 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7d4 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760131:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a400/0xd08452c77c56f50f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760142:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a400/0xd08452c77c56f50f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760150:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a400/0xd08452c77c56f50f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760159:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b000/0xd08452c77c56f516 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760173:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b000/0xd08452c77c56f516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760177:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b000/0xd08452c77c56f516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760253:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f51d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760258:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760262:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762841.760276:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 16384 00000004:00200000:0.0:1789762841.760279:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762841.760291:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760299:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a400/0xd08452c77c56f50f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760303:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a400/0xd08452c77c56f50f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760308:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a400/0xd08452c77c56f50f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760312:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762841.760315:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a400/0xd08452c77c56f50f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760324:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a400/0xd08452c77c56f50f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760333:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:0.0:1789762841.760335:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762841.760338:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a400/0xd08452c77c56f50f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760341:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a400/0xd08452c77c56f50f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760349:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b000/0xd08452c77c56f516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760353:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b000/0xd08452c77c56f516 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760357:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b000/0xd08452c77c56f516 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760360:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762841.760361:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b000/0xd08452c77c56f516 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760365:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b000/0xd08452c77c56f516 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760369:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d151e90b00) 00010000:00010000:0.0:1789762841.760370:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762841.760372:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b000/0xd08452c77c56f516 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760382:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b000/0xd08452c77c56f516 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760404:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a600/0xd08452c77c56f508 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7d4 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760413:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f51d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7d4 expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.760418:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d151e90400) 00010000:00010000:0.0:1789762841.760419:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789762841.760421:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16002b400, rc 0) 00000100:00100000:0.0:1789762841.760470:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+12:12168:x1876702140698368:12345-192.168.203.31@tcp:101:dd.500 Request processed in 440us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762841.760475:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:0.0:1789762841.761342:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762841.761377:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140698624 00000100:00100000:1.0:1789762841.761386:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140698624 00000100:00100000:1.0:1789762841.761431:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:1.0:1789762841.761443:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+12:12168:x1876702140698624:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:1.0:1789762841.761460:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762841.761494:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56f524 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7db expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.761615:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f52b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.761627:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f52b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.761635:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f52b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.761646:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f532 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.761651:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.761655:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789762841.763552:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x9:0x0], index 0: 0 00000004:00080000:1.0:1789762841.763564:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1789762841.763718:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c56f539 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.763730:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c56f539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.763736:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c56f539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.763762:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f52b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.763772:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f52b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.763777:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f52b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.763780:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762841.763782:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f52b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.763787:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f52b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.763793:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d151e90400) 00010000:00010000:1.0:1789762841.763795:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762841.763797:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f52b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.763801:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f52b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762841.763809:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060fa4c14 reply state 0000000063a5e781 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762841.763814:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789762841.763849:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56f524 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7db expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.763859:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c56f539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7db expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.763873:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:1.0:1789762841.763875:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762841.763877:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003e000, rc 0) 00000100:00100000:1.0:1789762841.763919:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+15:12168:x1876702140698624:12345-192.168.203.31@tcp:101:dd.500 Request processed in 2479us (2576us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789762841.763929:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 159 00010000:00010000:2.0:1789762841.764399:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.764407:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f532 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.764412:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.764416:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fa00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762841.764418:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.764422:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f532 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.764430:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0xf4d4877e (ffff95d14abf2700) 00010000:00010000:2.0:1789762841.764432:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762841.764441:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f532 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.764445:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f532 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762841.766220:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762841.766297:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140698752 00000100:00100000:3.0:1789762841.766303:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140698752 00000100:00080000:1.0:1789762841.766338:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762841.766349:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:3.0:1789762841.766358:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:12168:x1876702140698752:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:3.0:1789762841.766375:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762841.766385:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56f547 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7e2 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762841.766403:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789762841.766415:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=246s v=(0 0) 00010000:00010000:3.0:1789762841.766418:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762841.766425:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56f547 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7e2 expref: 6 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.766436:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56f547 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7e2 expref: 6 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.766444:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030800, rc 0) 00000100:00100000:3.0:1789762841.766471:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+6:12168:x1876702140698752:12345-192.168.203.31@tcp:101:dd.500 Request processed in 116us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762841.766477:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:3.0:1789762841.773381:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762841.773456:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140698880 00000100:00100000:0.0:1789762841.773462:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140698880 00002000:00100000:0.0:1789762841.773490:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (0->1048575) req@ffff95d17412c000 x1876702140698880/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762841.773499:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412c000 with x1876702140698880 ext(0->1048575) 00002000:00010000:0.0:1789762841.773502:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17412c000 00000100:00100000:0.0:1789762841.773521:0:6660:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 3 deadline 0 time 246246680441 state 0x0 ref 1 00000100:00100000:0.0:1789762841.773530:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 3 deadline 246296680441 time 246246680441 state 0x1 ref 1 00000100:00100000:0.0:1789762841.773567:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 2 deadline 246296680441 time 246246728641 state 0x0 ref 1 00000100:00100000:0.0:1789762841.773576:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140698880:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762841.779493:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140698880:12345-192.168.203.31@tcp:4:dd.500 Request processed in 5914us (6111us total) trans 4294967555 rc 0/0 00000100:00100000:0.0:1789762841.779506:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1789762841.779517:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 2 deadline 246296680441 time 246246728641 state 0x2 ref 0 00002000:00100000:0.0:1789762841.779531:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (0->1048575) req@ffff95d17412c000 x1876702140698880/t4294967555(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762841.779542:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412c000 with x1876702140698880 ext(0->1048575) 00002000:00010000:0.0:1789762841.779547:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17412c000 00000100:00100000:1.0:1789762841.781155:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762841.781184:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140699008 00000100:00100000:3.0:1789762841.781191:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140699008 00002000:00100000:3.0:1789762841.781213:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x9:0x0] (1048576->2097151) req@ffff95d17463ca80 x1876702140699008/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762841.781221:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463ca80 with x1876702140699008 ext(1048576->2097151) 00002000:00010000:3.0:1789762841.781224:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463ca80 00000100:00100000:3.0:1789762841.781234:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 2 deadline 246296680441 time 246246728641 state 0x0 ref 1 00000100:00100000:3.0:1789762841.781250:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 2 deadline 246296728641 time 246246728641 state 0x1 ref 1 00000100:00100000:3.0:1789762841.781271:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 1 deadline 246296728641 time 246254434461 state 0x0 ref 1 00000100:00100000:3.0:1789762841.781281:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140699008:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:3.0:1789762841.783651:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+10:2345:x1876702140699008:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2368us (2493us total) trans 4294967556 rc 0/0 00000100:00100000:3.0:1789762841.783661:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:3.0:1789762841.783669:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 1 deadline 246296728641 time 246254434461 state 0x2 ref 0 00002000:00100000:3.0:1789762841.783681:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x9:0x0] (1048576->2097151) req@ffff95d17463ca80 x1876702140699008/t4294967556(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762841.783691:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463ca80 with x1876702140699008 ext(1048576->2097151) 00002000:00010000:3.0:1789762841.783696:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463ca80 00000100:00100000:0.0:1789762841.790737:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762841.790781:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140699136 00000100:00100000:2.0:1789762841.790788:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140699136 00002000:00100000:2.0:1789762841.790817:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x9:0x0] (2097152->3145727) req@ffff95d147cda680 x1876702140699136/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762841.790825:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147cda680 with x1876702140699136 ext(2097152->3145727) 00002000:00010000:2.0:1789762841.790828:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147cda680 00000100:00100000:2.0:1789762841.790860:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 1 deadline 246296728641 time 246254434461 state 0x0 ref 1 00000100:00100000:2.0:1789762841.790870:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 1 deadline 246304434461 time 246254434461 state 0x1 ref 1 00000100:00100000:2.0:1789762841.790889:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246304434461 time 246264052392 state 0x0 ref 1 00000100:00100000:2.0:1789762841.790899:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+10:2345:x1876702140699136:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762841.793279:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140699136:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2379us (2541us total) trans 4294967557 rc 0/0 00000100:00100000:2.0:1789762841.793289:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:2.0:1789762841.793297:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246304434461 time 246264052392 state 0x2 ref 0 00002000:00100000:2.0:1789762841.793306:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x9:0x0] (2097152->3145727) req@ffff95d147cda680 x1876702140699136/t4294967557(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762841.793328:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147cda680 with x1876702140699136 ext(2097152->3145727) 00002000:00010000:2.0:1789762841.793332:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147cda680 00000100:00100000:1.0:1789762841.799988:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762841.800034:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140699264 00000100:00100000:0.0:1789762841.800041:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140699264 00002000:00100000:0.0:1789762841.800070:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (3145728->4194303) req@ffff95d17463c000 x1876702140699264/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762841.800078:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463c000 with x1876702140699264 ext(3145728->4194303) 00002000:00010000:0.0:1789762841.800082:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463c000 00000100:00100000:0.0:1789762841.800093:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246304434461 time 246264052392 state 0x0 ref 1 00000100:00100000:0.0:1789762841.800118:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246314052392 time 246264052392 state 0x1 ref 1 00000100:00100000:0.0:1789762841.800234:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762841.800269:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140699392 00000100:00100000:2.0:1789762841.800275:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140699392 00000100:00100000:2.0:1789762841.800301:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:2.0:1789762841.800308:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2341:x1876702140699392:12345-192.168.203.31@tcp:8:dd.500 00010000:00080000:2.0:1789762841.800330:0:10283:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1789762841.800350:0:10283:0:(genops.c:1385:class_connect()) connect: client 77777931-b235-4c03-82d2-4b1d12553008, cookie 0xd08452c77c56f54e 00002000:00100000:2.0:1789762841.800359:0:10283:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 77777931-b235-4c03-82d2-4b1d12553008/ffff95d147229000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 30670848 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789762841.800375:0:10283:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789762841.800516:0:10283:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789762841.800538:0:10283:0:(import.c:65:import_set_state_nolock()) ffff95d14722a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789762841.800584:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2341:x1876702140699392:12345-192.168.203.31@tcp:8:dd.500 Request processed in 276us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762841.800590:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:1.0:1789762841.801405:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762841.801453:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140699520 00000100:00100000:3.0:1789762841.801460:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140699520 00000100:00080000:1.0:1789762841.801496:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762841.801506:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:3.0:1789762841.801517:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+6:12168:x1876702140699520:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:3.0:1789762841.801529:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762841.801548:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d69de3a/0xd08452c77c56f555 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7e9 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762841.801573:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789762841.801597:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=246s v=(0 0) 00010000:00010000:3.0:1789762841.801602:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762841.801613:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d69de3a/0xd08452c77c56f555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7e9 expref: 7 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.801632:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d69de3a/0xd08452c77c56f555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7e9 expref: 7 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.801645:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140031600, rc 0) 00000100:00100000:3.0:1789762841.801681:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+7:12168:x1876702140699520:12345-192.168.203.31@tcp:101:dd.500 Request processed in 166us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762841.801688:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:0.0:1789762841.809578:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762841.809617:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140699648 00000100:00100000:3.0:1789762841.809623:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140699648 00002000:00100000:3.0:1789762841.809654:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->1048575) req@ffff95d147cdb100 x1876702140699648/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762841.809666:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147cdb100 with x1876702140699648 ext(0->1048575) 00002000:00010000:3.0:1789762841.809671:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d147cdb100 00000100:00100000:3.0:1789762841.809686:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246314052392 time 246264052392 state 0x1 ref 2 00000100:00100000:1.0:1789762841.816295:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762841.816361:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140699776 00000100:00100000:2.0:1789762841.816370:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140699776 00002000:00100000:2.0:1789762841.816400:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1048576->2097151) req@ffff95d17463dc00 x1876702140699776/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762841.816411:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463dc00 with x1876702140699776 ext(1048576->2097151) 00002000:00010000:2.0:1789762841.816416:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17463dc00 00000100:00100000:2.0:1789762841.816430:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246314052392 time 246264052392 state 0x1 ref 3 00000100:00100000:2.0:1789762841.840985:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246364134598 time 246314134598 state 0x1 ref 3 00000100:00100000:2.0:1789762841.841021:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140699264:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762841.843905:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+14:2345:x1876702140699264:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2890us (43916us total) trans 4294967558 rc 0/0 00000100:00100000:2.0:1789762841.843916:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 3 00002000:00100000:2.0:1789762841.843927:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x9:0x0] (3145728->4194303) req@ffff95d17463c000 x1876702140699264/t4294967558(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762841.843938:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463c000 with x1876702140699264 ext(3145728->4194303) 00002000:00010000:2.0:1789762841.843944:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463c000 00000100:00100000:3.0:1789762841.891045:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246414193855 time 246364193855 state 0x1 ref 2 00000100:00100000:3.0:1789762841.891069:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140699648:12345-192.168.203.31@tcp:4:dd.500 00000001:00100000:1.0:1789762841.903909:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000001:00080000:1.0:1789762841.918680:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967345 is committed 00000100:00100000:0.0:1789762841.918770:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140699648:12345-192.168.203.31@tcp:4:dd.500 Request processed in 27704us (109188us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1789762841.918780:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 4 00002000:00100000:0.0:1789762841.918792:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->1048575) req@ffff95d147cdb100 x1876702140699648/t4294967345(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762841.918800:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147cdb100 with x1876702140699648 ext(0->1048575) 00002000:00010000:0.0:1789762841.918806:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d147cdb100 00000100:00100000:1.0:1789762841.921001:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762841.921086:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140699904 00000100:00100000:0.0:1789762841.921106:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140699904 00002000:00100000:0.0:1789762841.921138:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2097152->3145727) req@ffff95d17463e680 x1876702140699904/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762841.921146:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463e680 with x1876702140699904 ext(2097152->3145727) 00002000:00010000:0.0:1789762841.921149:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17463e680 00000100:00100000:0.0:1789762841.921164:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246414193855 time 246364193855 state 0x1 ref 2 00000100:00100000:3.0:1789762841.926993:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762841.927068:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140700032 00000100:00100000:0.0:1789762841.927074:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140700032 00002000:00100000:0.0:1789762841.927094:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3145728->4194303) req@ffff95d17412e680 x1876702140700032/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762841.927115:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412e680 with x1876702140700032 ext(3145728->4194303) 00002000:00010000:0.0:1789762841.927118:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17412e680 00000100:00100000:0.0:1789762841.927128:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246414193855 time 246364193855 state 0x1 ref 3 00000100:00100000:1.0:1789762841.933489:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762841.933543:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140700160 00000100:00100000:0.0:1789762841.933548:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140700160 00002000:00100000:0.0:1789762841.933570:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x9:0x0] (4194304->5242879) req@ffff95d17463c700 x1876702140700160/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762841.933581:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463c700 with x1876702140700160 ext(4194304->5242879) 00002000:00010000:0.0:1789762841.933585:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463c700 00000100:00100000:0.0:1789762841.933598:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246414193855 time 246364193855 state 0x1 ref 4 00000100:00100000:1.0:1789762841.939733:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762841.939810:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140700288 00000100:00100000:2.0:1789762841.939816:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140700288 00002000:00100000:2.0:1789762841.939854:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x9:0x0] (5242880->6291455) req@ffff95d17463f480 x1876702140700288/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762841.939862:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463f480 with x1876702140700288 ext(5242880->6291455) 00002000:00010000:2.0:1789762841.939865:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463f480 00000100:00100000:2.0:1789762841.939874:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246414193855 time 246364193855 state 0x1 ref 5 00000100:00100000:2.0:1789762841.941146:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246464304363 time 246414304363 state 0x1 ref 5 00000100:00100000:2.0:1789762841.941160:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140699776:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762841.943880:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+10:2345:x1876702140699776:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2720us (127583us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789762841.943887:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 5 00002000:00100000:2.0:1789762841.943900:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1048576->2097151) req@ffff95d17463dc00 x1876702140699776/t4294967346(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762841.943907:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463dc00 with x1876702140699776 ext(1048576->2097151) 00002000:00010000:2.0:1789762841.943910:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17463dc00 00000100:00100000:1.0:1789762841.948253:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762841.948301:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140700416 00000100:00100000:0.0:1789762841.948308:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140700416 00002000:00100000:0.0:1789762841.948331:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x9:0x0] (6291456->7340031) req@ffff95d17463e300 x1876702140700416/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762841.948340:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463e300 with x1876702140700416 ext(6291456->7340031) 00002000:00010000:0.0:1789762841.948343:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463e300 00000100:00100000:0.0:1789762841.948353:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246464304363 time 246414304363 state 0x1 ref 5 00000100:00100000:3.0:1789762841.954351:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762841.954423:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140700544 00000100:00100000:2.0:1789762841.954430:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140700544 00002000:00100000:2.0:1789762841.954455:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x9:0x0] (7340032->8388607) req@ffff95d17412ce00 x1876702140700544/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762841.954462:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412ce00 with x1876702140700544 ext(7340032->8388607) 00002000:00010000:2.0:1789762841.954465:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17412ce00 00000100:00100000:2.0:1789762841.954477:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246464304363 time 246414304363 state 0x1 ref 6 00000100:00100000:1.0:1789762841.960478:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762841.960530:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140700672 00000100:00100000:2.0:1789762841.960537:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140700672 00002000:00100000:2.0:1789762841.960564:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5242879) req@ffff95d17463c380 x1876702140700672/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762841.960572:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463c380 with x1876702140700672 ext(4194304->5242879) 00002000:00010000:2.0:1789762841.960576:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17463c380 00000100:00100000:2.0:1789762841.960585:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246464304363 time 246414304363 state 0x1 ref 7 00000100:00100000:1.0:1789762841.966571:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762841.966631:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140700800 00000100:00100000:2.0:1789762841.966638:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140700800 00002000:00100000:2.0:1789762841.966667:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (5242880->6291455) req@ffff95d17463ce00 x1876702140700800/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762841.966679:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463ce00 with x1876702140700800 ext(5242880->6291455) 00002000:00010000:2.0:1789762841.966694:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17463ce00 00000100:00100000:2.0:1789762841.966709:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246464304363 time 246414304363 state 0x1 ref 8 00000100:00100000:0.0:1789762841.991212:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246514364180 time 246464364180 state 0x1 ref 8 00000100:00100000:0.0:1789762841.991234:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+11:2344:x1876702140699904:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762841.994041:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+13:2344:x1876702140699904:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2814us (73039us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789762841.994048:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 6 00002000:00100000:0.0:1789762841.994058:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2097152->3145727) req@ffff95d17463e680 x1876702140699904/t4294967347(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762841.994071:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463e680 with x1876702140699904 ext(2097152->3145727) 00002000:00010000:0.0:1789762841.994077:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17463e680 00000100:00100000:1.0:1789762841.995946:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762841.995999:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140700928 00000100:00100000:2.0:1789762841.996007:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140700928 00002000:00100000:2.0:1789762841.996040:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6291456->7340031) req@ffff95d17463ea00 x1876702140700928/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1789762852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762841.996050:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463ea00 with x1876702140700928 ext(6291456->7340031) 00002000:00010000:2.0:1789762841.996054:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17463ea00 00000100:00100000:2.0:1789762841.996071:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246514364180 time 246464364180 state 0x1 ref 8 00000100:00100000:3.0:1789762842.002137:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762842.002197:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140701312 00000100:00100000:3.0:1789762842.002202:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762842.002206:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140701312 00000100:00100000:1.0:1789762842.002253:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:2.0:1789762842.002258:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140701056 00000100:00100000:1.0:1789762842.002264:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+14:12168:x1876702140701312:12345-192.168.203.31@tcp:35:dd.500 00000100:00100000:2.0:1789762842.002266:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140701056 00002000:00100000:2.0:1789762842.002296:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (7340032->8388607) req@ffff95d17412ea00 x1876702140701056/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762842.002305:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412ea00 with x1876702140701056 ext(7340032->8388607) 00002000:00010000:2.0:1789762842.002309:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17412ea00 00000100:00100000:2.0:1789762842.002321:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246514364180 time 246464364180 state 0x1 ref 9 00000100:00100000:1.0:1789762842.002543:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+15:12168:x1876702140701312:12345-192.168.203.31@tcp:35:dd.500 Request processed in 281us (408us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789762842.002564:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1789762842.035616:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.035664:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140701568 00000100:00100000:3.0:1789762842.035674:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140701568 00000100:00100000:3.0:1789762842.035725:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:3.0:1789762842.035736:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+15:12179:x1876702140701568:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762842.035757:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762842.035772:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f55c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7f0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.035886:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f563 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.035897:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f563 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.035906:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f563 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.035916:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f56a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.035921:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f56a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.035925:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f56a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762842.036312:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7:0x0], index 1: 0 00000004:00080000:3.0:1789762842.036317:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa:0x0], index 0: 0 00010000:00010000:3.0:1789762842.036479:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f571 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.036492:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.036497:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.036525:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f563 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.036530:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f563 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.036535:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f563 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.036539:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.036542:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f563 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.036547:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f563 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.036554:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d151e90400) 00010000:00010000:3.0:1789762842.036557:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.036559:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f563 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.036563:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f563 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762842.036581:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad5b9b2c reply state 000000008e81ba63 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f56a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762842.036592:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789762842.036613:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f55c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7f0 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.036624:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7f0 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.036630:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff95d15055da00) 00010000:00010000:3.0:1789762842.036631:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762842.036633:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030c00, rc 0) 00000100:00100000:3.0:1789762842.036684:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+18:12179:x1876702140701568:12345-192.168.203.31@tcp:101:dd.0 Request processed in 952us (1077us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789762842.036689:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 160 00010000:00010000:3.0:1789762842.037447:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f56a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.037454:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f56a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.037458:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f56a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.037462:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.037464:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f56a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.037468:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f56a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.037483:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x636661f9 (ffff95d15055d400) 00010000:00010000:3.0:1789762842.037484:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.037487:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f56a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.037491:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f56a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762842.041254:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246564407573 time 246514407573 state 0x1 ref 9 00000100:00100000:0.0:1789762842.041269:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+14:2344:x1876702140700032:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762842.043516:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.043540:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140701824 00000100:00100000:1.0:1789762842.043590:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.043634:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140701824 00000100:00100000:2.0:1789762842.043649:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140701696 00000100:00100000:2.0:1789762842.043656:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140701696 00000100:00100000:3.0:1789762842.043677:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:3.0:1789762842.043688:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+17:12182:x1876702140701824:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762842.043697:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789762842.043703:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00010000:00010000:3.0:1789762842.043711:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7fe expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762842.043718:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+17:12181:x1876702140701696:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762842.043733:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1789762842.043736:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789762842.043743:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5045a74/0xd08452c77c56f586 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e7f7 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.043752:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=246s v=(0 0) 00010000:00010000:3.0:1789762842.043757:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762842.043866:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 19 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.043882:0:10283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 19 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.043890:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762842.043893:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789762842.043896:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5045a74/0xd08452c77c56f586 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7f7 expref: 19 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.043910:0:8803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 19 pid: 8803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.043918:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 19 pid: 8803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.043937:0:10283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 19 pid: 8803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.043947:0:10283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 19 pid: 8803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.043956:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140031200, rc 0) 00000100:00100000:1.0:1789762842.043959:0:10283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d144cbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10283:1876702149021056:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789762842.043995:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+19:12182:x1876702140701824:12345-192.168.203.31@tcp:101:dd.0 Request processed in 310us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762842.044003:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:1.0:1789762842.044027:0:10283:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b4750c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762842.044221:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+19:2344:x1876702140700032:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2953us (117226us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789762842.044229:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 7 00002000:00100000:2.0:1789762842.044238:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3145728->4194303) req@ffff95d17412e680 x1876702140700032/t4294967348(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762842.044257:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412e680 with x1876702140700032 ext(3145728->4194303) 00002000:00010000:2.0:1789762842.044261:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17412e680 00000100:00100000:1.0:1789762842.044867:0:10283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d144cbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10283:1876702149021056:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789762842.044886:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b5045a74/0xd08452c77c56f586 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7f7 expref: 18 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.044896:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003e800, rc 0) 00000100:00100000:1.0:1789762842.044926:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+18:12181:x1876702140701696:12345-192.168.203.31@tcp:101:dd.0 Request processed in 1215us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762842.044932:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:0.0:1789762842.046291:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.046329:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140701952 00000100:00100000:3.0:1789762842.046334:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140701952 00000100:00100000:3.0:1789762842.046358:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:3.0:1789762842.046363:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+18:12179:x1876702140701952:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762842.046370:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762842.046377:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d95c4d0f/0xd08452c77c56f58d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e805 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.046389:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789762842.046393:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1789762842.046399:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d95c4d0f/0xd08452c77c56f58d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e805 expref: 19 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.046410:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d95c4d0f/0xd08452c77c56f58d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e805 expref: 19 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.046421:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030200, rc 0) 00000100:00100000:3.0:1789762842.046453:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+19:12179:x1876702140701952:12345-192.168.203.31@tcp:101:dd.0 Request processed in 89us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762842.046459:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:0.0:1789762842.052164:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.052210:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140702080 00000100:00100000:2.0:1789762842.052217:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140702080 00000100:00100000:2.0:1789762842.052247:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:2.0:1789762842.052255:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+19:12180:x1876702140702080:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762842.052263:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762842.052271:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d293936/0xd08452c77c56f594 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e80c expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.052286:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789762842.052289:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(3 0) 00010000:00010000:2.0:1789762842.052293:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d293936/0xd08452c77c56f594 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e80c expref: 20 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.052301:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d293936/0xd08452c77c56f594 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e80c expref: 20 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.052308:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f96c00, rc 0) 00000100:00100000:2.0:1789762842.052337:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+20:12180:x1876702140702080:12345-192.168.203.31@tcp:101:dd.0 Request processed in 83us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762842.052341:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:0.0:1789762842.057753:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762842.057794:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140702208 00000100:00100000:1.0:1789762842.057800:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140702208 00000100:00100000:1.0:1789762842.057850:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:1.0:1789762842.057858:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+18:12186:x1876702140702208:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762842.057867:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762842.057880:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c56f59b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e813 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762842.057899:0:10283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789762842.057909:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=246s v=(0 0) 00010000:00010000:1.0:1789762842.057911:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762842.057918:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c56f59b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e813 expref: 19 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.057933:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c56f59b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e813 expref: 19 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.057940:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003ea00, rc 0) 00000100:00100000:1.0:1789762842.057984:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+19:12186:x1876702140702208:12345-192.168.203.31@tcp:101:dd.0 Request processed in 126us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762842.057993:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:0.0:1789762842.060270:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.060310:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140702336 00000100:00100000:3.0:1789762842.060321:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140702336 00000100:00100000:3.0:1789762842.060348:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:3.0:1789762842.060354:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+20:12188:x1876702140702336:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762842.060361:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762842.060369:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000027be040/0xd08452c77c56f5a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e81a expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.060383:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(3 0) 00010000:00010000:3.0:1789762842.060386:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(4 0) 00010000:00010000:3.0:1789762842.060390:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027be040/0xd08452c77c56f5a2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e81a expref: 21 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.060400:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000027be040/0xd08452c77c56f5a2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e81a expref: 21 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.060411:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030e00, rc 0) 00000100:00100000:3.0:1789762842.060445:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+21:12188:x1876702140702336:12345-192.168.203.31@tcp:101:dd.0 Request processed in 89us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762842.060453:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:0.0:1789762842.068216:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.068274:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140702464 00000100:00100000:2.0:1789762842.068281:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140702464 00000100:00100000:2.0:1789762842.068331:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:2.0:1789762842.068343:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+21:12187:x1876702140702464:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762842.068370:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762842.068385:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000038bc25c/0xd08452c77c56f5a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e821 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.068421:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789762842.068426:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(5 0) 00010000:00010000:2.0:1789762842.068433:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000038bc25c/0xd08452c77c56f5a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e821 expref: 22 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.068447:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000038bc25c/0xd08452c77c56f5a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e821 expref: 22 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.068456:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f97200, rc 0) 00000100:00100000:2.0:1789762842.068497:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+22:12187:x1876702140702464:12345-192.168.203.31@tcp:101:dd.0 Request processed in 158us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762842.068503:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:0.0:1789762842.070886:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.070935:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140702592 00000100:00100000:2.0:1789762842.070941:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140702592 00002000:00100000:2.0:1789762842.070968:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x7:0x0] (3145728->4194303) req@ffff95d04271ad80 x1876702140702592/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762842.070976:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d04271ad80 with x1876702140702592 ext(3145728->4194303) 00010000:00010000:2.0:1789762842.070983:0:11722:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 22 pid: 8803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.070994:0:11722:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 22 pid: 8803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762842.071011:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d04271ad80 00000100:00100000:2.0:1789762842.071030:0:11722:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75b00 gen 0 rate 10000 depth 3 token 3 deadline 0 time 246544189377 state 0x0 ref 1 00000100:00100000:2.0:1789762842.071039:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75b00 gen 0 rate 10000 depth 3 token 3 deadline 246544289377 time 246544189377 state 0x1 ref 1 00000100:00100000:2.0:1789762842.071061:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75b00 gen 0 rate 10000 depth 3 token 2 deadline 246544289377 time 246544223547 state 0x0 ref 1 00000100:00100000:2.0:1789762842.071069:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+22:2344:x1876702140702592:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762842.073994:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762842.074053:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140702720 00000100:00100000:1.0:1789762842.074061:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140702720 00000100:00100000:1.0:1789762842.074114:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:1.0:1789762842.074125:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+24:12190:x1876702140702720:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762842.074137:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762842.074149:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56f5b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e828 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.074169:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(5 0) 00010000:00010000:1.0:1789762842.074173:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762842.074178:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56f5b0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 8 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e828 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.074189:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56f5b0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 8 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e828 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.074198:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003fc00, rc 0) 00000100:00100000:1.0:1789762842.074236:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+25:12190:x1876702140702720:12345-192.168.203.31@tcp:101:dd.0 Request processed in 113us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762842.074243:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:3.0:1789762842.076438:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+25:2344:x1876702140702592:12345-192.168.203.31@tcp:4:dd.0 Request processed in 5366us (5551us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789762842.076447:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1789762842.076455:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75b00 gen 0 rate 10000 depth 3 token 2 deadline 246544289377 time 246544223547 state 0x2 ref 0 00002000:00100000:3.0:1789762842.076466:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x7:0x0] (3145728->4194303) req@ffff95d04271ad80 x1876702140702592/t4294967349(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762842.076493:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d04271ad80 with x1876702140702592 ext(3145728->4194303) 00010000:00010000:3.0:1789762842.076502:0:11722:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 25 pid: 8803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.076516:0:11722:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 25 pid: 8803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762842.076522:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d04271ad80 00000100:00100000:1.0:1789762842.078391:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762842.078421:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.078438:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140702848 00000100:00100000:3.0:1789762842.078446:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140702848 00000100:00100000:2.0:1789762842.078461:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140702976 00000100:00100000:2.0:1789762842.078468:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140702976 00000100:00100000:3.0:1789762842.078483:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 101 00010000:00010000:2.0:1789762842.078493:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 26 pid: 8803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762842.078495:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+26:12189:x1876702140702848:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762842.078512:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762842.078524:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56f5b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e82f expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762842.078532:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:2.0:1789762842.078546:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+27:2345:x1876702140702976:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762842.078549:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789762842.078555:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:3.0:1789762842.078560:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56f5b7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e82f expref: 27 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078563:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762842.078572:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56f5b7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e82f expref: 27 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.078583:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030600, rc 0) 00002000:00010000:2.0:1789762842.078584:0:5797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1789762842.078587:0:5797:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1789762841 00002000:00010000:2.0:1789762842.078589:0:5797:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1789762841 00010000:00010000:2.0:1789762842.078598:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 27 pid: 8803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078621:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 27 pid: 8803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762842.078629:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+27:12189:x1876702140702848:12345-192.168.203.31@tcp:101:dd.0 Request processed in 136us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762842.078635:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 101 00010000:00010000:2.0:1789762842.078642:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000113466cf/0xd08452c77c56f57f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7fe expref: 27 pid: 8803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078655:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078659:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078666:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5045a74/0xd08452c77c56f586 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7f7 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078675:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5045a74/0xd08452c77c56f586 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7f7 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078681:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078683:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078687:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d95c4d0f/0xd08452c77c56f58d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e805 expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078693:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d95c4d0f/0xd08452c77c56f58d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e805 expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078698:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078700:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078703:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d293936/0xd08452c77c56f594 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e80c expref: 25 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078718:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d293936/0xd08452c77c56f594 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e80c expref: 25 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078728:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078731:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078737:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000027be040/0xd08452c77c56f5a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e81a expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078745:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027be040/0xd08452c77c56f5a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e81a expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078754:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078757:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078763:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000038bc25c/0xd08452c77c56f5a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e821 expref: 25 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078772:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000038bc25c/0xd08452c77c56f5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e821 expref: 25 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078780:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078784:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078791:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56f5b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e828 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078800:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56f5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e828 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078827:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078830:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762842.078874:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56f5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e82f expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078885:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56f5b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e82f expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.078920:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56f5b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e82f expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762842.078935:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021184:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762842.079029:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56f5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e828 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762842.079042:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021312:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762842.079108:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000038bc25c/0xd08452c77c56f5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e821 expref: 25 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762842.079122:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cc0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021440:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762842.079181:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000027be040/0xd08452c77c56f5a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e81a expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762842.079208:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cc3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021568:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762842.079263:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004d293936/0xd08452c77c56f594 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e80c expref: 25 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762842.079276:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021696:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762842.079309:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d95c4d0f/0xd08452c77c56f58d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e805 expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762842.079320:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021824:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762842.079363:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b5045a74/0xd08452c77c56f586 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7f7 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762842.079376:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cc0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021952:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762842.079405:0:5797:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d151a76300 going to sleep for 11 seconds 00000100:00100000:2.0:1789762842.080667:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021184:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762842.080675:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021312:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762842.080808:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cc0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021440:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762842.087999:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cc3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021568:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762842.088011:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021696:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762842.088020:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021824:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762842.088040:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cc0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149021952:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762842.088074:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762842.088131:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+25:2345:x1876702140702976:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 9588us (9708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762842.088141:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:2.0:1789762842.091309:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246614462807 time 246564462807 state 0x1 ref 8 00000100:00100000:2.0:1789762842.091327:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+18:2345:x1876702140700160:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762842.094132:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+20:2345:x1876702140700160:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2808us (160642us total) trans 4294967559 rc 0/0 00000100:00100000:2.0:1789762842.094140:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 8 00002000:00100000:2.0:1789762842.094149:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x9:0x0] (4194304->5242879) req@ffff95d17463c700 x1876702140700160/t4294967559(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762842.094157:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463c700 with x1876702140700160 ext(4194304->5242879) 00002000:00010000:2.0:1789762842.094162:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463c700 00000100:00100000:1.0:1789762842.094681:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762842.094722:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140703104 00000100:00100000:0.0:1789762842.094730:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140703104 00002000:00100000:0.0:1789762842.094755:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa:0x0] (3145728->4194303) req@ffff95d144cbe680 x1876702140703104/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762842.094763:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbe680 with x1876702140703104 ext(3145728->4194303) 00002000:00010000:0.0:1789762842.094766:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d144cbe680 00000100:00100000:0.0:1789762842.094783:0:6661:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 3 deadline 0 time 246567944048 state 0x0 ref 1 00000100:00100000:0.0:1789762842.094794:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 3 deadline 246568044048 time 246567944048 state 0x1 ref 1 00000100:00100000:0.0:1789762842.094912:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246568044048 time 246568073445 state 0x0 ref 1 00000100:00100000:0.0:1789762842.094930:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+20:2344:x1876702140703104:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762842.100382:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+22:2344:x1876702140703104:12345-192.168.203.31@tcp:4:dd.0 Request processed in 5450us (5699us total) trans 4294967560 rc 0/0 00000100:00100000:3.0:1789762842.100391:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1789762842.100400:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246568044048 time 246568073445 state 0x2 ref 0 00002000:00100000:3.0:1789762842.100411:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xa:0x0] (3145728->4194303) req@ffff95d144cbe680 x1876702140703104/t4294967560(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762842.100421:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbe680 with x1876702140703104 ext(3145728->4194303) 00002000:00010000:3.0:1789762842.100426:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d144cbe680 00000100:00100000:1.0:1789762842.141307:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.141356:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140703232 00000100:00100000:3.0:1789762842.141368:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140703232 00002000:00100000:3.0:1789762842.141416:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xa:0x0] (5242880->6291455) req@ffff95d144cbc700 x1876702140703232/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789762842.141427:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246664577790 time 246614577790 state 0x1 ref 7 00002000:00100000:3.0:1789762842.141442:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbc700 with x1876702140703232 ext(5242880->6291455) 00002000:00010000:3.0:1789762842.141449:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d144cbc700 00000100:00100000:2.0:1789762842.141451:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+22:2344:x1876702140700288:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:3.0:1789762842.141469:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246568044048 time 246568073445 state 0x0 ref 1 00000100:00100000:3.0:1789762842.141486:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246568173445 time 246568073445 state 0x1 ref 1 00000100:00100000:3.0:1789762842.141520:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246568173445 time 246614680600 state 0x0 ref 1 00000100:00100000:3.0:1789762842.141536:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+23:2345:x1876702140703232:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762842.144822:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+24:2344:x1876702140700288:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3375us (205086us total) trans 4294967561 rc 0/0 00000100:00100000:3.0:1789762842.144857:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 9 00002000:00100000:3.0:1789762842.144867:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x9:0x0] (5242880->6291455) req@ffff95d17463f480 x1876702140700288/t4294967561(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762842.144877:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463f480 with x1876702140700288 ext(5242880->6291455) 00002000:00010000:3.0:1789762842.144882:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463f480 00000100:00100000:3.0:1789762842.147950:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+25:2345:x1876702140703232:12345-192.168.203.31@tcp:4:dd.0 Request processed in 6416us (6649us total) trans 4294967562 rc 0/0 00000100:00100000:3.0:1789762842.147959:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1789762842.147968:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246568173445 time 246614680600 state 0x2 ref 0 00002000:00100000:3.0:1789762842.147981:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xa:0x0] (5242880->6291455) req@ffff95d144cbc700 x1876702140703232/t4294967562(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762842.147990:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbc700 with x1876702140703232 ext(5242880->6291455) 00002000:00010000:3.0:1789762842.147995:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d144cbc700 00000100:00100000:2.0:1789762842.163759:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762842.163808:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140703360 00000100:00100000:0.0:1789762842.163817:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140703360 00002000:00100000:0.0:1789762842.163879:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa:0x0] (7340032->8388607) req@ffff95d148cc0e00 x1876702140703360/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762842.163888:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148cc0e00 with x1876702140703360 ext(7340032->8388607) 00002000:00010000:0.0:1789762842.163892:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148cc0e00 00000100:00100000:0.0:1789762842.163905:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246568173445 time 246614680600 state 0x0 ref 1 00000100:00100000:0.0:1789762842.163934:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246614780600 time 246614680600 state 0x1 ref 1 00000100:00100000:0.0:1789762842.163955:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246614780600 time 246637117402 state 0x0 ref 1 00000100:00100000:0.0:1789762842.163965:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+25:2344:x1876702140703360:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762842.166690:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+27:2344:x1876702140703360:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2725us (2934us total) trans 4294967563 rc 0/0 00000100:00100000:2.0:1789762842.166700:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1789762842.166707:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246614780600 time 246637117402 state 0x2 ref 0 00002000:00100000:2.0:1789762842.166724:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa:0x0] (7340032->8388607) req@ffff95d148cc0e00 x1876702140703360/t4294967563(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762842.166731:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148cc0e00 with x1876702140703360 ext(7340032->8388607) 00002000:00010000:2.0:1789762842.166735:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148cc0e00 00000100:00100000:0.0:1789762842.166980:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.167019:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140703488 00000100:00100000:3.0:1789762842.167025:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140703488 00002000:00100000:3.0:1789762842.167051:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x7:0x0] (2097152->3145727) req@ffff95d148de1f80 x1876702140703488/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762842.167062:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de1f80 with x1876702140703488 ext(2097152->3145727) 00002000:00010000:3.0:1789762842.167067:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de1f80 00000100:00100000:3.0:1789762842.167078:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246614780600 time 246637117402 state 0x0 ref 1 00000100:00100000:3.0:1789762842.167139:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246637217402 time 246637117402 state 0x1 ref 1 00000100:00100000:3.0:1789762842.167167:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246637217402 time 246640327947 state 0x0 ref 1 00000100:00100000:3.0:1789762842.167181:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+25:2345:x1876702140703488:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762842.169720:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+27:2345:x1876702140703488:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2541us (2740us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789762842.169730:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:3.0:1789762842.169738:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246637217402 time 246640327947 state 0x2 ref 0 00002000:00100000:3.0:1789762842.169749:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x7:0x0] (2097152->3145727) req@ffff95d148de1f80 x1876702140703488/t4294967350(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762842.169758:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de1f80 with x1876702140703488 ext(2097152->3145727) 00002000:00010000:3.0:1789762842.169762:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de1f80 00000100:00100000:1.0:1789762842.180477:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.180530:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140703616 00000100:00100000:2.0:1789762842.180539:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140703616 00002000:00100000:2.0:1789762842.180572:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa:0x0] (1048576->2097151) req@ffff95d144cbf480 x1876702140703616/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762842.180580:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbf480 with x1876702140703616 ext(1048576->2097151) 00002000:00010000:2.0:1789762842.180584:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d144cbf480 00000100:00100000:2.0:1789762842.180595:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246637217402 time 246640327947 state 0x0 ref 1 00000100:00100000:2.0:1789762842.180623:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246640427947 time 246640327947 state 0x1 ref 1 00000100:00100000:2.0:1789762842.180639:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246640427947 time 246653802009 state 0x0 ref 1 00000100:00100000:2.0:1789762842.180650:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+27:2344:x1876702140703616:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762842.183568:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+29:2344:x1876702140703616:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2918us (3094us total) trans 4294967564 rc 0/0 00000100:00100000:2.0:1789762842.183575:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1789762842.183582:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246640427947 time 246653802009 state 0x2 ref 0 00002000:00100000:2.0:1789762842.183590:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa:0x0] (1048576->2097151) req@ffff95d144cbf480 x1876702140703616/t4294967564(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762842.183603:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbf480 with x1876702140703616 ext(1048576->2097151) 00002000:00010000:2.0:1789762842.183606:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d144cbf480 00000100:00100000:1.0:1789762842.184021:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.184083:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140703744 00000100:00100000:2.0:1789762842.184090:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140703744 00002000:00100000:2.0:1789762842.184125:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xa:0x0] (2097152->3145727) req@ffff95d144cbe300 x1876702140703744/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762842.184133:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbe300 with x1876702140703744 ext(2097152->3145727) 00002000:00010000:2.0:1789762842.184137:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d144cbe300 00000100:00100000:2.0:1789762842.184148:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246640427947 time 246653802009 state 0x0 ref 1 00000100:00100000:2.0:1789762842.184182:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246653902009 time 246653802009 state 0x1 ref 1 00000100:00100000:3.0:1789762842.184216:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246653902009 time 246657371494 state 0x0 ref 1 00000100:00100000:3.0:1789762842.184235:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+29:2343:x1876702140703744:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762842.186140:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.186526:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140703872 00000100:00100000:3.0:1789762842.186532:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140703872 00002000:00100000:3.0:1789762842.186751:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x7:0x0] (6291456->7340031) req@ffff95d144cbc380 x1876702140703872/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762842.186761:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbc380 with x1876702140703872 ext(6291456->7340031) 00002000:00010000:3.0:1789762842.186773:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d144cbc380 00000100:00100000:3.0:1789762842.186807:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246657471494 time 246657371494 state 0x1 ref 2 00000100:00100000:3.0:1789762842.186864:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246657471494 time 246659996658 state 0x0 ref 2 00000100:00100000:3.0:1789762842.186879:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+27:2342:x1876702140703872:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762842.187278:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+31:2343:x1876702140703744:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3046us (3254us total) trans 4294967565 rc 0/0 00000100:00100000:2.0:1789762842.187289:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 21 00002000:00100000:2.0:1789762842.187299:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xa:0x0] (2097152->3145727) req@ffff95d144cbe300 x1876702140703744/t4294967565(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762842.187308:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbe300 with x1876702140703744 ext(2097152->3145727) 00002000:00010000:2.0:1789762842.187311:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d144cbe300 00000100:00100000:3.0:1789762842.190062:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+29:2342:x1876702140703872:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3185us (3919us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789762842.190073:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1789762842.190082:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246657471494 time 246659996658 state 0x2 ref 0 00002000:00100000:3.0:1789762842.190109:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x7:0x0] (6291456->7340031) req@ffff95d144cbc380 x1876702140703872/t4294967351(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762842.190120:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbc380 with x1876702140703872 ext(6291456->7340031) 00002000:00010000:3.0:1789762842.190125:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d144cbc380 00000100:00100000:0.0:1789762842.191452:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246714610129 time 246664610129 state 0x1 ref 6 00000100:00100000:0.0:1789762842.191464:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+30:2344:x1876702140700416:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762842.195079:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+32:2344:x1876702140700416:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3614us (246823us total) trans 4294967566 rc 0/0 00000100:00100000:2.0:1789762842.195091:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 10 00002000:00100000:2.0:1789762842.195114:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (6291456->7340031) req@ffff95d17463e300 x1876702140700416/t4294967566(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00000100:00100000:1.0:1789762842.195134:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00002000:00100000:2.0:1789762842.195137:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463e300 with x1876702140700416 ext(6291456->7340031) 00002000:00010000:2.0:1789762842.195143:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463e300 00000100:00100000:2.0:1789762842.195167:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140704000 00000100:00100000:2.0:1789762842.195172:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140704000 00000100:00100000:1.0:1789762842.195185:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00002000:00100000:2.0:1789762842.195202:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa:0x0] (6291456->7340031) req@ffff95d144cbce00 x1876702140704000/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1789762842.195205:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140704128 00002000:00100000:2.0:1789762842.195216:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbce00 with x1876702140704000 ext(6291456->7340031) 00002000:00010000:2.0:1789762842.195221:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d144cbce00 00000100:00100000:2.0:1789762842.195234:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246657471494 time 246659996658 state 0x0 ref 1 00000100:00100000:3.0:1789762842.195255:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140704128 00000100:00100000:2.0:1789762842.195270:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246660096658 time 246659996658 state 0x1 ref 1 00002000:00100000:3.0:1789762842.195281:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xa:0x0] (0->1048575) req@ffff95d144cbea00 x1876702140704128/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789762842.195300:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246660096658 time 246668453904 state 0x0 ref 1 00002000:00100000:3.0:1789762842.195312:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbea00 with x1876702140704128 ext(0->1048575) 00000100:00100000:2.0:1789762842.195314:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+33:2345:x1876702140704000:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:3.0:1789762842.195320:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d144cbea00 00000100:00100000:3.0:1789762842.195345:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246668553904 time 246668453904 state 0x1 ref 2 00000100:00100000:0.0:1789762842.195425:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246668553904 time 246668584659 state 0x0 ref 2 00000100:00100000:0.0:1789762842.195438:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+34:2345:x1876702140704128:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762842.199091:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+36:2345:x1876702140704000:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3780us (3962us total) trans 4294967567 rc 0/0 00000100:00100000:2.0:1789762842.199113:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 23 00002000:00100000:2.0:1789762842.199122:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa:0x0] (6291456->7340031) req@ffff95d144cbce00 x1876702140704000/t4294967567(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762842.199133:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbce00 with x1876702140704000 ext(6291456->7340031) 00002000:00010000:2.0:1789762842.199138:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d144cbce00 00000100:00100000:0.0:1789762842.201455:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+36:2345:x1876702140704128:12345-192.168.203.31@tcp:4:dd.0 Request processed in 6019us (6269us total) trans 4294967568 rc 0/0 00000100:00100000:0.0:1789762842.201464:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1789762842.201470:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246668553904 time 246668584659 state 0x2 ref 0 00002000:00100000:0.0:1789762842.201479:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xa:0x0] (0->1048575) req@ffff95d144cbea00 x1876702140704128/t4294967568(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762842.201486:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d144cbea00 with x1876702140704128 ext(0->1048575) 00002000:00010000:0.0:1789762842.201490:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d144cbea00 00000100:00100000:2.0:1789762842.202507:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762842.202559:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140704256 00000100:00100000:1.0:1789762842.202567:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140704256 00002000:00100000:1.0:1789762842.202596:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x7:0x0] (5242880->6291455) req@ffff95d148cc0380 x1876702140704256/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762842.202614:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148cc0380 with x1876702140704256 ext(5242880->6291455) 00002000:00010000:1.0:1789762842.202619:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148cc0380 00000100:00100000:1.0:1789762842.202631:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246668553904 time 246668584659 state 0x0 ref 1 00000100:00100000:1.0:1789762842.202666:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246668684659 time 246668584659 state 0x1 ref 1 00000100:00100000:1.0:1789762842.202695:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246668684659 time 246675855157 state 0x0 ref 1 00000100:00100000:1.0:1789762842.202710:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+29:2344:x1876702140704256:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762842.205488:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762842.205521:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.205535:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140704384 00000100:00100000:2.0:1789762842.205541:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140704384 00000100:00100000:3.0:1789762842.205553:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+32:2344:x1876702140704256:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2843us (3041us total) trans 4294967352 rc 0/0 00002000:00100000:2.0:1789762842.205565:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x7:0x0] (0->1048575) req@ffff95d148de1180 x1876702140704384/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1789762842.205570:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140704512 00000100:00100000:3.0:1789762842.205576:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:1.0:1789762842.205579:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140704512 00002000:00100000:2.0:1789762842.205580:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de1180 with x1876702140704384 ext(0->1048575) 00002000:00010000:2.0:1789762842.205587:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de1180 00000100:00100000:3.0:1789762842.205593:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246668684659 time 246675855157 state 0x2 ref 0 00000100:00100000:2.0:1789762842.205607:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246668684659 time 246675855157 state 0x0 ref 1 00002000:00100000:1.0:1789762842.205612:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x7:0x0] (7340032->8388607) req@ffff95d148de1500 x1876702140704512/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762842.205618:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x7:0x0] (5242880->6291455) req@ffff95d148cc0380 x1876702140704256/t4294967352(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762842.205636:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de1500 with x1876702140704512 ext(7340032->8388607) 00000100:00100000:2.0:1789762842.205645:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246675955157 time 246675855157 state 0x1 ref 1 00002000:00010000:1.0:1789762842.205647:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de1500 00000100:00100000:0.0:1789762842.205663:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246675955157 time 246678822313 state 0x0 ref 1 00000100:00100000:0.0:1789762842.205678:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+33:2343:x1876702140704384:12345-192.168.203.31@tcp:4:dd.0 00002000:00100000:3.0:1789762842.205691:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148cc0380 with x1876702140704256 ext(5242880->6291455) 00000100:00100000:1.0:1789762842.205693:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246678922313 time 246678822313 state 0x1 ref 2 00002000:00010000:3.0:1789762842.205697:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148cc0380 00000100:00100000:2.0:1789762842.205803:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246678922313 time 246678963653 state 0x0 ref 2 00000100:00100000:2.0:1789762842.205814:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+33:2343:x1876702140704512:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762842.209041:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762842.209109:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140704640 00000100:00100000:1.0:1789762842.209115:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140704640 00002000:00100000:1.0:1789762842.209138:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x7:0x0] (1048576->2097151) req@ffff95d042b44a80 x1876702140704640/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762842.209149:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b44a80 with x1876702140704640 ext(1048576->2097151) 00002000:00010000:1.0:1789762842.209154:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042b44a80 00000100:00100000:1.0:1789762842.209166:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246679063653 time 246678963653 state 0x1 ref 3 00000100:00100000:1.0:1789762842.209190:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246679063653 time 246682352216 state 0x0 ref 3 00000100:00100000:1.0:1789762842.209202:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+35:2344:x1876702140704640:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762842.209257:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.209303:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789762842.209314:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1789762842.209649:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+37:2343:x1876702140704384:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3975us (4162us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789762842.209656:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 26 00002000:00100000:0.0:1789762842.209662:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x7:0x0] (0->1048575) req@ffff95d148de1180 x1876702140704384/t4294967353(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762842.209670:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de1180 with x1876702140704384 ext(0->1048575) 00002000:00010000:0.0:1789762842.209673:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de1180 00000100:00100000:0.0:1789762842.209688:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140704768 00000100:00100000:0.0:1789762842.209697:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140704768 00002000:00100000:0.0:1789762842.209715:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xa:0x0] (4194304->5242879) req@ffff95d148cc2300 x1876702140704768/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762842.209722:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148cc2300 with x1876702140704768 ext(4194304->5242879) 00002000:00010000:0.0:1789762842.209725:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148cc2300 00000100:00100000:0.0:1789762842.209735:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246682452216 time 246682352216 state 0x1 ref 3 00000100:00100000:0.0:1789762842.209761:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246682452216 time 246682924075 state 0x0 ref 3 00000100:00100000:0.0:1789762842.209771:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+36:2343:x1876702140704768:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762842.211089:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762842.211160:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140705024 00000100:00100000:0.0:1789762842.211167:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140705024 00000100:00100000:0.0:1789762842.211221:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:0.0:1789762842.211232:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+17:12180:x1876702140705024:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:0.0:1789762842.211597:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+18:12180:x1876702140705024:12345-192.168.203.31@tcp:35:dd.0 Request processed in 368us (509us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789762842.211602:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+37:2343:x1876702140704512:12345-192.168.203.31@tcp:4:dd.0 Request processed in 5786us (6077us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789762842.211609:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1789762842.211614:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 27 00002000:00100000:2.0:1789762842.211622:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7:0x0] (7340032->8388607) req@ffff95d148de1500 x1876702140704512/t4294967354(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762842.211629:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148de1500 with x1876702140704512 ext(7340032->8388607) 00002000:00010000:2.0:1789762842.211633:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148de1500 00000100:00100000:0.0:1789762842.211753:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762842.211797:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140705152 00000100:00100000:1.0:1789762842.211804:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140705152 00002000:00100000:1.0:1789762842.211864:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x7:0x0] (4194304->5242879) req@ffff95d042b44000 x1876702140705152/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762842.211875:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b44000 with x1876702140705152 ext(4194304->5242879) 00002000:00010000:1.0:1789762842.211881:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042b44000 00000100:00100000:1.0:1789762842.211914:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246683024075 time 246682924075 state 0x1 ref 3 00000100:00100000:1.0:1789762842.211946:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246683024075 time 246685105421 state 0x0 ref 3 00000100:00100000:1.0:1789762842.211962:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+37:2345:x1876702140705152:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762842.213239:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140704640:12345-192.168.203.31@tcp:4:dd.0 Request processed in 4039us (4198us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789762842.213250:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 28 00002000:00100000:1.0:1789762842.213261:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x7:0x0] (1048576->2097151) req@ffff95d042b44a80 x1876702140704640/t4294967355(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762842.213271:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b44a80 with x1876702140704640 ext(1048576->2097151) 00002000:00010000:1.0:1789762842.213277:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042b44a80 00000100:00100000:1.0:1789762842.214748:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+38:2343:x1876702140704768:12345-192.168.203.31@tcp:4:dd.0 Request processed in 4978us (5492us total) trans 4294967569 rc 0/0 00000100:00100000:1.0:1789762842.214755:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 29 00002000:00100000:1.0:1789762842.214763:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa:0x0] (4194304->5242879) req@ffff95d148cc2300 x1876702140704768/t4294967569(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762842.214773:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148cc2300 with x1876702140704768 ext(4194304->5242879) 00002000:00010000:1.0:1789762842.214778:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148cc2300 00000100:00100000:1.0:1789762842.216163:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+39:2345:x1876702140705152:12345-192.168.203.31@tcp:4:dd.0 Request processed in 4206us (4410us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789762842.216169:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:1.0:1789762842.216175:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246683024075 time 246685105421 state 0x2 ref 0 00002000:00100000:1.0:1789762842.216182:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x7:0x0] (4194304->5242879) req@ffff95d042b44000 x1876702140705152/t4294967356(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762842.216189:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b44000 with x1876702140705152 ext(4194304->5242879) 00002000:00010000:1.0:1789762842.216192:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042b44000 00000100:00100000:2.0:1789762842.241508:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246764660771 time 246714660771 state 0x1 ref 5 00000100:00100000:2.0:1789762842.241541:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+37:2344:x1876702140700544:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762842.244139:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140700544:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2602us (289788us total) trans 4294967570 rc 0/0 00000100:00100000:2.0:1789762842.244148:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 11 00002000:00100000:2.0:1789762842.244157:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x9:0x0] (7340032->8388607) req@ffff95d17412ce00 x1876702140700544/t4294967570(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762842.244165:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412ce00 with x1876702140700544 ext(7340032->8388607) 00002000:00010000:2.0:1789762842.244170:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17412ce00 00000001:00080000:3.0:1789762842.287657:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967421 is committed 00000100:00100000:2.0:1789762842.291560:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246814705462 time 246764705462 state 0x1 ref 4 00000100:00100000:2.0:1789762842.291587:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+38:2344:x1876702140700672:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762842.295012:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+40:2344:x1876702140700672:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3434us (334535us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1789762842.295020:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 12 00002000:00100000:2.0:1789762842.295031:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5242879) req@ffff95d17463c380 x1876702140700672/t4294967357(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762842.295040:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463c380 with x1876702140700672 ext(4194304->5242879) 00002000:00010000:2.0:1789762842.295048:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17463c380 00000100:00100000:3.0:1789762842.341651:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246864801405 time 246814801405 state 0x1 ref 3 00000100:00100000:3.0:1789762842.341675:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140700800:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:3.0:1789762842.348076:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+41:2344:x1876702140700800:12345-192.168.203.31@tcp:4:dd.500 Request processed in 6408us (381504us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1789762842.348084:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 13 00002000:00100000:3.0:1789762842.348108:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5242880->6291455) req@ffff95d17463ce00 x1876702140700800/t4294967358(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762842.348115:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463ce00 with x1876702140700800 ext(5242880->6291455) 00002000:00010000:3.0:1789762842.348121:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17463ce00 00000100:00100000:1.0:1789762842.391750:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246914899434 time 246864899434 state 0x1 ref 2 00000100:00100000:1.0:1789762842.391772:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+40:2345:x1876702140700928:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762842.394910:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+42:2345:x1876702140700928:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3144us (398964us total) trans 4294967359 rc 0/0 00000100:00100000:1.0:1789762842.394918:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 14 00002000:00100000:1.0:1789762842.394929:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (6291456->7340031) req@ffff95d17463ea00 x1876702140700928/t4294967359(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1789762852 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762842.394937:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463ea00 with x1876702140700928 ext(6291456->7340031) 00002000:00010000:1.0:1789762842.394942:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17463ea00 00000100:00100000:1.0:1789762842.441820:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246914899434 time 246914973911 state 0x0 ref 1 00000100:00100000:1.0:1789762842.441853:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+41:2345:x1876702140701056:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762842.444454:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+43:2345:x1876702140701056:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2620us (442252us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789762842.444462:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:1.0:1789762842.444469:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246914899434 time 246914973911 state 0x2 ref 0 00002000:00100000:1.0:1789762842.444481:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (7340032->8388607) req@ffff95d17412ea00 x1876702140701056/t4294967360(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/448 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762842.444489:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412ea00 with x1876702140701056 ext(7340032->8388607) 00002000:00010000:1.0:1789762842.444496:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d17412ea00 00000100:00100000:0.0:1789762842.475913:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762842.475958:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.475988:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140705280 00000100:00100000:3.0:1789762842.475997:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140705280 00000100:00100000:1.0:1789762842.476005:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140705408 00000100:00100000:1.0:1789762842.476018:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140705408 00000100:00100000:3.0:1789762842.476055:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1789762842.476067:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+43:5571:x1876702140705280:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789762842.476070:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:1.0:1789762842.476083:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+39:6029:x1876702140705408:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762842.476107:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789762842.476108:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 8 locks, starting at 0 00002000:00010000:3.0:1789762842.476127:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1789762842.476128:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:3.0:1789762842.476134:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789762841 00002000:00010000:1.0:1789762842.476135:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1789762841 00002000:00010000:3.0:1789762842.476141:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1789762841 00002000:00010000:1.0:1789762842.476142:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1789762841 00002000:00010000:3.0:1789762842.476147:0:5799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1789762842.476169:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c56f547 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7e2 expref: 39 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.476170:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d69de3a/0xd08452c77c56f555 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7e9 expref: 43 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762842.476207:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb size from disk: 4194304 -> 8388608 00002000:00010000:1.0:1789762842.476210:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1789762842.476213:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1789762841 00002000:00010000:1.0:1789762842.476217:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1789762841 00010000:00010000:3.0:1789762842.476218:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000038bc25c/0xd08452c77c56f5a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e821 expref: 42 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.476227:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c56f59b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e813 expref: 38 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.476236:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d293936/0xd08452c77c56f594 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e80c expref: 41 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.476241:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762842.476250:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56f5b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 7 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e828 expref: 40 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.476261:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d95c4d0f/0xd08452c77c56f58d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e805 expref: 39 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.476270:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000027be040/0xd08452c77c56f5a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e81a expref: 38 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.476279:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065800d53/0xd08452c77c56f5b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e82f expref: 37 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762842.476288:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+37:6029:x1876702140705408:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 210us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762842.476303:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00010000:00010000:3.0:1789762842.476313:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5045a74/0xd08452c77c56f586 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7f7 expref: 36 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.476327:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762842.476349:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+35:5571:x1876702140705280:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 286us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762842.476355:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1789762842.509592:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.509662:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140705664 00000100:00100000:2.0:1789762842.509673:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140705664 00000100:00100000:2.0:1789762842.509728:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:0.0:1789762842.509735:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.509741:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+9:12216:x1876702140705664:12345-192.168.203.31@tcp:101:dd.0 00000100:00100000:1.0:1789762842.509758:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140705920 00000100:00100000:1.0:1789762842.509764:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140705920 00010000:00010000:2.0:1789762842.509781:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762842.509801:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f5be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e836 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762842.509802:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:1.0:1789762842.509814:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+11:12217:x1876702140705920:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762842.509823:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762842.509861:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56f5c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e83d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762842.509899:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:1.0:1789762842.509933:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f5cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762842.509935:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140706176 00010000:00010000:2.0:1789762842.509937:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f5d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762842.509944:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140706176 00010000:00010000:1.0:1789762842.509950:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f5cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.509961:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f5cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.509965:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762842.509969:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 16777216 00010000:00010000:2.0:1789762842.509981:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762842.509991:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 163 00000004:00200000:2.0:1789762842.509993:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 16777216 00000100:00100000:0.0:1789762842.509999:0:7603:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:3.0:1789762842.510006:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+13:12218:x1876702140706176:12345-192.168.203.31@tcp:101:dd.0 00000100:00100000:0.0:1789762842.510016:0:7603:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00010000:00010000:3.0:1789762842.510020:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762842.510034:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f5e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e844 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.510106:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f5ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.510119:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.510137:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762842.510153:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 16777216 00010000:00010000:2.0:1789762842.510244:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f5be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e836 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.510258:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56f5c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e83d expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.510263:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e836 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.510275:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:2.0:1789762842.510277:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762842.510282:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f96e00, rc 0) 00010000:00010000:3.0:1789762842.510283:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f5e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e844 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.510285:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f5cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e83d expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.510306:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:1.0:1789762842.510312:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762842.510316:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003fa00, rc 0) 00000100:00100000:2.0:1789762842.510334:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+17:12216:x1876702140705664:12345-192.168.203.31@tcp:101:dd.0 Request processed in 596us (749us total) trans 4294967423 rc 0/0 00010000:00010000:3.0:1789762842.510342:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f5ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e844 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762842.510349:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+17:12217:x1876702140705920:12345-192.168.203.31@tcp:101:dd.0 Request processed in 534us (611us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789762842.510349:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:1.0:1789762842.510367:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 162 00010000:00010000:3.0:1789762842.510368:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:3.0:1789762842.510374:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762842.510378:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030e00, rc 0) 00000100:00100000:3.0:1789762842.510413:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+15:12218:x1876702140706176:12345-192.168.203.31@tcp:101:dd.0 Request processed in 412us (512us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1789762842.510422:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:0.0:1789762842.512249:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762842.512271:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762842.512285:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140706816 00000100:00100000:1.0:1789762842.512290:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140706816 00000100:00100000:2.0:1789762842.512303:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140706304 00000100:00100000:2.0:1789762842.512309:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140706304 00000100:00100000:1.0:1789762842.512324:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:1.0:1789762842.512334:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+16:12216:x1876702140706816:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:2.0:1789762842.512352:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1789762842.512369:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+16:2344:x1876702140706304:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789762842.512383:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:2.0:1789762842.512383:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762842.512400:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f5cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e83d expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.512413:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:2.0:1789762842.512416:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762842.512429:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.512449:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+16:2344:x1876702140706304:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 82us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762842.512460:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1789762842.512461:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+16:12216:x1876702140706816:12345-192.168.203.31@tcp:35:dd.0 Request processed in 126us (207us total) trans 4294967425 rc 0/0 00000100:00100000:3.0:1789762842.512472:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140706688 00000100:00100000:1.0:1789762842.512474:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:3.0:1789762842.512480:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140706688 00000100:00100000:2.0:1789762842.512483:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140706432 00000100:00100000:2.0:1789762842.512487:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140706432 00000100:00100000:0.0:1789762842.512498:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.512531:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1789762842.512541:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:3.0:1789762842.512547:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+16:2344:x1876702140706688:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789762842.512558:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+16:2345:x1876702140706432:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762842.512560:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789762842.512563:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140706944 00000100:00100000:2.0:1789762842.512569:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140706944 00010000:00010000:1.0:1789762842.512577:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789762842.512598:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:2.0:1789762842.512606:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+37:12217:x1876702140706944:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762842.512614:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762842.512628:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f5ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e844 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.512629:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029b24162/0xd08452c77c56f5fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e84b expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.512634:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f5d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e836 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.512667:0:6672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff95d14abf2f00) 00002000:00010000:2.0:1789762842.512668:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 8388608, mtime: 0x6aad9d19, atime: 0x0, ctime: 0x6aad9d19, blocks: 0x1 00010000:00010000:1.0:1789762842.512670:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762842.512676:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:3.0:1789762842.512682:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762842.512683:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=246s v=(0 0) 00010000:00010000:2.0:1789762842.512689:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762842.512696:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029b24162/0xd08452c77c56f5fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e84b expref: 38 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762842.512702:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+14:2345:x1876702140706432:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 148us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762842.512717:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00010000:00010000:2.0:1789762842.512718:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029b24162/0xd08452c77c56f5fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e84b expref: 38 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762842.512719:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+14:2344:x1876702140706688:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 174us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762842.512735:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00010000:00010000:2.0:1789762842.512738:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f96600, rc 0) 00000100:00100000:2.0:1789762842.512764:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+38:12217:x1876702140706944:12345-192.168.203.31@tcp:101:dd.0 Request processed in 159us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762842.512779:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:0.0:1789762842.516853:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762842.516885:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.516894:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140707200 00000100:00100000:2.0:1789762842.516900:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140707200 00000100:00100000:1.0:1789762842.516918:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140707328 00000100:00100000:1.0:1789762842.516923:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140707328 00000100:00100000:2.0:1789762842.516935:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:2.0:1789762842.516945:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+13:12218:x1876702140707200:12345-192.168.203.31@tcp:35:dd.0 00002000:00100000:1.0:1789762842.516950:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x9:0x0] (0->1048575) req@ffff95d042b47b80 x1876702140707328/t0(0) o3->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/0 e 0 to 0 dl 1789762853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762842.516959:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b47b80 with x1876702140707328 ext(0->1048575) 00002000:00010000:1.0:1789762842.516962:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d042b47b80 00000100:00100000:1.0:1789762842.516982:0:11722:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 3 deadline 0 time 246990140348 state 0x0 ref 1 00000100:00100000:1.0:1789762842.516990:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 3 deadline 246990240348 time 246990140348 state 0x1 ref 1 00000100:00100000:1.0:1789762842.517016:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246990240348 time 246990177721 state 0x0 ref 1 00000100:00100000:1.0:1789762842.517032:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+38:2342:x1876702140707328:12345-192.168.203.31@tcp:3:dd.0 00000100:00100000:2.0:1789762842.517047:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+14:12218:x1876702140707200:12345-192.168.203.31@tcp:35:dd.0 Request processed in 103us (211us total) trans 4294967426 rc 0/0 00000100:00100000:2.0:1789762842.517054:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1789762842.521252:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+38:2342:x1876702140707328:12345-192.168.203.31@tcp:3:dd.0 Request processed in 4221us (4365us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762842.521261:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1789762842.521268:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246990240348 time 246990177721 state 0x2 ref 0 00002000:00100000:1.0:1789762842.521276:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x9:0x0] (0->1048575) req@ffff95d042b47b80 x1876702140707328/t0(0) o3->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:623/0 lens 488/440 e 0 to 0 dl 1789762853 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762842.521283:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b47b80 with x1876702140707328 ext(0->1048575) 00002000:00010000:1.0:1789762842.521287:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d042b47b80 00000100:00100000:0.0:1789762842.558624:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762842.558684:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140707584 00000100:00100000:1.0:1789762842.558693:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140707584 00000100:00100000:1.0:1789762842.558741:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1789762842.558750:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15177dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+14:12229:x1876702140707584:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:1.0:1789762842.558955:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15177dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+15:12229:x1876702140707584:12345-192.168.203.31@tcp:35:dd.0 Request processed in 207us (339us total) trans 4294967427 rc 0/0 00000100:00100000:1.0:1789762842.558961:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:0.0:1789762842.571406:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.571456:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140707712 00000100:00100000:3.0:1789762842.571464:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140707712 00000100:00100000:3.0:1789762842.571513:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:3.0:1789762842.571533:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+15:12232:x1876702140707712:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1789762842.571553:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762842.571567:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e852 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.571619:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f60b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.571631:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f60b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.571640:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f60b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762842.571666:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 16384 00000004:00200000:3.0:1789762842.571668:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762842.571680:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f60b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.571698:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e852 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.571710:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f60b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e852 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.571716:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d151e90400) 00010000:00010000:3.0:1789762842.571719:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762842.571721:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030800, rc 0) 00000100:00100000:3.0:1789762842.571766:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+16:12232:x1876702140707712:12345-192.168.203.31@tcp:101:rm.0 Request processed in 236us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762842.571780:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:3.0:1789762842.572961:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.573001:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140707968 00000100:00100000:2.0:1789762842.573007:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140707968 00000100:00100000:2.0:1789762842.573040:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:2.0:1789762842.573047:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+16:12232:x1876702140707968:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789762842.573055:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762842.573063:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f612 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e859 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762842.573120:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 16384 00010000:00010000:2.0:1789762842.573221:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f612 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e859 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.573231:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:2.0:1789762842.573239:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789762842.573242:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f612 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e859 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.573251:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f96800, rc 0) 00000100:00100000:2.0:1789762842.573280:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+17:12232:x1876702140707968:12345-192.168.203.31@tcp:101:rm.0 Request processed in 234us (321us total) trans 4294967428 rc 301/301 00000100:00100000:2.0:1789762842.573285:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:0.0:1789762842.574740:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.574775:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140708096 00000100:00100000:2.0:1789762842.574779:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140708096 00000100:00100000:2.0:1789762842.574807:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1789762842.574813:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+17:12232:x1876702140708096:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:2.0:1789762842.576667:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+17:12232:x1876702140708096:12345-192.168.203.31@tcp:37:rm.0 Request processed in 1854us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762842.576673:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1789762842.578013:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762842.578062:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140708352 00000100:00100000:1.0:1789762842.578069:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140708352 00000100:00100000:1.0:1789762842.578111:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1789762842.578118:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+17:12232:x1876702140708352:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:1.0:1789762842.578221:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+18:12232:x1876702140708352:12345-192.168.203.31@tcp:35:rm.0 Request processed in 102us (208us total) trans 4294967429 rc 0/0 00000100:00100000:1.0:1789762842.578240:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:0.0:1789762842.579063:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.579113:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140708608 00000100:00100000:3.0:1789762842.579118:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140708608 00000100:00100000:3.0:1789762842.579147:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:3.0:1789762842.579153:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+18:12232:x1876702140708608:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1789762842.579163:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762842.579170:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e860 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.579206:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f627 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.579215:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f627 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.579221:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f627 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762842.579227:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 16384 00010000:00010000:3.0:1789762842.579271:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e860 expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.579282:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f627 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e860 expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.579287:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d151e90400) 00010000:00010000:3.0:1789762842.579290:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789762842.579297:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030200, rc 0) 00000100:00100000:3.0:1789762842.579325:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+20:12232:x1876702140708608:12345-192.168.203.31@tcp:101:rm.0 Request processed in 172us (262us total) trans 4294967430 rc 0/0 00000100:00100000:3.0:1789762842.579330:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:0.0:1789762842.580160:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.580196:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140708736 00000100:00100000:2.0:1789762842.580202:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140708736 00000100:00100000:2.0:1789762842.580232:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:2.0:1789762842.580240:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+20:12232:x1876702140708736:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:2.0:1789762842.580270:0:7603:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1789762842.580303:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+20:12232:x1876702140708736:12345-192.168.203.31@tcp:41:rm.0 Request processed in 65us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762842.580309:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:0.0:1789762842.581157:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762842.581195:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140708992 00000100:00100000:1.0:1789762842.581201:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140708992 00000100:00100000:1.0:1789762842.581234:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:1.0:1789762842.581241:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+20:12232:x1876702140708992:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:1.0:1789762842.581261:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789762842.581273:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f571 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7f0 expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.581283:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff95d15055da00) 00010000:00010000:1.0:1789762842.581292:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f60b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e852 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.581299:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d151e90400) 00010000:00010000:1.0:1789762842.581301:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762842.581311:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56f635 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.581318:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56f635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.581323:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56f635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.581332:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f63c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.581337:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f63c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.581348:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f63c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.581501:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f643 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.581507:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f643 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.581513:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f643 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789762842.582422:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 64 off8576 00000004:00080000:1.0:1789762842.582429:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 247055595278ns, next at 248055593862ns, rc = 0 00000040:00080000:1.0:1789762842.582477:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].9, 64 off8768 00000004:00080000:1.0:1789762842.582482:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 247055647930ns, next at 248055647170ns, rc = 0 00010000:00010000:1.0:1789762842.582517:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f64a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582525:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f64a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582531:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f64a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582536:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f64a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582541:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f64a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582553:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f64a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582569:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762842.582580:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f643 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582588:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f643 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.582592:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762842.582596:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f643 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.582599:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f64a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582608:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ec00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762842.582615:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f643 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.582626:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762842.582632:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f643 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.582633:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f64a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.582653:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f64a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582656:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:1.0:1789762842.582660:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762842.582664:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f643 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.582672:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff95d14abf2200) 00010000:00010000:1.0:1789762842.582673:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c56f643 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.582677:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762842.582681:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f64a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.582688:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56f64a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582696:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56f635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.582700:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762842.582703:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762842.582705:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762842.582709:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56f635 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582721:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56f635 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582725:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ea00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762842.582727:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56f635 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582731:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56f635 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582738:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d151e90400) 00010000:00010000:1.0:1789762842.582740:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762842.582742:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56f635 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.582747:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56f635 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762842.582759:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000018bfa5 reply state 000000006f3e7719 transno 4294967431 ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f63c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762842.582768:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762842.582807:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+20:12232:x1876702140708992:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1566us (1649us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1789762842.582812:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 168 00010000:00010000:2.0:1789762842.583348:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f63c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.583356:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f63c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.583360:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f63c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.583364:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762842.583366:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f63c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.583380:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f63c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.583387:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x636661f9 (ffff95d14abf2400) 00010000:00010000:2.0:1789762842.583389:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762842.583391:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f63c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.583395:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c56f63c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762842.583805:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.583862:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140709248 00000100:00100000:2.0:1789762842.583867:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140709248 00000100:00100000:2.0:1789762842.583894:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:2.0:1789762842.583901:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+19:12232:x1876702140709248:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762842.583920:0:13232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762842.583930:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c56f539 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7db expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.583940:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:2.0:1789762842.583945:0:13232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762842.583952:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f651 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.583959:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f651 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.583964:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f651 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.583982:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f658 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.583988:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f658 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.583992:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f658 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584047:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f65f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584056:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f65f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584064:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f65f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762842.584346:0:13232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].10, 64 off8832 00000040:00080000:2.0:1789762842.584358:0:13232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8640 00010000:00010000:2.0:1789762842.584392:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f666 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584399:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584404:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584409:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f666 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584421:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f666 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584425:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f666 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584438:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762842.584446:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f65f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584450:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f65f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584455:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f65f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.584458:0:6671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762842.584459:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f96400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762842.584465:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f666 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584465:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f65f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.584486:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762842.584487:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f65f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.584497:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f666 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584502:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff95d142a04600) 00010000:00010000:2.0:1789762842.584512:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762842.584518:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f666 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584519:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f65f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.584537:0:6671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff95d142a04600) 00010000:00010000:2.0:1789762842.584537:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f65f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.584544:0:6671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789762842.584548:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f666 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.584553:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f666 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584578:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f651 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.584581:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762842.584584:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762842.584587:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f651 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.584589:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762842.584595:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f651 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584599:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f96800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762842.584601:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f651 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584605:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f651 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584611:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d151e90400) 00010000:00010000:2.0:1789762842.584613:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762842.584615:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f651 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.584619:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f651 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762842.584625:0:13232:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000292db1b6 reply state 00000000967cf47d transno 4294967432 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f658 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762842.584630:0:13232:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762842.584662:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+20:12232:x1876702140709248:12345-192.168.203.31@tcp:36:rm.0 Request processed in 761us (857us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789762842.584667:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 169 00010000:00010000:3.0:1789762842.585135:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f658 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.585143:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f658 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.585147:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f658 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.585151:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.585153:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f658 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.585157:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f658 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.585164:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0xf4d4877e (ffff95d142a04900) 00010000:00010000:3.0:1789762842.585166:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.585168:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f658 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.585171:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f658 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762842.586532:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.586577:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140709504 00000100:00100000:2.0:1789762842.586583:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140709504 00000100:00100000:2.0:1789762842.586615:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1789762842.586622:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+19:12232:x1876702140709504:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:2.0:1789762842.586703:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+20:12232:x1876702140709504:12345-192.168.203.31@tcp:35:rm.0 Request processed in 82us (171us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1789762842.586708:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1789762842.587414:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.587436:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140709760 00000100:00100000:3.0:1789762842.587440:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140709760 00000100:00100000:3.0:1789762842.587465:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 170 00000100:00100000:3.0:1789762842.587470:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+20:12232:x1876702140709760:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:3.0:1789762842.587495:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789762842.587504:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f627 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e860 expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.587515:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f51d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7d4 expref: 19 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.587522:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d151e90400) 00010000:00010000:3.0:1789762842.587529:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56f4bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e7bf expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.587535:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:3.0:1789762842.587539:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762842.587547:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f66d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.587553:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f66d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.587558:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f66d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.587564:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f674 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.587569:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f674 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.587573:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f674 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.587681:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f67b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.587688:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f67b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.587693:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f67b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762842.588027:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 16384 00010000:00010000:3.0:1789762842.588034:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f67b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.588039:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f67b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.588043:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f67b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.588047:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.588049:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f67b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.588053:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f67b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.588059:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff95d15055dc00) 00010000:00010000:3.0:1789762842.588061:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789762842.588063:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f67b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.588074:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f67b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.588087:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f66d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.588106:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f66d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.588113:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f66d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.588117:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.588119:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f66d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.588123:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f66d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.588129:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055df00) 00010000:00010000:3.0:1789762842.588130:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.588134:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f66d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.588140:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f66d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762842.588153:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df52cf68 reply state 000000004e491cd6 transno 4294967434 ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f674 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762842.588161:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762842.588206:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+19:12232:x1876702140709760:12345-192.168.203.31@tcp:36:rm.0 Request processed in 735us (792us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789762842.588211:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 170 00010000:00010000:2.0:1789762842.588712:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f674 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.588719:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f674 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.588723:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f674 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.588726:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762842.588729:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f674 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.588734:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f674 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.588740:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055d700) 00010000:00010000:2.0:1789762842.588742:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762842.588744:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f674 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.588748:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f674 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.662927:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762842.867761:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.867814:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140709888 00000100:00100000:2.0:1789762842.867823:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140709888 00000100:00100000:2.0:1789762842.867969:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:2.0:1789762842.867984:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+18:12243:x1876702140709888:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:2.0:1789762842.868005:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762842.868026:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f682 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e867 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.868108:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f689 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.868121:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f689 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.868130:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f689 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762842.868160:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762842.868164:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762842.868179:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f689 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.868202:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f682 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e867 expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.868220:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f689 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e867 expref: 19 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.868226:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04600) 00010000:00010000:2.0:1789762842.868240:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762842.868244:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f96400, rc 0) 00000100:00100000:2.0:1789762842.868296:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+19:12243:x1876702140709888:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 319us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762842.868304:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:0.0:1789762842.869290:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.869321:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140710144 00000100:00100000:3.0:1789762842.869327:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140710144 00000100:00100000:3.0:1789762842.869357:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:3.0:1789762842.869365:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+19:12243:x1876702140710144:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:3.0:1789762842.869394:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762842.869407:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96400/0xd08452c77c56f689 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e867 expref: 19 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.869418:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04600) 00010000:00010000:3.0:1789762842.869424:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762842.869476:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f690 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.869484:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f690 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.869490:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f690 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.869503:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f697 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.869511:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f697 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.869519:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f697 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762842.870143:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 16384 00010000:00010000:3.0:1789762842.870151:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f690 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.870156:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f690 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.870161:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f690 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.870166:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.870169:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f690 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.870174:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f690 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.870181:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d000) 00010000:00010000:3.0:1789762842.870182:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.870185:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f690 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.870189:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f690 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762842.870199:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009963480b reply state 00000000b1441bb5 transno 4294967435 ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f697 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762842.870205:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762842.870246:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+20:12243:x1876702140710144:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 882us (957us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1789762842.870260:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 172 00010000:00010000:3.0:1789762842.870777:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f697 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.870784:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f697 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.870789:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f697 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.870793:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.870795:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f697 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.870799:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f697 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.870807:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055df00) 00010000:00010000:3.0:1789762842.870809:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.870812:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f697 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.870819:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f697 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762842.875070:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.875124:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140710272 00000100:00100000:2.0:1789762842.875131:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140710272 00000100:00100000:2.0:1789762842.875171:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:2.0:1789762842.875180:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+19:12244:x1876702140710272:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762842.875192:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762842.875205:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f69e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e86e expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.875244:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f6a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.875255:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.875263:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762842.875283:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762842.875286:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762842.875298:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.875318:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f69e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e86e expref: 21 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.875345:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e86e expref: 20 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.875353:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04900) 00010000:00010000:2.0:1789762842.875356:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762842.875359:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f97400, rc 0) 00000100:00100000:2.0:1789762842.875402:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+20:12244:x1876702140710272:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 223us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762842.875411:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:0.0:1789762842.876271:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.876301:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140710528 00000100:00100000:3.0:1789762842.876307:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140710528 00000100:00100000:3.0:1789762842.876338:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:3.0:1789762842.876345:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+20:12244:x1876702140710528:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762842.876353:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762842.876361:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789762842.876372:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97400/0xd08452c77c56f6a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e86e expref: 20 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876389:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04900) 00010000:00010000:3.0:1789762842.876396:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762842.876404:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f6ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e875 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876481:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f6b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876488:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876494:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876504:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f6ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876509:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876514:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876560:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f6c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876565:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876580:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762842.876586:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 16384 00010000:00010000:3.0:1789762842.876595:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876600:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f6c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876604:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876608:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.876610:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876615:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876621:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff95d15055d400) 00010000:00010000:3.0:1789762842.876623:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.876625:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f6c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876629:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c56f6c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876640:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876644:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f6b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876655:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f6b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876658:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.876660:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f6b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876664:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f6b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876669:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055dc00) 00010000:00010000:3.0:1789762842.876671:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.876672:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f6b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876676:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c56f6b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876683:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876687:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f6ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876691:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f6ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876694:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.876697:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f6ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876709:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f6ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876714:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055d200) 00010000:00010000:3.0:1789762842.876716:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.876718:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f6ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876721:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c56f6ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876738:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f6ac lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e875 expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876744:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055dc00) 00010000:00010000:3.0:1789762842.876745:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.876748:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c56f6ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e875 expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.876755:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140031200, rc 0) 00000100:00100000:3.0:1789762842.876782:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+19:12244:x1876702140710528:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 438us (513us total) trans 0 rc 301/301 00000100:00100000:3.0:1789762842.876787:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:0.0:1789762842.877685:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.877725:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140710656 00000100:00100000:2.0:1789762842.877731:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140710656 00000100:00100000:2.0:1789762842.877765:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:2.0:1789762842.877775:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+19:12244:x1876702140710656:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762842.877784:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762842.877796:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f6c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e87c expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.877827:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f6cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.877863:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f6cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.877872:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f6cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762842.877890:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762842.877898:0:13232:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762842.877913:0:13232:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f6cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.877933:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f6c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e87c expref: 21 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.877948:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f6cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e87c expref: 20 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.877956:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:2.0:1789762842.877959:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762842.877962:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f96e00, rc 0) 00000100:00100000:2.0:1789762842.877997:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+20:12244:x1876702140710656:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 223us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762842.878005:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:0.0:1789762842.879184:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.879217:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140710912 00000100:00100000:3.0:1789762842.879222:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140710912 00000100:00100000:3.0:1789762842.879253:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:3.0:1789762842.879260:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+20:12244:x1876702140710912:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762842.879277:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762842.879286:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f6d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e883 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879316:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f6dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879324:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f6dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879330:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f6dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879341:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f6e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879346:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879351:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762842.879393:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 16384 00010000:00010000:3.0:1789762842.879440:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f6dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879445:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f6dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879449:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f6dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879462:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.879464:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f6dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879469:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f6dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879477:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:3.0:1789762842.879478:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.879481:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f6dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879485:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c56f6dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879494:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879498:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f6e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879502:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879506:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.879508:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879511:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f6e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879524:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055df00) 00010000:00010000:3.0:1789762842.879526:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.879529:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f6e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879532:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c56f6e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879554:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f6d6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e883 expref: 22 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879560:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:3.0:1789762842.879561:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762842.879564:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c56f6d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e883 expref: 22 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.879571:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030600, rc 0) 00000100:00100000:3.0:1789762842.879601:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+21:12244:x1876702140710912:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 343us (421us total) trans 4294967436 rc 301/301 00000100:00100000:3.0:1789762842.879607:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:0.0:1789762842.880436:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.880469:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140711168 00000100:00100000:2.0:1789762842.880474:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140711168 00000100:00100000:2.0:1789762842.880507:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:2.0:1789762842.880515:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+21:12244:x1876702140711168:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:2.0:1789762842.880564:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f6f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.880576:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.880586:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762842.880718:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a2475c1 reply state 00000000bb196403 transno 4294967437 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762842.880732:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762842.880738:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 16384 00000100:00100000:2.0:1789762842.880782:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+23:12244:x1876702140711168:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 268us (347us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789762842.880788:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 177 00010000:00010000:2.0:1789762842.881457:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.881464:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f6f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.881470:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f6f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.881474:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f96c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762842.881476:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f6f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.881481:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f6f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.881488:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff95d142a04c00) 00010000:00010000:2.0:1789762842.881491:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789762842.881494:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f6f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.881498:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f6f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762842.881623:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.881662:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140711424 00000100:00100000:2.0:1789762842.881673:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140711424 00000100:00100000:2.0:1789762842.881703:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:2.0:1789762842.881711:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+22:12244:x1876702140711424:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1789762842.881814:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+23:12244:x1876702140711424:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 104us (192us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789762842.881820:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:0.0:1789762842.885291:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.885330:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140711552 00000100:00100000:3.0:1789762842.885336:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140711552 00000100:00100000:3.0:1789762842.885365:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:3.0:1789762842.885371:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+23:12245:x1876702140711552:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:3.0:1789762842.885387:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762842.885396:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f6f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e88a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885435:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f700 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885442:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f700 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885449:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f700 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885458:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f707 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885463:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885468:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885511:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56f70e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885520:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56f70e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885528:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56f70e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762842.885549:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 16384 00000004:00200000:3.0:1789762842.885553:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762842.885565:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56f70e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885582:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f700 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885587:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f700 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885592:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f700 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885596:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.885598:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f700 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885603:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f700 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885609:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:3.0:1789762842.885611:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.885613:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885617:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c56f700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885624:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885629:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f707 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885633:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f707 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885641:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.885644:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f707 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885647:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f707 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885652:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055d000) 00010000:00010000:3.0:1789762842.885654:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.885655:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f707 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885659:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f707 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885677:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c56f6f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e88a expref: 25 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885685:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56f70e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e88a expref: 24 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.885690:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff95d15055d800) 00010000:00010000:3.0:1789762842.885691:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762842.885693:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16002a800, rc 0) 00000100:00100000:3.0:1789762842.885721:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+24:12245:x1876702140711552:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 350us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762842.885726:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:0.0:1789762842.886686:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.886730:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140711808 00000100:00100000:2.0:1789762842.886736:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140711808 00000100:00100000:2.0:1789762842.886771:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:2.0:1789762842.886783:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+24:12245:x1876702140711808:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:2.0:1789762842.886807:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762842.886820:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002a800/0xd08452c77c56f70e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e88a expref: 24 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.886859:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff95d15055d800) 00010000:00010000:2.0:1789762842.886868:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762842.886883:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f715 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.886893:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.886902:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762842.887005:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef956f57 reply state 000000009922e093 transno 4294967439 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762842.887014:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762842.887026:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 16384 00000100:00100000:2.0:1789762842.887071:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+25:12245:x1876702140711808:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 291us (385us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789762842.887080:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 179 00010000:00010000:3.0:1789762842.887629:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.887643:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f715 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.887648:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f715 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.887652:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f96800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.887655:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f715 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.887659:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f715 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.887666:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff95d142a04d00) 00010000:00010000:3.0:1789762842.887667:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789762842.887670:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f715 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.887674:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96800/0xd08452c77c56f715 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762842.906633:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.906713:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140711936 00000100:00100000:3.0:1789762842.906721:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140711936 00000100:00100000:3.0:1789762842.906769:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:3.0:1789762842.906777:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+24:12251:x1876702140711936:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:3.0:1789762842.906795:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762842.906811:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f71c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e891 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907073:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ba00/0xd08452c77c56f723 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907103:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ba00/0xd08452c77c56f723 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907113:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ba00/0xd08452c77c56f723 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907124:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b800/0xd08452c77c56f72a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907129:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b800/0xd08452c77c56f72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907133:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b800/0xd08452c77c56f72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907215:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f731 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907220:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907224:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762842.907238:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 16384 00000004:00200000:3.0:1789762842.907241:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762842.907254:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907263:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ba00/0xd08452c77c56f723 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907275:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ba00/0xd08452c77c56f723 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907280:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ba00/0xd08452c77c56f723 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907284:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ba00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.907287:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ba00/0xd08452c77c56f723 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907293:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ba00/0xd08452c77c56f723 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907301:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:3.0:1789762842.907303:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.907307:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ba00/0xd08452c77c56f723 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907310:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ba00/0xd08452c77c56f723 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907317:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b800/0xd08452c77c56f72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907322:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b800/0xd08452c77c56f72a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907326:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b800/0xd08452c77c56f72a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907329:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762842.907334:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b800/0xd08452c77c56f72a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907339:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b800/0xd08452c77c56f72a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907343:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055d000) 00010000:00010000:3.0:1789762842.907345:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762842.907346:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b800/0xd08452c77c56f72a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907350:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b800/0xd08452c77c56f72a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907371:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002b400/0xd08452c77c56f71c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e891 expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907380:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e891 expref: 25 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.907384:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff95d15055df00) 00010000:00010000:3.0:1789762842.907386:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789762842.907387:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16002ac00, rc 0) 00000100:00100000:3.0:1789762842.907436:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+25:12251:x1876702140711936:12345-192.168.203.31@tcp:101:dd.500 Request processed in 658us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762842.907444:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:0.0:1789762842.908487:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.908519:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140712192 00000100:00100000:2.0:1789762842.908525:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140712192 00000100:00100000:2.0:1789762842.908557:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:2.0:1789762842.908565:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+25:12251:x1876702140712192:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:2.0:1789762842.908576:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762842.908586:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f738 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e898 expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.908695:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f73f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.908707:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f73f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.908715:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f73f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.908743:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f746 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.908749:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.908759:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789762842.909210:0:13232:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb:0x0], index 0: 0 00010000:00010000:2.0:1789762842.909329:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f74d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.909336:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f74d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.909342:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f74d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.909362:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f73f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.909369:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f73f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.909377:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f73f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.909383:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762842.909386:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f73f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.909394:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f73f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.909404:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff95d15055df00) 00010000:00010000:2.0:1789762842.909407:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762842.909410:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f73f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.909417:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97000/0xd08452c77c56f73f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762842.909435:0:13232:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f614966 reply state 000000005bfffb19 transno 4294967440 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762842.909441:0:13232:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789762842.909458:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96c00/0xd08452c77c56f738 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e898 expref: 28 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.909466:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f74d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e898 expref: 27 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.909471:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff95d142a04b00) 00010000:00010000:2.0:1789762842.909473:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762842.909475:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f97a00, rc 0) 00000100:00100000:2.0:1789762842.909520:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+28:12251:x1876702140712192:12345-192.168.203.31@tcp:101:dd.500 Request processed in 957us (1035us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789762842.909525:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 181 00010000:00010000:2.0:1789762842.910077:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.910083:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f746 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.910087:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.910103:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762842.910105:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.910118:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f746 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.910125:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x4009f790 (ffff95d142a04c00) 00010000:00010000:2.0:1789762842.910127:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762842.910129:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f746 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.910133:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56f746 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762842.912551:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.912584:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140712320 00000100:00100000:2.0:1789762842.912589:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140712320 00000100:00100000:2.0:1789762842.912620:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246914899434 time 246914973911 state 0x0 ref 1 00000100:00100000:2.0:1789762842.912631:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 246964973911 time 246914973911 state 0x1 ref 1 00000100:00100000:2.0:1789762842.912660:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 2 deadline 246964973911 time 247385821741 state 0x0 ref 1 00000100:00100000:2.0:1789762842.912669:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+38:2344:x1876702140712320:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762842.912697:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789762842.912702:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f75b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.912711:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:2.0:1789762842.912715:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762842.912724:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f75b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.912733:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f75b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762842.933490:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967568 is committed 00000001:00080000:3.0:1789762842.933513:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967569 is committed 00000001:00080000:3.0:1789762842.933525:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967571 is committed 00002000:00010000:1.0:1789762842.933553:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1789762842.933558:0:13229:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1789762842 00002000:00010000:1.0:1789762842.933560:0:13229:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1789762842 00002000:00010000:1.0:1789762842.933563:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1789762842.933577:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f75b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.933591:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f75b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.933601:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f75b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.933610:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762842.933624:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f75b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.933635:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f75b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.933654:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f75b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.933660:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f75b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762842.933741:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140712320:12345-192.168.203.31@tcp:4:dd.500 Request processed in 21069us (21187us total) trans 4294967571 rc 0/0 00000100:00100000:1.0:1789762842.933750:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:1.0:1789762842.933760:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 2 deadline 246964973911 time 247385821741 state 0x2 ref 0 00000100:00100000:0.0:1789762842.946861:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762842.946943:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140712448 00000100:00100000:1.0:1789762842.946953:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140712448 00000100:00100000:1.0:1789762842.946998:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 2 deadline 246964973911 time 247385821741 state 0x0 ref 1 00000100:00100000:1.0:1789762842.947010:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 2 deadline 247435821741 time 247385821741 state 0x1 ref 1 00000100:00100000:1.0:1789762842.947034:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 1 deadline 247435821741 time 247420196220 state 0x0 ref 1 00000100:00100000:1.0:1789762842.947044:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140712448:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762842.947083:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 1048576, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x803 00010000:00010000:1.0:1789762842.947103:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f762 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.947117:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:1.0:1789762842.947121:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762842.947125:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f762 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.947139:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f762 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762842.958898:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967572 is committed 00002000:00010000:1.0:1789762842.958902:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1789762842.958908:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1789762842.958917:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f762 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.958927:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f762 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.958934:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f762 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.958939:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762842.958943:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f762 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.958959:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f762 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.958972:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f762 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.958978:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f762 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762842.959032:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140712448:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11988us (12173us total) trans 4294967572 rc 0/0 00000100:00100000:1.0:1789762842.959040:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:1.0:1789762842.959049:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 1 deadline 247435821741 time 247420196220 state 0x2 ref 0 00000100:00100000:0.0:1789762842.961050:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762842.961105:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140712576 00000100:00100000:3.0:1789762842.961114:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140712576 00000100:00100000:3.0:1789762842.961157:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 1 deadline 247435821741 time 247420196220 state 0x0 ref 1 00000100:00100000:3.0:1789762842.961167:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 1 deadline 247470196220 time 247420196220 state 0x1 ref 1 00000100:00100000:3.0:1789762842.961187:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247470196220 time 247434350053 state 0x0 ref 1 00000100:00100000:3.0:1789762842.961197:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140712576:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762842.961222:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 2097152, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x1007 00010000:00010000:3.0:1789762842.961227:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56f769 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.961237:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:3.0:1789762842.961240:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762842.961244:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56f769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.961253:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56f769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762842.972610:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967573 is committed 00002000:00010000:1.0:1789762842.972626:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1789762842.972631:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1789762842.972643:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56f769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.972657:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56f769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.972667:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56f769 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.972689:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762842.972694:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56f769 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.972701:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56f769 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.972716:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56f769 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.972721:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062b002c7/0xd08452c77c56f769 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762842.972782:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140712576:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11583us (11729us total) trans 4294967573 rc 0/0 00000100:00100000:1.0:1789762842.972790:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1789762842.972799:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247470196220 time 247434350053 state 0x2 ref 0 00000100:00100000:3.0:1789762842.974729:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762842.974784:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140712704 00000100:00100000:2.0:1789762842.974794:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140712704 00000100:00100000:2.0:1789762842.974851:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247470196220 time 247434350053 state 0x0 ref 1 00000100:00100000:2.0:1789762842.974863:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247484350053 time 247434350053 state 0x1 ref 1 00000100:00100000:0.0:1789762843.011292:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247484350053 time 247484441825 state 0x0 ref 1 00000100:00100000:0.0:1789762843.011332:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140712704:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:1.0:1789762843.011377:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789762843.011381:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 3145728, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x1807 00010000:00010000:0.0:1789762843.011388:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ee9ba4f/0xd08452c77c56f770 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.011402:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:0.0:1789762843.011405:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762843.011410:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ee9ba4f/0xd08452c77c56f770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.011420:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ee9ba4f/0xd08452c77c56f770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762843.022120:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967574 is committed 00002000:00010000:1.0:1789762843.022156:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1789762843.022162:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1789762843.022174:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ee9ba4f/0xd08452c77c56f770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.022187:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ee9ba4f/0xd08452c77c56f770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.022203:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ee9ba4f/0xd08452c77c56f770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.022208:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0452b7200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.022212:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee9ba4f/0xd08452c77c56f770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.022218:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee9ba4f/0xd08452c77c56f770 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.022231:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ee9ba4f/0xd08452c77c56f770 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.022236:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ee9ba4f/0xd08452c77c56f770 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.022292:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140712704:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10984us (47562us total) trans 4294967574 rc 0/0 00000100:00100000:1.0:1789762843.022299:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:1.0:1789762843.022308:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247484350053 time 247484441825 state 0x2 ref 0 00000100:00100000:3.0:1789762843.024339:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762843.024376:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140712832 00000100:00100000:1.0:1789762843.024384:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140712832 00000100:00100000:1.0:1789762843.024420:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247484350053 time 247484441825 state 0x0 ref 1 00000100:00100000:1.0:1789762843.024440:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247534441825 time 247484441825 state 0x1 ref 1 00000100:00100000:1.0:1789762843.061336:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247534441825 time 247534492411 state 0x0 ref 1 00000100:00100000:1.0:1789762843.061353:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140712832:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.061387:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 4194304, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x2007 00010000:00010000:1.0:1789762843.061393:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f777 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.061404:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:1.0:1789762843.061408:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.061412:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.061422:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762843.073496:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967575 is committed 00002000:00010000:1.0:1789762843.073516:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1789762843.073522:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1789762843.073533:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.073542:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.073560:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.073565:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.073568:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.073574:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.073587:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f777 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.073593:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f777 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.073649:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140712832:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12297us (49308us total) trans 4294967575 rc 0/0 00000100:00100000:1.0:1789762843.073657:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:1.0:1789762843.073665:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247534441825 time 247534492411 state 0x2 ref 0 00000100:00100000:2.0:1789762843.075604:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762843.075671:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140712960 00000100:00100000:1.0:1789762843.075679:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140712960 00000100:00100000:1.0:1789762843.075716:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247534441825 time 247534492411 state 0x0 ref 1 00000100:00100000:1.0:1789762843.075736:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247584492411 time 247534492411 state 0x1 ref 1 00000100:00100000:1.0:1789762843.111389:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247584492411 time 247584542607 state 0x0 ref 1 00000100:00100000:1.0:1789762843.111408:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140712960:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.111450:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 5242880, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x2807 00010000:00010000:1.0:1789762843.111457:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f77e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.111469:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:1.0:1789762843.111472:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.111477:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f77e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.111488:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f77e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762843.123549:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967576 is committed 00002000:00010000:1.0:1789762843.123568:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:1.0:1789762843.123574:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1789762843.123588:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f77e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.123598:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f77e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.123615:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f77e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.123620:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.123624:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f77e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.123630:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.123646:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f77e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.123651:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f77e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.123717:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140712960:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12312us (48111us total) trans 4294967576 rc 0/0 00000100:00100000:1.0:1789762843.123727:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:1.0:1789762843.123740:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247584492411 time 247584542607 state 0x2 ref 0 00000100:00100000:3.0:1789762843.125849:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762843.125871:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140713088 00000100:00100000:1.0:1789762843.125879:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140713088 00000100:00100000:1.0:1789762843.125915:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247584492411 time 247584542607 state 0x0 ref 1 00000100:00100000:1.0:1789762843.125934:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247634542607 time 247584542607 state 0x1 ref 1 00000100:00100000:1.0:1789762843.161435:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247634542607 time 247634589189 state 0x0 ref 1 00000100:00100000:1.0:1789762843.161453:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140713088:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.161492:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 6291456, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x3007 00010000:00010000:1.0:1789762843.161499:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f785 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.161511:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:1.0:1789762843.161515:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.161519:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.161529:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762843.173014:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967577 is committed 00002000:00010000:1.0:1789762843.173031:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1789762843.173038:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1789762843.173050:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.173064:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f785 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.173101:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f785 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.173111:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.173116:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f785 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.173126:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f785 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.173139:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f785 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.173145:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f785 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.173204:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140713088:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11753us (47369us total) trans 4294967577 rc 0/0 00000100:00100000:1.0:1789762843.173214:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:1.0:1789762843.173225:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247634542607 time 247634589189 state 0x2 ref 0 00000100:00100000:3.0:1789762843.175288:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762843.175321:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140713216 00000100:00100000:1.0:1789762843.175328:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140713216 00000100:00100000:1.0:1789762843.175363:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247634542607 time 247634589189 state 0x0 ref 1 00000100:00100000:1.0:1789762843.175382:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247684589189 time 247634589189 state 0x1 ref 1 00000100:00100000:1.0:1789762843.211474:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247684589189 time 247684629629 state 0x0 ref 1 00000100:00100000:1.0:1789762843.211492:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140713216:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.211528:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 7340032, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x3807 00010000:00010000:1.0:1789762843.211534:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f78c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.211546:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:1.0:1789762843.211549:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.211554:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f78c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.211565:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f78c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762843.223690:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967578 is committed 00002000:00010000:1.0:1789762843.223730:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:1.0:1789762843.223737:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1789762843.223749:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f78c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.223760:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f78c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.223778:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f78c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.223783:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.223786:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f78c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.223793:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f78c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.223808:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f78c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.223814:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f78c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.223914:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140713216:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12423us (48623us total) trans 4294967578 rc 0/0 00000100:00100000:1.0:1789762843.223922:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:1.0:1789762843.223932:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247684589189 time 247684629629 state 0x2 ref 0 00000100:00100000:0.0:1789762843.226196:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762843.226231:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140713344 00000100:00100000:1.0:1789762843.226239:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140713344 00000100:00100000:1.0:1789762843.226278:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247684589189 time 247684629629 state 0x0 ref 1 00000100:00100000:1.0:1789762843.226297:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247734629629 time 247684629629 state 0x1 ref 1 00000100:00100000:1.0:1789762843.261516:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247734629629 time 247734668341 state 0x0 ref 1 00000100:00100000:1.0:1789762843.261533:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140713344:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.261574:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 8388608, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x4007 00010000:00010000:1.0:1789762843.261581:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f793 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.261593:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:1.0:1789762843.261597:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.261602:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f793 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.261612:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f793 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762843.272172:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967579 is committed 00002000:00010000:1.0:1789762843.272180:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:1.0:1789762843.272185:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:1.0:1789762843.272195:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f793 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.272204:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f793 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.272221:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f793 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.272227:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.272230:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f793 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.272237:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f793 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.272250:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f793 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.272256:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f793 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.272312:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140713344:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10781us (46115us total) trans 4294967579 rc 0/0 00000100:00100000:1.0:1789762843.272319:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1789762843.272327:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247734629629 time 247734668341 state 0x2 ref 0 00000100:00100000:3.0:1789762843.274360:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762843.274399:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140713472 00000100:00100000:1.0:1789762843.274408:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140713472 00000100:00100000:1.0:1789762843.274451:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247734629629 time 247734668341 state 0x0 ref 1 00000100:00100000:1.0:1789762843.274472:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247784668341 time 247734668341 state 0x1 ref 1 00000100:00100000:1.0:1789762843.311586:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247784668341 time 247784737937 state 0x0 ref 1 00000100:00100000:1.0:1789762843.311607:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140713472:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.311650:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 9437184, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x4807 00010000:00010000:1.0:1789762843.311657:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f79a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.311670:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:1.0:1789762843.311673:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.311678:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f79a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.311688:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f79a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762843.321979:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967580 is committed 00002000:00010000:1.0:1789762843.322003:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:1.0:1789762843.322008:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:1.0:1789762843.322019:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f79a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.322028:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f79a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.322045:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f79a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.322051:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.322054:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f79a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.322061:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f79a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.322074:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f79a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.322080:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f79a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.322150:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140713472:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10548us (47789us total) trans 4294967580 rc 0/0 00000100:00100000:1.0:1789762843.322158:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:1.0:1789762843.322167:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247784668341 time 247784737937 state 0x2 ref 0 00000100:00100000:3.0:1789762843.324189:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762843.324237:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140713600 00000100:00100000:0.0:1789762843.324244:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140713600 00000100:00100000:0.0:1789762843.324279:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247784668341 time 247784737937 state 0x0 ref 1 00000100:00100000:0.0:1789762843.324290:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247834737937 time 247784737937 state 0x1 ref 1 00000100:00100000:1.0:1789762843.361663:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247834737937 time 247834818331 state 0x0 ref 1 00000100:00100000:1.0:1789762843.361681:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140713600:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.361727:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 10485760, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x5007 00010000:00010000:1.0:1789762843.361734:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.361745:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:1.0:1789762843.361749:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.361753:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.361763:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762843.372041:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967581 is committed 00002000:00010000:1.0:1789762843.372049:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:1.0:1789762843.372055:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 20487 -> 22535 00010000:00010000:1.0:1789762843.372064:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.372074:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.372081:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.372097:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.372101:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.372118:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.372132:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.372137:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.372192:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140713600:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10514us (48002us total) trans 4294967581 rc 0/0 00000100:00100000:1.0:1789762843.372199:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1789762843.372207:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247834737937 time 247834818331 state 0x2 ref 0 00000100:00100000:3.0:1789762843.374148:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762843.374183:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140713728 00000100:00100000:1.0:1789762843.374191:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140713728 00000100:00100000:1.0:1789762843.374230:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247834737937 time 247834818331 state 0x0 ref 1 00000100:00100000:1.0:1789762843.374242:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247884818331 time 247834818331 state 0x1 ref 1 00000100:00100000:1.0:1789762843.411727:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247884818331 time 247884875437 state 0x0 ref 1 00000100:00100000:1.0:1789762843.411760:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140713728:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.411809:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 11534336, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x5807 00010000:00010000:1.0:1789762843.411828:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.411858:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:1.0:1789762843.411861:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.411866:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.411877:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762843.425331:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967582 is committed 00002000:00010000:1.0:1789762843.425343:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:1.0:1789762843.425348:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 22535 -> 24583 00010000:00010000:1.0:1789762843.425359:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.425369:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.425377:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.425381:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.425385:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.425392:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.425413:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.425418:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.425491:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140713728:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13741us (51342us total) trans 4294967582 rc 0/0 00000100:00100000:1.0:1789762843.425501:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:1.0:1789762843.425510:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247884818331 time 247884875437 state 0x2 ref 0 00000100:00100000:3.0:1789762843.427611:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762843.427662:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140713856 00000100:00100000:0.0:1789762843.427671:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140713856 00000100:00100000:0.0:1789762843.427716:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247884818331 time 247884875437 state 0x0 ref 1 00000100:00100000:0.0:1789762843.427731:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247934875437 time 247884875437 state 0x1 ref 1 00000100:00100000:1.0:1789762843.461809:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247934875437 time 247934964704 state 0x0 ref 1 00000100:00100000:1.0:1789762843.461826:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140713856:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.461877:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 12582912, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x6007 00010000:00010000:1.0:1789762843.461884:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7af lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.461896:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:1.0:1789762843.461899:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.461903:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.461914:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762843.473614:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967583 is committed 00002000:00010000:1.0:1789762843.473624:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:1.0:1789762843.473629:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 24583 -> 26631 00010000:00010000:1.0:1789762843.473640:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.473650:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.473656:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.473661:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.473665:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.473672:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.473685:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7af lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.473690:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7af lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.473758:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140713856:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11933us (46146us total) trans 4294967583 rc 0/0 00000100:00100000:1.0:1789762843.473776:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:1.0:1789762843.473787:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247934875437 time 247934964704 state 0x2 ref 0 00000100:00100000:3.0:1789762843.475710:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762843.475744:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140713984 00000100:00100000:1.0:1789762843.475752:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140713984 00000100:00100000:1.0:1789762843.475788:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247934875437 time 247934964704 state 0x0 ref 1 00000100:00100000:1.0:1789762843.475799:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247984964704 time 247934964704 state 0x1 ref 1 00000100:00100000:1.0:1789762843.511874:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247984964704 time 247985026254 state 0x0 ref 1 00000100:00100000:1.0:1789762843.511893:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140713984:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.511938:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 13631488, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x6807 00010000:00010000:1.0:1789762843.511945:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.511958:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=247s v=(0 0) 00010000:00010000:1.0:1789762843.511961:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.511966:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.511977:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762843.522767:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967584 is committed 00002000:00010000:1.0:1789762843.522783:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:1.0:1789762843.522793:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 26631 -> 28679 00010000:00010000:1.0:1789762843.522804:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.522813:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.522820:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.522825:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.522828:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.522852:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.522866:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.522872:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.522927:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140713984:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11038us (47216us total) trans 4294967584 rc 0/0 00000100:00100000:1.0:1789762843.522935:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1789762843.522943:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247984964704 time 247985026254 state 0x2 ref 0 00000100:00100000:3.0:1789762843.524887:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762843.524921:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140714112 00000100:00100000:0.0:1789762843.524930:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140714112 00000100:00100000:0.0:1789762843.524967:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 247984964704 time 247985026254 state 0x0 ref 1 00000100:00100000:0.0:1789762843.524978:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248035026254 time 247985026254 state 0x1 ref 1 00000100:00100000:1.0:1789762843.561971:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248035026254 time 248035128183 state 0x0 ref 1 00000100:00100000:1.0:1789762843.561987:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140714112:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.562023:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 14680064, mtime: 0x6aad9d1a, atime: 0x0, ctime: 0x6aad9d1a, blocks: 0x7007 00010000:00010000:1.0:1789762843.562029:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.562041:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762843.562044:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.562048:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.562059:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762843.572668:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967585 is committed 00002000:00010000:1.0:1789762843.572719:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:1.0:1789762843.572724:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb mtime from disk: 1789762842 -> 1789762843 00002000:00010000:1.0:1789762843.572726:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb ctime from disk: 1789762842 -> 1789762843 00002000:00010000:1.0:1789762843.572728:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 28679 -> 30727 00010000:00010000:1.0:1789762843.572736:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.572745:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.572763:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.572768:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.572772:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.572778:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.572790:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.572795:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.572871:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140714112:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10886us (47985us total) trans 4294967585 rc 0/0 00000100:00100000:1.0:1789762843.572880:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1789762843.572888:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248035026254 time 248035128183 state 0x2 ref 0 00000100:00100000:3.0:1789762843.574973:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762843.575008:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140714240 00000100:00100000:1.0:1789762843.575016:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140714240 00000100:00100000:1.0:1789762843.575055:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248035026254 time 248035128183 state 0x0 ref 1 00000100:00100000:1.0:1789762843.575095:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248085128183 time 248035128183 state 0x1 ref 1 00000100:00100000:1.0:1789762843.612028:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248085128183 time 248085180394 state 0x0 ref 1 00000100:00100000:1.0:1789762843.612047:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140714240:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.612103:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 15728640, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0x7807 00010000:00010000:1.0:1789762843.612110:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.612129:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762843.612133:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.612138:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.612148:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762843.623534:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967586 is committed 00002000:00010000:1.0:1789762843.623561:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:1.0:1789762843.623566:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 30727 -> 32775 00010000:00010000:1.0:1789762843.623576:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.623587:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.623604:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.623610:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.623613:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.623620:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.623635:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.623640:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.623717:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140714240:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11672us (48740us total) trans 4294967586 rc 0/0 00000100:00100000:1.0:1789762843.623727:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:1.0:1789762843.623737:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248085128183 time 248085180394 state 0x2 ref 0 00000100:00100000:2.0:1789762843.625802:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762843.625854:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140714368 00000100:00100000:0.0:1789762843.625864:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140714368 00000100:00100000:0.0:1789762843.625901:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248085128183 time 248085180394 state 0x0 ref 1 00000100:00100000:0.0:1789762843.625912:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248135180394 time 248085180394 state 0x1 ref 1 00000100:00100000:1.0:1789762843.662135:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248135180394 time 248135290900 state 0x0 ref 1 00000100:00100000:1.0:1789762843.662151:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140714368:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.662195:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 16777216, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0x8007 00010000:00010000:1.0:1789762843.662202:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.662213:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762843.662217:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.662221:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.662231:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762843.672243:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967587 is committed 00002000:00010000:1.0:1789762843.672260:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:1.0:1789762843.672266:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 32775 -> 34823 00010000:00010000:1.0:1789762843.672276:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.672285:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.672291:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.672296:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.672300:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.672317:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.672331:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.672336:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.672396:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140714368:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10246us (46592us total) trans 4294967587 rc 0/0 00000100:00100000:1.0:1789762843.672405:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1789762843.672416:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248135180394 time 248135290900 state 0x2 ref 0 00000100:00100000:3.0:1789762843.674325:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762843.674360:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140714496 00000100:00100000:1.0:1789762843.674368:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140714496 00000100:00100000:1.0:1789762843.674414:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248135180394 time 248135290900 state 0x0 ref 1 00000100:00100000:1.0:1789762843.674428:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248185290900 time 248135290900 state 0x1 ref 1 00010000:00010000:1.0:1789762843.686950:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762843.712191:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248185290900 time 248185340394 state 0x0 ref 1 00000100:00100000:1.0:1789762843.712221:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140714496:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.712282:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 17825792, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0x8807 00010000:00010000:1.0:1789762843.712290:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.712303:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762843.712306:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.712311:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.712320:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762843.723045:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967588 is committed 00002000:00010000:1.0:1789762843.723069:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:1.0:1789762843.723076:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 34823 -> 36871 00010000:00010000:1.0:1789762843.723096:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.723105:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.723112:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.723118:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.723121:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.723137:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.723151:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.723156:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.723213:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140714496:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11004us (48887us total) trans 4294967588 rc 0/0 00000100:00100000:1.0:1789762843.723221:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:1.0:1789762843.723230:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248185290900 time 248185340394 state 0x2 ref 0 00000100:00100000:3.0:1789762843.725284:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762843.725331:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140714624 00000100:00100000:0.0:1789762843.725339:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140714624 00000100:00100000:0.0:1789762843.725376:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248185290900 time 248185340394 state 0x0 ref 1 00000100:00100000:0.0:1789762843.725387:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248235340394 time 248185340394 state 0x1 ref 1 00000100:00100000:1.0:1789762843.762247:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248235340394 time 248235403390 state 0x0 ref 1 00000100:00100000:1.0:1789762843.762264:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140714624:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.762299:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 18874368, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0x9007 00010000:00010000:1.0:1789762843.762306:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.762318:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762843.762321:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.762325:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.762344:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762843.772587:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967589 is committed 00002000:00010000:1.0:1789762843.772605:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:1.0:1789762843.772611:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 36871 -> 38919 00010000:00010000:1.0:1789762843.772622:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.772636:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.772645:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.772654:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.772657:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.772664:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.772677:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.772682:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.772743:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140714624:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10482us (47457us total) trans 4294967589 rc 0/0 00000100:00100000:1.0:1789762843.772750:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:1.0:1789762843.772758:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248235340394 time 248235403390 state 0x2 ref 0 00000100:00100000:3.0:1789762843.774753:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762843.774793:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140714752 00000100:00100000:1.0:1789762843.774801:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140714752 00000100:00100000:1.0:1789762843.774855:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248235340394 time 248235403390 state 0x0 ref 1 00000100:00100000:1.0:1789762843.774866:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248285403390 time 248235403390 state 0x1 ref 1 00000100:00100000:1.0:1789762843.812300:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248285403390 time 248285453690 state 0x0 ref 1 00000100:00100000:1.0:1789762843.812319:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140714752:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.812369:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 19922944, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0x9807 00010000:00010000:1.0:1789762843.812376:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.812389:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762843.812392:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.812397:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.812407:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762843.822790:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967590 is committed 00002000:00010000:1.0:1789762843.822809:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:1.0:1789762843.822816:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 38919 -> 40967 00010000:00010000:1.0:1789762843.822828:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.822859:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.822870:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.822879:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.822884:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.822894:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.822911:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.822916:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.822971:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140714752:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10657us (48218us total) trans 4294967590 rc 0/0 00000100:00100000:1.0:1789762843.822985:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:1.0:1789762843.822994:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248285403390 time 248285453690 state 0x2 ref 0 00000100:00100000:3.0:1789762843.824956:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762843.825033:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140714880 00000100:00100000:0.0:1789762843.825041:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140714880 00000100:00100000:0.0:1789762843.825077:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248285403390 time 248285453690 state 0x0 ref 1 00000100:00100000:0.0:1789762843.825104:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248335453690 time 248285453690 state 0x1 ref 1 00000100:00100000:1.0:1789762843.862363:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248335453690 time 248335518355 state 0x0 ref 1 00000100:00100000:1.0:1789762843.862380:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140714880:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.862415:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 20971520, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0xa007 00010000:00010000:1.0:1789762843.862422:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.862434:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762843.862437:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.862441:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.862450:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762843.872633:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967591 is committed 00002000:00010000:1.0:1789762843.872656:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:1.0:1789762843.872662:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 40967 -> 43015 00010000:00010000:1.0:1789762843.872673:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.872682:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.872698:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.872703:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.872706:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.872713:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.872725:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.872731:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.872781:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140714880:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10405us (47825us total) trans 4294967591 rc 0/0 00000100:00100000:1.0:1789762843.872789:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:1.0:1789762843.872797:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248335453690 time 248335518355 state 0x2 ref 0 00000100:00100000:3.0:1789762843.874719:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762843.874758:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140715008 00000100:00100000:1.0:1789762843.874766:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140715008 00000100:00100000:1.0:1789762843.874806:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248335453690 time 248335518355 state 0x0 ref 1 00000100:00100000:1.0:1789762843.874826:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248385518355 time 248335518355 state 0x1 ref 1 00000100:00100000:1.0:1789762843.912424:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248385518355 time 248385575350 state 0x0 ref 1 00000100:00100000:1.0:1789762843.912447:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140715008:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.912492:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 22020096, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0xa807 00010000:00010000:1.0:1789762843.912499:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.912512:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762843.912515:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.912520:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.912531:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762843.922987:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967592 is committed 00002000:00010000:1.0:1789762843.923011:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:1.0:1789762843.923017:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 43015 -> 45063 00010000:00010000:1.0:1789762843.923029:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.923039:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.923058:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.923063:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.923067:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.923073:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.923103:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.923109:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.923183:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140715008:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10739us (48458us total) trans 4294967592 rc 0/0 00000100:00100000:1.0:1789762843.923195:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:1.0:1789762843.923208:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248385518355 time 248385575350 state 0x2 ref 0 00000100:00100000:3.0:1789762843.925289:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762843.925338:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140715136 00000100:00100000:0.0:1789762843.925346:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140715136 00000100:00100000:0.0:1789762843.925392:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248385518355 time 248385575350 state 0x0 ref 1 00000100:00100000:0.0:1789762843.925403:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248435575350 time 248385575350 state 0x1 ref 1 00000100:00100000:1.0:1789762843.962487:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248435575350 time 248435638946 state 0x0 ref 1 00000100:00100000:1.0:1789762843.962507:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140715136:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762843.962567:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 23068672, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0xb007 00010000:00010000:1.0:1789762843.962577:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.962604:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762843.962607:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.962613:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.962624:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762843.973292:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967593 is committed 00002000:00010000:1.0:1789762843.973345:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:1.0:1789762843.973350:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 45063 -> 47111 00010000:00010000:1.0:1789762843.973360:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.973369:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.973376:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.973381:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762843.973385:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.973402:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.973416:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.973421:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.973483:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140715136:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10980us (48192us total) trans 4294967593 rc 0/0 00000100:00100000:1.0:1789762843.973490:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:1.0:1789762843.973499:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248435575350 time 248435638946 state 0x2 ref 0 00000100:00100000:3.0:1789762843.975564:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762843.975607:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140715264 00000100:00100000:2.0:1789762843.975616:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140715264 00000100:00100000:2.0:1789762843.975658:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248435575350 time 248435638946 state 0x0 ref 1 00000100:00100000:2.0:1789762843.975670:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248485638946 time 248435638946 state 0x1 ref 1 00000100:00100000:1.0:1789762844.012573:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248485638946 time 248485721467 state 0x0 ref 1 00000100:00100000:1.0:1789762844.012597:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140715264:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762844.012641:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 24117248, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0xb807 00010000:00010000:1.0:1789762844.012647:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.012669:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762844.012673:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762844.012678:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.012702:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762844.023488:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967594 is committed 00002000:00010000:1.0:1789762844.023507:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:1.0:1789762844.023512:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 47111 -> 49159 00010000:00010000:1.0:1789762844.023522:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.023531:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.023538:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.023543:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762844.023548:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.023558:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.023577:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.023586:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f7fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762844.023657:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140715264:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11066us (48091us total) trans 4294967594 rc 0/0 00000100:00100000:1.0:1789762844.023665:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:1.0:1789762844.023673:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248485638946 time 248485721467 state 0x2 ref 0 00000100:00100000:3.0:1789762844.025596:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762844.025635:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140715392 00000100:00100000:0.0:1789762844.025645:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140715392 00000100:00100000:0.0:1789762844.025683:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248485638946 time 248485721467 state 0x0 ref 1 00000100:00100000:0.0:1789762844.025694:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248535721467 time 248485721467 state 0x1 ref 1 00000100:00100000:1.0:1789762844.062670:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248535721467 time 248535823176 state 0x0 ref 1 00000100:00100000:1.0:1789762844.062689:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140715392:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762844.062729:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 25165824, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0xc007 00010000:00010000:1.0:1789762844.062736:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f803 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.062750:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762844.062755:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762844.062762:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.062777:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762844.073603:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967595 is committed 00002000:00010000:1.0:1789762844.073621:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:1.0:1789762844.073626:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 49159 -> 51207 00010000:00010000:1.0:1789762844.073639:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.073660:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.073667:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f803 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.073674:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762844.073680:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f803 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.073692:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f803 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.073713:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f803 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.073723:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f803 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762844.073791:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140715392:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11104us (48193us total) trans 4294967595 rc 0/0 00000100:00100000:1.0:1789762844.073800:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1789762844.073809:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248535721467 time 248535823176 state 0x2 ref 0 00000100:00100000:3.0:1789762844.076223:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762844.076275:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140715520 00000100:00100000:2.0:1789762844.076285:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140715520 00000100:00100000:2.0:1789762844.076331:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248535721467 time 248535823176 state 0x0 ref 1 00000100:00100000:2.0:1789762844.076346:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248585823176 time 248535823176 state 0x1 ref 1 00000100:00100000:1.0:1789762844.112764:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248585823176 time 248585907876 state 0x0 ref 1 00000100:00100000:1.0:1789762844.112815:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140715520:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762844.112884:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 26214400, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0xc807 00010000:00010000:1.0:1789762844.112891:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f80a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.112905:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762844.112909:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762844.112914:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f80a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.112924:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f80a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762844.123519:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967596 is committed 00002000:00010000:1.0:1789762844.123543:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:1.0:1789762844.123549:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 51207 -> 53257 00010000:00010000:1.0:1789762844.123561:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f80a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.123573:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f80a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.123583:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f80a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.123591:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762844.123603:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f80a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.123613:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f80a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.123632:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f80a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.123641:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f80a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762844.123718:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140715520:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10916us (47492us total) trans 4294967596 rc 0/0 00000100:00100000:1.0:1789762844.123729:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:1.0:1789762844.123742:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248585823176 time 248585907876 state 0x2 ref 0 00000100:00100000:3.0:1789762844.125811:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762844.125870:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140715648 00000100:00100000:0.0:1789762844.125879:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140715648 00000100:00100000:0.0:1789762844.125917:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248585823176 time 248585907876 state 0x0 ref 1 00000100:00100000:0.0:1789762844.125928:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248635907876 time 248585907876 state 0x1 ref 1 00000100:00100000:1.0:1789762844.162883:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248635907876 time 248636030850 state 0x0 ref 1 00000100:00100000:1.0:1789762844.162909:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140715648:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762844.162959:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 27262976, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0xd009 00010000:00010000:1.0:1789762844.162967:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f811 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.162982:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762844.162998:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762844.163004:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.163019:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762844.173940:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967597 is committed 00002000:00010000:1.0:1789762844.173974:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:1.0:1789762844.173981:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 53257 -> 55305 00010000:00010000:1.0:1789762844.173996:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.174008:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.174019:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.174027:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762844.174032:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.174043:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.174063:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f811 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.174102:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f811 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762844.174181:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140715648:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11278us (48367us total) trans 4294967597 rc 0/0 00000100:00100000:1.0:1789762844.174193:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1789762844.174205:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248635907876 time 248636030850 state 0x2 ref 0 00000100:00100000:0.0:1789762844.176363:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762844.176409:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140715776 00000100:00100000:2.0:1789762844.176424:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140715776 00000100:00100000:2.0:1789762844.176465:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248635907876 time 248636030850 state 0x0 ref 1 00000100:00100000:2.0:1789762844.176476:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248686030850 time 248636030850 state 0x1 ref 1 00000100:00100000:1.0:1789762844.212965:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248686030850 time 248686116914 state 0x0 ref 1 00000100:00100000:1.0:1789762844.212988:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140715776:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762844.213034:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 28311552, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0xd809 00010000:00010000:1.0:1789762844.213041:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f818 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.213054:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762844.213057:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762844.213062:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.213073:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762844.223548:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967598 is committed 00002000:00010000:1.0:1789762844.223574:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:1.0:1789762844.223587:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 55305 -> 57353 00010000:00010000:1.0:1789762844.223600:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.223611:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.223617:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.223622:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762844.223626:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.223632:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f818 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.223646:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f818 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.223651:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f818 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762844.223713:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140715776:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10730us (47348us total) trans 4294967598 rc 0/0 00000100:00100000:1.0:1789762844.223725:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:1.0:1789762844.223738:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248686030850 time 248686116914 state 0x2 ref 0 00000100:00100000:3.0:1789762844.225741:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762844.225798:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140715904 00000100:00100000:0.0:1789762844.225809:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140715904 00000100:00100000:0.0:1789762844.225865:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248686030850 time 248686116914 state 0x0 ref 1 00000100:00100000:0.0:1789762844.225876:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248736116914 time 248686116914 state 0x1 ref 1 00000100:00100000:1.0:1789762844.263024:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248736116914 time 248736177255 state 0x0 ref 1 00000100:00100000:1.0:1789762844.263042:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173c62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140715904:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762844.263097:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 29360128, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0xe009 00010000:00010000:1.0:1789762844.263104:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f81f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.263118:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762844.263123:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762844.263130:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f81f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.263145:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f81f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762844.273595:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967599 is committed 00002000:00010000:3.0:1789762844.273616:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:3.0:1789762844.273631:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 57353 -> 59401 00010000:00010000:3.0:1789762844.273643:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f81f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.273653:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f81f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.273660:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f81f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.273665:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762844.273668:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f81f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.273675:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f81f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.273689:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f81f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.273693:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56f81f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762844.273755:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173c62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140715904:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10716us (48013us total) trans 4294967599 rc 0/0 00000100:00100000:3.0:1789762844.273765:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:3.0:1789762844.273774:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248736116914 time 248736177255 state 0x2 ref 0 00000100:00100000:3.0:1789762844.275940:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762844.275994:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140716032 00000100:00100000:2.0:1789762844.276006:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140716032 00000100:00100000:2.0:1789762844.276059:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248736116914 time 248736177255 state 0x0 ref 1 00000100:00100000:2.0:1789762844.276077:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248786177255 time 248736177255 state 0x1 ref 1 00000100:00100000:1.0:1789762844.313148:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248786177255 time 248786297447 state 0x0 ref 1 00000100:00100000:1.0:1789762844.313173:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140716032:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762844.313225:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 30408704, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0xe809 00010000:00010000:1.0:1789762844.313232:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c56f826 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.313246:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:1.0:1789762844.313249:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762844.313266:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c56f826 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.313278:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c56f826 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762844.323737:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:0.0:1789762844.323743:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 59401 -> 61449 00000001:00080000:3.0:1789762844.323751:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967600 is committed 00010000:00010000:0.0:1789762844.323754:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c56f826 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.323765:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c56f826 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.323773:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c56f826 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.323789:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762844.323793:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c56f826 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.323800:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c56f826 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.323814:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c56f826 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.323819:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c56f826 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762844.323907:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140716032:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10743us (47966us total) trans 4294967600 rc 0/0 00000100:00100000:0.0:1789762844.323915:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1789762844.323924:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248786177255 time 248786297447 state 0x2 ref 0 00000100:00100000:0.0:1789762844.325919:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762844.325997:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140716160 00000100:00100000:1.0:1789762844.326006:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140716160 00000100:00100000:1.0:1789762844.326045:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248786177255 time 248786297447 state 0x0 ref 1 00000100:00100000:1.0:1789762844.326056:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248836297447 time 248786297447 state 0x1 ref 1 00000004:00080000:0.0:1789762844.326932:0:8167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 248800097435ns, next at 249800095200ns, rc = 0 00000100:00100000:1.0:1789762844.326948:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149022080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762844.326956:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149022208:0@lo:400:kworker.0 00000100:00100000:2.0:1789762844.326963:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149022464:0@lo:400:kworker.0 00000100:00100000:3.0:1789762844.327016:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149022336:0@lo:400:kworker.0 00000100:00100000:1.0:1789762844.327018:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762844.327025:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762844.327058:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762844.327096:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149022208 00000100:00100000:1.0:1789762844.327097:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149022592:0@lo:400:kworker.0 00000100:00100000:3.0:1789762844.327102:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149022208 00000100:00100000:0.0:1789762844.327107:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149022720:0@lo:400:kworker.0 00000100:00100000:2.0:1789762844.327128:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149022464 00000100:00100000:2.0:1789762844.327134:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149022464 00000100:00100000:1.0:1789762844.327138:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762844.327147:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762844.327149:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789762844.327160:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149022208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762844.327185:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149022720 00000100:00100000:2.0:1789762844.327189:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149022720 00000100:00100000:1.0:1789762844.327191:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149022080 00000100:00100000:1.0:1789762844.327198:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149022080 00000100:00100000:0.0:1789762844.327208:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789762844.327217:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149022208:12345-0@lo:400:kworker.0 Request processed in 59us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762844.327222:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149022464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762844.327226:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789762844.327235:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789762844.327242:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149022720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762844.327250:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789762844.327262:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149022080:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762844.327282:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149022464:12345-0@lo:400:kworker.0 Request processed in 66us (225us total) trans 0 rc 0/0 00002000:00000024:1.0:1789762844.327291:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 97058816 pending 25559040 free 3858759680 avail 3856662528 00000100:00100000:0.0:1789762844.327298:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789762844.327298:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149022720:12345-0@lo:400:kworker.0 Request processed in 54us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762844.327300:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762844.327310:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789762844.327322:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149022336 00000100:00100000:0.0:1789762844.327327:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149022336 00000100:00100000:3.0:1789762844.327334:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149022848:0@lo:400:kworker.0 00000100:00100000:1.0:1789762844.327353:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149022080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762844.327359:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789762844.327367:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789762844.327368:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762844.327373:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149022336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762844.327394:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149022592 00000100:00100000:2.0:1789762844.327399:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149022592 00000100:00100000:0.0:1789762844.327421:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149022336:12345-0@lo:400:kworker.0 Request processed in 51us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762844.327427:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149022336:0@lo:400:kworker.0 00000100:00100000:0.0:1789762844.327432:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789762844.327438:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149022848 00000100:00100000:2.0:1789762844.327441:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149022848 00000100:00100000:2.0:1789762844.327472:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789762844.327479:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149022464:0@lo:400:kworker.0 00000100:00100000:2.0:1789762844.327484:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149022592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762844.327490:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789762844.327504:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149022848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762844.327527:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149022720:0@lo:400:kworker.0 00000100:00100000:0.0:1789762844.327541:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149022208:0@lo:400:kworker.0 00000100:00100000:2.0:1789762844.327564:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149022592:12345-0@lo:400:kworker.0 Request processed in 84us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762844.327572:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789762844.327578:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149022848:12345-0@lo:400:kworker.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762844.327587:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789762844.327629:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149022848:0@lo:400:kworker.0 00000100:00080000:1.0:1789762844.327648:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789762844.327652:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762844.327654:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762844.327680:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149022592:0@lo:400:kworker.0 00000100:00100000:1.0:1789762844.327690:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149022080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762844.363243:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248836297447 time 248836397202 state 0x0 ref 1 00000100:00100000:3.0:1789762844.363262:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140716160:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762844.363310:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 31457280, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0xf009 00010000:00010000:3.0:1789762844.363317:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f82d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.363329:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:3.0:1789762844.363332:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762844.363337:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f82d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.363347:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f82d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762844.373585:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967601 is committed 00002000:00010000:3.0:1789762844.373610:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:3.0:1789762844.373615:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 61449 -> 63497 00010000:00010000:3.0:1789762844.373626:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f82d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.373635:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f82d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.373642:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f82d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.373647:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762844.373650:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f82d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.373667:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f82d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.373681:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f82d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.373687:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f82d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762844.373741:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140716160:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10483us (47820us total) trans 4294967601 rc 0/0 00000100:00100000:3.0:1789762844.373749:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:3.0:1789762844.373758:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248836297447 time 248836397202 state 0x2 ref 0 00000100:00100000:1.0:1789762844.375861:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762844.375897:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140716288 00000100:00100000:2.0:1789762844.375907:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140716288 00000100:00100000:2.0:1789762844.375961:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248836297447 time 248836397202 state 0x0 ref 1 00000100:00100000:2.0:1789762844.375975:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248886397202 time 248836397202 state 0x1 ref 1 00000100:00100000:0.0:1789762844.413335:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248886397202 time 248886488741 state 0x0 ref 1 00000100:00100000:0.0:1789762844.413355:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140716288:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762844.413396:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 32505856, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0xf809 00010000:00010000:0.0:1789762844.413404:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d8040d/0xd08452c77c56f834 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.413418:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:0.0:1789762844.413421:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762844.413436:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d8040d/0xd08452c77c56f834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.413449:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d8040d/0xd08452c77c56f834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762844.423880:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967602 is committed 00002000:00010000:0.0:1789762844.423888:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:0.0:1789762844.423893:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 63497 -> 65545 00010000:00010000:0.0:1789762844.423905:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d8040d/0xd08452c77c56f834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.423916:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d8040d/0xd08452c77c56f834 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.423923:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1d8040d/0xd08452c77c56f834 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.423928:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0452b7c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762844.423931:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d8040d/0xd08452c77c56f834 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.423938:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d8040d/0xd08452c77c56f834 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.423954:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1d8040d/0xd08452c77c56f834 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.423969:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d8040d/0xd08452c77c56f834 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762844.424041:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140716288:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10688us (48180us total) trans 4294967602 rc 0/0 00000100:00100000:0.0:1789762844.424050:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:0.0:1789762844.424060:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248886397202 time 248886488741 state 0x2 ref 0 00000100:00100000:0.0:1789762844.426503:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762844.426567:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140716416 00000100:00100000:1.0:1789762844.426578:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140716416 00000100:00100000:1.0:1789762844.426622:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248886397202 time 248886488741 state 0x0 ref 1 00000100:00100000:1.0:1789762844.426634:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248936488741 time 248886488741 state 0x1 ref 1 00000100:00100000:3.0:1789762844.463426:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248936488741 time 248936579163 state 0x0 ref 1 00000100:00100000:3.0:1789762844.463445:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140716416:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762844.463487:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 33554432, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0x10009 00010000:00010000:3.0:1789762844.463494:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f83b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.463508:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:3.0:1789762844.463513:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762844.463533:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f83b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.463549:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f83b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762844.474742:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:3.0:1789762844.474748:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 65545 -> 67593 00010000:00010000:3.0:1789762844.474759:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f83b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.474768:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f83b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.474775:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f83b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.474780:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762844.474784:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f83b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.474790:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f83b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.474804:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f83b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.474820:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f83b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762844.474901:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140716416:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11459us (48396us total) trans 4294967603 rc 0/0 00000100:00100000:3.0:1789762844.474909:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:3.0:1789762844.474918:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248936488741 time 248936579163 state 0x2 ref 0 00000001:00080000:3.0:1789762844.474947:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967603 is committed 00000100:00100000:0.0:1789762844.477184:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762844.477235:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140716544 00000100:00100000:2.0:1789762844.477253:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140716544 00000100:00100000:2.0:1789762844.477304:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248936488741 time 248936579163 state 0x0 ref 1 00000100:00100000:2.0:1789762844.477320:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248986579163 time 248936579163 state 0x1 ref 1 00000100:00100000:0.0:1789762844.513541:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248986579163 time 248986694267 state 0x0 ref 1 00000100:00100000:0.0:1789762844.513561:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140716544:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762844.513608:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 34603008, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0x10809 00010000:00010000:0.0:1789762844.513616:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152549b4/0xd08452c77c56f842 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.513629:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=248s v=(0 0) 00010000:00010000:0.0:1789762844.513632:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762844.513637:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000152549b4/0xd08452c77c56f842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.513648:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000152549b4/0xd08452c77c56f842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762844.524244:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 34603008 -> 35651584 00000001:00080000:3.0:1789762844.524248:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967604 is committed 00002000:00010000:2.0:1789762844.524251:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 67593 -> 69641 00010000:00010000:2.0:1789762844.524264:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152549b4/0xd08452c77c56f842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.524277:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000152549b4/0xd08452c77c56f842 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.524287:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000152549b4/0xd08452c77c56f842 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.524309:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0452b7400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762844.524314:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000152549b4/0xd08452c77c56f842 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.524325:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000152549b4/0xd08452c77c56f842 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.524343:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000152549b4/0xd08452c77c56f842 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.524352:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000152549b4/0xd08452c77c56f842 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762844.524424:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140716544:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10866us (47238us total) trans 4294967604 rc 0/0 00000100:00100000:2.0:1789762844.524435:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1789762844.524447:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248986579163 time 248986694267 state 0x2 ref 0 00000100:00100000:1.0:1789762844.526478:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762844.526534:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140716672 00000100:00100000:0.0:1789762844.526542:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140716672 00000100:00100000:0.0:1789762844.526585:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 248986579163 time 248986694267 state 0x0 ref 1 00000100:00100000:0.0:1789762844.526599:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249036694267 time 248986694267 state 0x1 ref 1 00000100:00100000:0.0:1789762844.532166:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762844.532192:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762844.532209:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762844.532243:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140716800 00000100:00100000:0.0:1789762844.532248:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762844.532250:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140716928 00000100:00100000:3.0:1789762844.532250:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140716800 00000100:00100000:2.0:1789762844.532258:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140716928 00000100:00100000:1.0:1789762844.532265:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140717184 00000100:00100000:1.0:1789762844.532272:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140717184 00000100:00100000:3.0:1789762844.532291:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 269 00000100:00100000:0.0:1789762844.532295:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140717056 00000100:00100000:0.0:1789762844.532300:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140717056 00000100:00100000:3.0:1789762844.532305:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140716800:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762844.532322:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:1.0:1789762844.532334:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:2.0:1789762844.532337:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+27:2343:x1876702140716928:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762844.532345:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:1.0:1789762844.532347:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140717184:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762844.532353:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140716800:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 51us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762844.532358:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+35:2342:x1876702140717056:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762844.532364:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 269 00000100:00100000:2.0:1789762844.532393:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+27:2343:x1876702140716928:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 61us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762844.532400:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140717184:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 53us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762844.532401:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+35:2342:x1876702140717056:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762844.532414:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:1.0:1789762844.532414:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:2.0:1789762844.532427:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00080000:1.0:1789762844.532446:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762844.532452:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762844.563620:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249036694267 time 249036776227 state 0x0 ref 1 00000100:00100000:3.0:1789762844.563636:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140716672:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762844.563669:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 35651584, mtime: 0x6aad9d1b, atime: 0x0, ctime: 0x6aad9d1b, blocks: 0x11009 00010000:00010000:3.0:1789762844.563676:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f849 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.563698:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762844.563702:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762844.563706:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.563718:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762844.574563:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967605 is committed 00002000:00010000:3.0:1789762844.574619:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:3.0:1789762844.574624:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb mtime from disk: 1789762843 -> 1789762844 00002000:00010000:3.0:1789762844.574626:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb ctime from disk: 1789762843 -> 1789762844 00002000:00010000:3.0:1789762844.574628:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 69641 -> 71689 00010000:00010000:3.0:1789762844.574637:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.574647:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.574654:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f849 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.574659:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ba00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762844.574663:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f849 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.574669:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f849 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.574691:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f849 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.574697:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f849 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762844.574753:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140716672:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11120us (48275us total) trans 4294967605 rc 0/0 00000100:00100000:3.0:1789762844.574760:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:3.0:1789762844.574770:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249036694267 time 249036776227 state 0x2 ref 0 00000100:00100000:3.0:1789762844.576972:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762844.577027:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140717312 00000100:00100000:2.0:1789762844.577036:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140717312 00000100:00100000:2.0:1789762844.577095:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249036694267 time 249036776227 state 0x0 ref 1 00000100:00100000:2.0:1789762844.577110:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249086776227 time 249036776227 state 0x1 ref 1 00000100:00100000:2.0:1789762844.613706:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249086776227 time 249086850966 state 0x0 ref 1 00000100:00100000:2.0:1789762844.613736:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140717312:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762844.613799:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 36700160, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x11809 00010000:00010000:2.0:1789762844.613808:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56f850 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.613825:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:2.0:1789762844.613830:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762844.613855:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56f850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.613870:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56f850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762844.626265:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967606 is committed 00002000:00010000:3.0:1789762844.626304:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:3.0:1789762844.626310:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 71689 -> 73737 00010000:00010000:3.0:1789762844.626321:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56f850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.626332:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56f850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.626338:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56f850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.626343:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f96c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762844.626347:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56f850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.626361:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56f850 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.626384:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56f850 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.626390:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56f850 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762844.626457:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140717312:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12731us (49482us total) trans 4294967606 rc 0/0 00000100:00100000:3.0:1789762844.626466:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:3.0:1789762844.626476:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249086776227 time 249086850966 state 0x2 ref 0 00000100:00100000:1.0:1789762844.628582:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762844.628661:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140717440 00000100:00100000:0.0:1789762844.628670:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140717440 00000100:00100000:0.0:1789762844.628709:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249086776227 time 249086850966 state 0x0 ref 1 00000100:00100000:0.0:1789762844.628720:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249136850966 time 249086850966 state 0x1 ref 1 00000100:00100000:3.0:1789762844.663786:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249136850966 time 249136932942 state 0x0 ref 1 00000100:00100000:3.0:1789762844.663809:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140717440:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762844.663872:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 37748736, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x12009 00010000:00010000:3.0:1789762844.663879:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f857 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.663894:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762844.663897:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762844.663902:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.663923:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762844.674152:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967607 is committed 00002000:00010000:3.0:1789762844.674168:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:3.0:1789762844.674172:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 73737 -> 75785 00010000:00010000:3.0:1789762844.674183:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.674193:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.674200:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f857 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.674205:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ba00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762844.674208:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f857 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.674215:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f857 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.674227:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f857 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.674233:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f857 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762844.674296:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140717440:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10492us (45713us total) trans 4294967607 rc 0/0 00000100:00100000:3.0:1789762844.674305:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1789762844.674314:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249136850966 time 249136932942 state 0x2 ref 0 00000100:00100000:0.0:1789762844.676387:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762844.676438:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140717568 00000100:00100000:2.0:1789762844.676446:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140717568 00000100:00100000:2.0:1789762844.676483:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249136850966 time 249136932942 state 0x0 ref 1 00000100:00100000:2.0:1789762844.676500:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249186932942 time 249136932942 state 0x1 ref 1 00010000:00010000:2.0:1789762844.710980:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762844.713868:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249186932942 time 249187020404 state 0x0 ref 1 00000100:00100000:3.0:1789762844.713889:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140717568:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762844.713935:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 38797312, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x12809 00010000:00010000:3.0:1789762844.713942:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f85e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.713955:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762844.713959:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762844.713963:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f85e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.713973:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f85e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762844.724731:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967608 is committed 00002000:00010000:3.0:1789762844.724736:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:3.0:1789762844.724741:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 75785 -> 77833 00010000:00010000:3.0:1789762844.724753:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f85e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.724773:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f85e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.724780:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f85e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.724785:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ba00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762844.724788:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f85e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.724795:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f85e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.724809:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f85e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.724814:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f85e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762844.724892:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140717568:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11009us (48505us total) trans 4294967608 rc 0/0 00000100:00100000:3.0:1789762844.724900:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:3.0:1789762844.724909:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249186932942 time 249187020404 state 0x2 ref 0 00000100:00100000:0.0:1789762844.727115:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762844.727158:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140717696 00000100:00100000:1.0:1789762844.727166:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140717696 00000100:00100000:1.0:1789762844.727204:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249186932942 time 249187020404 state 0x0 ref 1 00000100:00100000:1.0:1789762844.727221:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249237020404 time 249187020404 state 0x1 ref 1 00000100:00100000:3.0:1789762844.763977:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249237020404 time 249237131248 state 0x0 ref 1 00000100:00100000:3.0:1789762844.764003:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140717696:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762844.764050:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 39845888, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x13009 00010000:00010000:3.0:1789762844.764060:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f865 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.764088:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762844.764092:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762844.764097:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.764107:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762844.774633:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967609 is committed 00002000:00010000:3.0:1789762844.774641:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:3.0:1789762844.774646:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 77833 -> 79881 00010000:00010000:3.0:1789762844.774657:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.774666:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.774673:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f865 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.774679:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ba00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762844.774688:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f865 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.774695:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f865 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.774708:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f865 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.774713:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f865 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762844.774770:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140717696:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10770us (47655us total) trans 4294967609 rc 0/0 00000100:00100000:3.0:1789762844.774778:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:3.0:1789762844.774788:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249237020404 time 249237131248 state 0x2 ref 0 00000100:00100000:1.0:1789762844.777418:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762844.777471:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140717824 00000100:00100000:2.0:1789762844.777480:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140717824 00000100:00100000:2.0:1789762844.777525:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249237020404 time 249237131248 state 0x0 ref 1 00000100:00100000:2.0:1789762844.777536:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249287131248 time 249237131248 state 0x1 ref 1 00000100:00100000:3.0:1789762844.814089:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249287131248 time 249287228359 state 0x0 ref 1 00000100:00100000:3.0:1789762844.814109:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140717824:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762844.814149:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 40894464, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x13809 00010000:00010000:3.0:1789762844.814155:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f86c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.814168:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762844.814180:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762844.814185:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f86c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.814196:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f86c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762844.824786:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 40894464 -> 41943040 00000001:00080000:3.0:1789762844.824793:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967610 is committed 00002000:00010000:2.0:1789762844.824794:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 79881 -> 81929 00010000:00010000:2.0:1789762844.824808:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f86c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.824821:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f86c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.824852:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f86c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.824861:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ba00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762844.824867:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f86c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.824890:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f86c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.824908:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f86c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.824917:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af7ffb49/0xd08452c77c56f86c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762844.824978:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140717824:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10873us (47560us total) trans 4294967610 rc 0/0 00000100:00100000:2.0:1789762844.824986:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:2.0:1789762844.824995:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249287131248 time 249287228359 state 0x2 ref 0 00000100:00100000:0.0:1789762844.827018:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762844.827063:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140717952 00000100:00100000:1.0:1789762844.827071:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140717952 00000100:00100000:1.0:1789762844.827118:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249287131248 time 249287228359 state 0x0 ref 1 00000100:00100000:1.0:1789762844.827129:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249337228359 time 249287228359 state 0x1 ref 1 00000004:00080000:0.0:1789762844.838987:0:7131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 249312151835ns, next at 250312149606ns, rc = 0 00000100:00100000:2.0:1789762844.839000:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149022976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762844.839039:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762844.839070:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149022976 00000100:00100000:0.0:1789762844.839088:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149022976 00000100:00100000:0.0:1789762844.839128:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789762844.839136:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149022976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762844.839152:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526057472 pending 0 free 3828350976 avail 3798990848 00000100:00100000:0.0:1789762844.839188:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149022976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762844.839194:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789762844.839233:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149022976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762844.864150:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249337228359 time 249337305604 state 0x0 ref 1 00000100:00100000:3.0:1789762844.864166:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140717952:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762844.864198:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 41943040, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x14009 00010000:00010000:3.0:1789762844.864205:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f873 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.864217:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762844.864220:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762844.864224:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.864234:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762844.874647:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967611 is committed 00002000:00010000:3.0:1789762844.874661:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:3.0:1789762844.874666:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 81929 -> 83977 00010000:00010000:3.0:1789762844.874676:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.874691:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.874698:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f873 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.874703:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762844.874706:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f873 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.874712:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f873 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.874725:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f873 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.874731:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f873 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762844.874786:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140717952:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10624us (47768us total) trans 4294967611 rc 0/0 00000100:00100000:3.0:1789762844.874794:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:3.0:1789762844.874802:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249337228359 time 249337305604 state 0x2 ref 0 00000100:00100000:1.0:1789762844.877359:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762844.877405:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140718080 00000100:00100000:2.0:1789762844.877413:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140718080 00000100:00100000:2.0:1789762844.877452:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249337228359 time 249337305604 state 0x0 ref 1 00000100:00100000:2.0:1789762844.877463:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249387305604 time 249337305604 state 0x1 ref 1 00000100:00100000:2.0:1789762844.914218:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249387305604 time 249387367093 state 0x0 ref 1 00000100:00100000:2.0:1789762844.914241:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140718080:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762844.914285:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 42991616, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x14809 00010000:00010000:2.0:1789762844.914293:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000038bc25c/0xd08452c77c56f87a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.914306:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:2.0:1789762844.914309:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762844.914314:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000038bc25c/0xd08452c77c56f87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.914324:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000038bc25c/0xd08452c77c56f87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762844.924491:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967612 is committed 00002000:00010000:3.0:1789762844.924504:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:3.0:1789762844.924514:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 83977 -> 86025 00010000:00010000:3.0:1789762844.924525:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000038bc25c/0xd08452c77c56f87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.924537:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000038bc25c/0xd08452c77c56f87a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.924547:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000038bc25c/0xd08452c77c56f87a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.924555:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762844.924561:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000038bc25c/0xd08452c77c56f87a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.924572:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000038bc25c/0xd08452c77c56f87a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.924587:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000038bc25c/0xd08452c77c56f87a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.924593:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000038bc25c/0xd08452c77c56f87a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762844.924648:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140718080:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10414us (47288us total) trans 4294967612 rc 0/0 00000100:00100000:3.0:1789762844.924656:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:3.0:1789762844.924664:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249387305604 time 249387367093 state 0x2 ref 0 00000100:00100000:0.0:1789762844.926733:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762844.926811:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140718208 00000100:00100000:1.0:1789762844.926819:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140718208 00000100:00100000:1.0:1789762844.926882:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249387305604 time 249387367093 state 0x0 ref 1 00000100:00100000:1.0:1789762844.926897:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249437367093 time 249387367093 state 0x1 ref 1 00000100:00100000:3.0:1789762844.964286:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249437367093 time 249437436984 state 0x0 ref 1 00000100:00100000:3.0:1789762844.964310:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140718208:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762844.964354:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 44040192, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x15009 00010000:00010000:3.0:1789762844.964362:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f881 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.964375:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762844.964379:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762844.964383:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.964394:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762844.975323:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967613 is committed 00002000:00010000:3.0:1789762844.975354:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:3.0:1789762844.975359:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 86025 -> 88073 00010000:00010000:3.0:1789762844.975369:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.975378:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.975384:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f881 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.975400:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762844.975404:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f881 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.975410:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f881 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.975424:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f881 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762844.975429:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f881 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762844.975490:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140718208:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11186us (48755us total) trans 4294967613 rc 0/0 00000100:00100000:3.0:1789762844.975498:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:3.0:1789762844.975507:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249437367093 time 249437436984 state 0x2 ref 0 00000100:00100000:3.0:1789762844.977748:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762844.977828:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140718336 00000100:00100000:2.0:1789762844.977853:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140718336 00000100:00100000:2.0:1789762844.977894:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249437367093 time 249437436984 state 0x0 ref 1 00000100:00100000:2.0:1789762844.977905:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249487436984 time 249437436984 state 0x1 ref 1 00000100:00100000:3.0:1789762845.014390:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249487436984 time 249487543869 state 0x0 ref 1 00000100:00100000:3.0:1789762845.014424:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140718336:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:1.0:1789762845.014454:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762845.014465:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 45088768, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x15809 00010000:00010000:3.0:1789762845.014483:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f888 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.014497:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762845.014500:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.014505:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.014515:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762845.024969:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967614 is committed 00002000:00010000:3.0:1789762845.025001:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:3.0:1789762845.025006:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 88073 -> 90121 00010000:00010000:3.0:1789762845.025014:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.025023:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.025029:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.025034:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.025038:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.025044:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f888 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.025065:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f888 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.025071:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f888 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.025140:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140718336:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10736us (47393us total) trans 4294967614 rc 0/0 00000100:00100000:3.0:1789762845.025148:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:3.0:1789762845.025157:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249487436984 time 249487543869 state 0x2 ref 0 00000100:00100000:3.0:1789762845.027284:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762845.027327:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140718464 00000100:00100000:1.0:1789762845.027335:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140718464 00000100:00100000:1.0:1789762845.027369:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249487436984 time 249487543869 state 0x0 ref 1 00000100:00100000:1.0:1789762845.027379:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249537543869 time 249487543869 state 0x1 ref 1 00000100:00100000:3.0:1789762845.064457:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249537543869 time 249537612045 state 0x0 ref 1 00000100:00100000:3.0:1789762845.064475:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140718464:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.064509:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 46137344, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x16009 00010000:00010000:3.0:1789762845.064517:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f88f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.064529:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762845.064532:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.064537:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.064559:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762845.075229:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967615 is committed 00002000:00010000:3.0:1789762845.075243:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:3.0:1789762845.075248:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 90121 -> 92169 00010000:00010000:3.0:1789762845.075258:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.075267:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f88f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.075274:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f88f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.075279:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.075282:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f88f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.075289:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f88f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.075303:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f88f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.075308:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f88f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.075370:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140718464:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10898us (48084us total) trans 4294967615 rc 0/0 00000100:00100000:3.0:1789762845.075379:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:3.0:1789762845.075387:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249537543869 time 249537612045 state 0x2 ref 0 00000100:00100000:3.0:1789762845.077830:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762845.077887:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140718592 00000100:00100000:2.0:1789762845.077895:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140718592 00000100:00100000:2.0:1789762845.077940:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249537543869 time 249537612045 state 0x0 ref 1 00000100:00100000:2.0:1789762845.077951:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249587612045 time 249537612045 state 0x1 ref 1 00000100:00100000:3.0:1789762845.114529:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249587612045 time 249587679043 state 0x0 ref 1 00000100:00100000:3.0:1789762845.114554:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140718592:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.114611:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 47185920, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x16809 00010000:00010000:3.0:1789762845.114619:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.114641:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762845.114645:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.114649:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.114661:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762845.125705:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967616 is committed 00002000:00010000:2.0:1789762845.125708:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 47185920 -> 48234496 00002000:00010000:2.0:1789762845.125714:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 92169 -> 94217 00010000:00010000:2.0:1789762845.125725:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.125735:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.125743:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.125748:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762845.125752:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.125757:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f896 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.125771:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f896 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.125776:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec32d29/0xd08452c77c56f896 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762845.125878:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140718592:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11330us (48045us total) trans 4294967616 rc 0/0 00000100:00100000:2.0:1789762845.125886:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:2.0:1789762845.125895:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249587612045 time 249587679043 state 0x2 ref 0 00000100:00100000:0.0:1789762845.128235:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762845.128292:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140718720 00000100:00100000:1.0:1789762845.128306:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140718720 00000100:00100000:1.0:1789762845.128346:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249587612045 time 249587679043 state 0x0 ref 1 00000100:00100000:1.0:1789762845.128357:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249637679043 time 249587679043 state 0x1 ref 1 00000100:00100000:3.0:1789762845.164601:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249637679043 time 249637755239 state 0x0 ref 1 00000100:00100000:3.0:1789762845.164632:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140718720:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.164670:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 48234496, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x17009 00010000:00010000:3.0:1789762845.164676:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f89d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.164687:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762845.164691:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.164695:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.164705:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762845.175242:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:3.0:1789762845.175247:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 94217 -> 96265 00000001:00080000:0.0:1789762845.175248:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967617 is committed 00010000:00010000:3.0:1789762845.175260:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.175271:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f89d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.175278:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f89d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.175283:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.175293:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f89d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.175301:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f89d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.175315:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f89d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.175320:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f89d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.175389:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140718720:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10757us (47150us total) trans 4294967617 rc 0/0 00000100:00100000:3.0:1789762845.175401:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:3.0:1789762845.175410:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249637679043 time 249637755239 state 0x2 ref 0 00000100:00100000:0.0:1789762845.177701:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762845.177755:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140718848 00000100:00100000:2.0:1789762845.177765:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140718848 00000100:00100000:2.0:1789762845.177804:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249637679043 time 249637755239 state 0x0 ref 1 00000100:00100000:2.0:1789762845.177816:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249687755239 time 249637755239 state 0x1 ref 1 00000100:00100000:2.0:1789762845.214654:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249687755239 time 249687803539 state 0x0 ref 1 00000100:00100000:2.0:1789762845.214680:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140718848:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762845.214728:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 49283072, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x17809 00010000:00010000:2.0:1789762845.214735:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f8a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.214749:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:2.0:1789762845.214753:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762845.214758:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.214768:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762845.225038:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967618 is committed 00002000:00010000:3.0:1789762845.225066:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 49283072 -> 50331648 00002000:00010000:3.0:1789762845.225082:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 96265 -> 98313 00010000:00010000:3.0:1789762845.225095:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.225105:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f8a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.225113:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f8a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.225135:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.225140:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f8a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.225151:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f8a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.225170:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f8a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.225177:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56f8a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.225244:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140718848:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10573us (47542us total) trans 4294967618 rc 0/0 00000100:00100000:3.0:1789762845.225252:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:3.0:1789762845.225262:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249687755239 time 249687803539 state 0x2 ref 0 00000100:00100000:0.0:1789762845.227543:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762845.227595:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140718976 00000100:00100000:1.0:1789762845.227603:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140718976 00000100:00100000:1.0:1789762845.227641:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249687755239 time 249687803539 state 0x0 ref 1 00000100:00100000:1.0:1789762845.227653:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249737803539 time 249687803539 state 0x1 ref 1 00000100:00100000:3.0:1789762845.264733:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249737803539 time 249737883692 state 0x0 ref 1 00000100:00100000:3.0:1789762845.264752:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140718976:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.264800:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 50331648, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x18009 00010000:00010000:3.0:1789762845.264810:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.264858:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762845.264862:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.264868:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.264879:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762845.275581:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967619 is committed 00002000:00010000:3.0:1789762845.275608:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:3.0:1789762845.275613:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 98313 -> 100361 00010000:00010000:3.0:1789762845.275623:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.275633:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.275640:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.275645:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.275648:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.275655:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.275680:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.275686:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.275749:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140718976:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10999us (48205us total) trans 4294967619 rc 0/0 00000100:00100000:3.0:1789762845.275757:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:3.0:1789762845.275766:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249737803539 time 249737883692 state 0x2 ref 0 00000100:00100000:0.0:1789762845.278224:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762845.278276:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140719104 00000100:00100000:2.0:1789762845.278285:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140719104 00000100:00100000:2.0:1789762845.278333:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249737803539 time 249737883692 state 0x0 ref 1 00000100:00100000:2.0:1789762845.278349:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249787883692 time 249737883692 state 0x1 ref 1 00000100:00100000:3.0:1789762845.314861:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249787883692 time 249787993681 state 0x0 ref 1 00000100:00100000:3.0:1789762845.314885:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140719104:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.314935:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 51380224, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x18809 00010000:00010000:3.0:1789762845.314942:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.314955:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762845.314959:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.314964:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.314975:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762845.325573:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967620 is committed 00002000:00010000:3.0:1789762845.325600:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:3.0:1789762845.325606:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 100361 -> 102409 00010000:00010000:3.0:1789762845.325618:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.325631:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.325641:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.325649:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.325654:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.325664:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.325683:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.325692:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.325766:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140719104:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10885us (47538us total) trans 4294967620 rc 0/0 00000100:00100000:3.0:1789762845.325784:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1789762845.325796:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249787883692 time 249787993681 state 0x2 ref 0 00000100:00100000:0.0:1789762845.327867:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762845.327911:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140719232 00000100:00100000:1.0:1789762845.327920:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140719232 00000100:00100000:1.0:1789762845.327963:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249787883692 time 249787993681 state 0x0 ref 1 00000100:00100000:1.0:1789762845.327974:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249837993681 time 249787993681 state 0x1 ref 1 00000100:00100000:3.0:1789762845.364961:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249837993681 time 249838111497 state 0x0 ref 1 00000100:00100000:3.0:1789762845.364986:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140719232:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.365038:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 52428800, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x19009 00010000:00010000:3.0:1789762845.365045:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.365058:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762845.365062:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.365067:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.365093:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762845.377061:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967621 is committed 00002000:00010000:3.0:1789762845.377101:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:3.0:1789762845.377106:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 102409 -> 104457 00010000:00010000:3.0:1789762845.377120:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.377134:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.377172:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.377182:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.377186:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.377193:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.377208:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.377214:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.377290:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140719232:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12311us (49420us total) trans 4294967621 rc 0/0 00000100:00100000:3.0:1789762845.377298:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:3.0:1789762845.377309:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249837993681 time 249838111497 state 0x2 ref 0 00000100:00100000:1.0:1789762845.379738:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762845.379784:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140719360 00000100:00100000:2.0:1789762845.379793:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140719360 00000100:00100000:2.0:1789762845.379861:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249837993681 time 249838111497 state 0x0 ref 1 00000100:00100000:2.0:1789762845.379873:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249888111497 time 249838111497 state 0x1 ref 1 00000100:00100000:3.0:1789762845.415013:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249888111497 time 249888164653 state 0x0 ref 1 00000100:00100000:3.0:1789762845.415038:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140719360:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.415113:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 53477376, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x19809 00010000:00010000:3.0:1789762845.415120:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.415134:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762845.415138:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.415142:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.415154:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762845.425605:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967622 is committed 00002000:00010000:3.0:1789762845.425630:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:3.0:1789762845.425634:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 104457 -> 106505 00010000:00010000:3.0:1789762845.425646:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.425656:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.425663:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.425668:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.425672:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.425689:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.425704:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.425710:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.425775:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140719360:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10744us (46036us total) trans 4294967622 rc 0/0 00000100:00100000:3.0:1789762845.425783:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:3.0:1789762845.425793:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249888111497 time 249888164653 state 0x2 ref 0 00000100:00100000:3.0:1789762845.428062:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762845.428121:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140719488 00000100:00100000:1.0:1789762845.428129:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140719488 00000100:00100000:1.0:1789762845.428177:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249888111497 time 249888164653 state 0x0 ref 1 00000100:00100000:1.0:1789762845.428193:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249938164653 time 249888164653 state 0x1 ref 1 00000100:00100000:3.0:1789762845.465122:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249938164653 time 249938274112 state 0x0 ref 1 00000100:00100000:3.0:1789762845.465141:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140719488:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.465180:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 54525952, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x1a009 00010000:00010000:3.0:1789762845.465187:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.465201:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762845.465204:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.465217:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.465228:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762845.475976:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967623 is committed 00002000:00010000:3.0:1789762845.476046:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:3.0:1789762845.476050:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 106505 -> 108553 00010000:00010000:3.0:1789762845.476062:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.476086:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.476096:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.476101:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.476106:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.476112:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.476127:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.476143:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.476214:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140719488:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11076us (48149us total) trans 4294967623 rc 0/0 00000100:00100000:3.0:1789762845.476224:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:3.0:1789762845.476234:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249938164653 time 249938274112 state 0x2 ref 0 00000100:00100000:3.0:1789762845.478326:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762845.478371:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140719616 00000100:00100000:2.0:1789762845.478380:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140719616 00000100:00100000:2.0:1789762845.478421:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249938164653 time 249938274112 state 0x0 ref 1 00000100:00100000:2.0:1789762845.478432:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249988274112 time 249938274112 state 0x1 ref 1 00000100:00100000:3.0:1789762845.515234:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249988274112 time 249988383548 state 0x0 ref 1 00000100:00100000:3.0:1789762845.515260:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140719616:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.515308:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 55574528, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x1a809 00010000:00010000:3.0:1789762845.515315:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.515329:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1789762845.515332:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.515337:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.515348:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762845.526772:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967624 is committed 00002000:00010000:3.0:1789762845.526795:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:3.0:1789762845.526800:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 108553 -> 110603 00010000:00010000:3.0:1789762845.526813:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.526823:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.526829:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.526851:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.526856:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.526863:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.526879:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.526884:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.526959:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140719616:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11707us (48631us total) trans 4294967624 rc 0/0 00000100:00100000:3.0:1789762845.526974:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:3.0:1789762845.526984:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249988274112 time 249988383548 state 0x2 ref 0 00000100:00100000:0.0:1789762845.529207:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762845.529264:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140719744 00000100:00100000:1.0:1789762845.529273:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140719744 00000100:00100000:1.0:1789762845.529318:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 249988274112 time 249988383548 state 0x0 ref 1 00000100:00100000:1.0:1789762845.529330:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250038383548 time 249988383548 state 0x1 ref 1 00000100:00100000:3.0:1789762845.565311:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250038383548 time 250038463182 state 0x0 ref 1 00000100:00100000:3.0:1789762845.565334:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140719744:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.565381:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 56623104, mtime: 0x6aad9d1c, atime: 0x0, ctime: 0x6aad9d1c, blocks: 0x1b00b 00010000:00010000:3.0:1789762845.565388:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.565407:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762845.565410:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.565414:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.565427:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762845.576618:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967625 is committed 00002000:00010000:3.0:1789762845.576642:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 56623104 -> 57671680 00002000:00010000:3.0:1789762845.576649:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb mtime from disk: 1789762844 -> 1789762845 00002000:00010000:3.0:1789762845.576651:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb ctime from disk: 1789762844 -> 1789762845 00002000:00010000:3.0:1789762845.576653:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 110603 -> 112651 00010000:00010000:3.0:1789762845.576665:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.576694:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.576705:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.576714:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.576720:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.576731:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.576751:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.576761:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.576872:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140719744:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11507us (47628us total) trans 4294967625 rc 0/0 00000100:00100000:3.0:1789762845.576885:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:3.0:1789762845.576899:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250038383548 time 250038463182 state 0x2 ref 0 00000100:00100000:1.0:1789762845.579303:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762845.579354:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140719872 00000100:00100000:2.0:1789762845.579363:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140719872 00000100:00100000:2.0:1789762845.579402:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250038383548 time 250038463182 state 0x0 ref 1 00000100:00100000:2.0:1789762845.579413:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250088463182 time 250038463182 state 0x1 ref 1 00000100:00100000:3.0:1789762845.615384:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250088463182 time 250088535430 state 0x0 ref 1 00000100:00100000:3.0:1789762845.615413:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140719872:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.615457:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 57671680, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x1b80b 00010000:00010000:3.0:1789762845.615464:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.615476:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762845.615479:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.615485:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.615500:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762845.626188:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967626 is committed 00002000:00010000:3.0:1789762845.626220:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:3.0:1789762845.626227:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 112651 -> 114699 00010000:00010000:3.0:1789762845.626239:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.626252:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.626263:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.626271:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.626284:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.626296:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.626316:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.626325:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.626397:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140719872:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10985us (47092us total) trans 4294967626 rc 0/0 00000100:00100000:3.0:1789762845.626410:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:3.0:1789762845.626423:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250088463182 time 250088535430 state 0x2 ref 0 00000100:00100000:1.0:1789762845.628719:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762845.628802:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140720000 00000100:00100000:0.0:1789762845.628810:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140720000 00000100:00100000:0.0:1789762845.628865:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250088463182 time 250088535430 state 0x0 ref 1 00000100:00100000:0.0:1789762845.628886:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250138535430 time 250088535430 state 0x1 ref 1 00000100:00100000:3.0:1789762845.665461:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250138535430 time 250138602026 state 0x0 ref 1 00000100:00100000:3.0:1789762845.665486:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140720000:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.665550:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 58720256, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x1c00b 00010000:00010000:3.0:1789762845.665558:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.665572:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762845.665583:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.665588:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.665600:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762845.676473:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967627 is committed 00002000:00010000:3.0:1789762845.676503:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:3.0:1789762845.676508:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 114699 -> 116747 00010000:00010000:3.0:1789762845.676520:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.676534:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.676544:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.676552:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.676558:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.676569:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.676588:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.676604:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.676672:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140720000:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11192us (47950us total) trans 4294967627 rc 0/0 00000100:00100000:3.0:1789762845.676680:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:3.0:1789762845.676690:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250138535430 time 250138602026 state 0x2 ref 0 00000100:00100000:3.0:1789762845.679216:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762845.679257:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140720128 00000100:00100000:2.0:1789762845.679265:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140720128 00000100:00100000:2.0:1789762845.679303:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250138535430 time 250138602026 state 0x0 ref 1 00000100:00100000:2.0:1789762845.679315:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250188602026 time 250138602026 state 0x1 ref 1 00000100:00100000:3.0:1789762845.715580:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250188602026 time 250188727471 state 0x0 ref 1 00000100:00100000:3.0:1789762845.715610:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140720128:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.715661:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 59768832, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x1c80b 00010000:00010000:3.0:1789762845.715669:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.715682:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762845.715686:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.715690:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.715700:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762845.727978:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967628 is committed 00002000:00010000:3.0:1789762845.727997:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:3.0:1789762845.728003:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 116747 -> 118795 00010000:00010000:3.0:1789762845.728014:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.728024:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.728031:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.728036:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.728040:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.728047:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.728062:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.728081:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.728147:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140720128:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12547us (48928us total) trans 4294967628 rc 0/0 00000100:00100000:3.0:1789762845.728164:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:3.0:1789762845.728178:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250188602026 time 250188727471 state 0x2 ref 0 00000100:00100000:3.0:1789762845.730756:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762845.730797:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140720256 00000100:00100000:0.0:1789762845.730806:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140720256 00000100:00100000:0.0:1789762845.730862:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250188602026 time 250188727471 state 0x0 ref 1 00000100:00100000:0.0:1789762845.730873:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250238727471 time 250188727471 state 0x1 ref 1 00010000:00010000:1.0:1789762845.734924:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762845.765655:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250238727471 time 250238804344 state 0x0 ref 1 00000100:00100000:3.0:1789762845.765679:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140720256:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.765735:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 60817408, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x1d00b 00010000:00010000:3.0:1789762845.765742:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.765754:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762845.765758:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.765762:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.765773:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762845.776883:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967629 is committed 00002000:00010000:3.0:1789762845.776888:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:3.0:1789762845.776893:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 118795 -> 120843 00010000:00010000:3.0:1789762845.776905:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.776915:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.776930:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.776935:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.776939:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.776945:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.776959:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.776965:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.777025:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140720256:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11354us (46267us total) trans 4294967629 rc 0/0 00000100:00100000:3.0:1789762845.777033:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:3.0:1789762845.777041:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250238727471 time 250238804344 state 0x2 ref 0 00000100:00100000:3.0:1789762845.779169:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762845.779219:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140720384 00000100:00100000:2.0:1789762845.779227:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140720384 00000100:00100000:2.0:1789762845.779268:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250238727471 time 250238804344 state 0x0 ref 1 00000100:00100000:2.0:1789762845.779279:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250288804344 time 250238804344 state 0x1 ref 1 00000100:00100000:3.0:1789762845.815740:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250288804344 time 250288892845 state 0x0 ref 1 00000100:00100000:3.0:1789762845.815761:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140720384:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.815814:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 61865984, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x1d80b 00010000:00010000:3.0:1789762845.815821:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.815850:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762845.815854:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.815859:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.815870:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762845.827027:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:2.0:1789762845.827033:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 120843 -> 122891 00000001:00080000:3.0:1789762845.827037:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967630 is committed 00010000:00010000:2.0:1789762845.827043:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.827054:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.827062:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.827083:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762845.827087:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.827101:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.827115:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.827121:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2b1724/0xd08452c77c56f8f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762845.827175:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140720384:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11420us (48004us total) trans 4294967630 rc 0/0 00000100:00100000:2.0:1789762845.827182:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:2.0:1789762845.827191:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250288804344 time 250288892845 state 0x2 ref 0 00000100:00100000:0.0:1789762845.829350:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762845.829410:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140720512 00000100:00100000:1.0:1789762845.829419:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140720512 00000100:00100000:1.0:1789762845.829460:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250288804344 time 250288892845 state 0x0 ref 1 00000100:00100000:1.0:1789762845.829475:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250338892845 time 250288892845 state 0x1 ref 1 00000100:00100000:3.0:1789762845.865822:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250338892845 time 250338977556 state 0x0 ref 1 00000100:00100000:3.0:1789762845.865861:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140720512:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.865900:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 62914560, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x1e00b 00010000:00010000:3.0:1789762845.865907:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f8ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.865919:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762845.865922:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.865925:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f8ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.865935:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f8ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762845.877187:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967631 is committed 00002000:00010000:3.0:1789762845.877255:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:3.0:1789762845.877260:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 122891 -> 124939 00010000:00010000:3.0:1789762845.877269:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f8ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.877279:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f8ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.877285:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f8ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.877290:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.877293:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f8ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.877300:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f8ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.877313:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f8ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.877318:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f8ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.877371:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140720512:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11516us (48020us total) trans 4294967631 rc 0/0 00000100:00100000:3.0:1789762845.877385:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:3.0:1789762845.877393:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250338892845 time 250338977556 state 0x2 ref 0 00000100:00100000:0.0:1789762845.879517:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762845.879559:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140720640 00000100:00100000:2.0:1789762845.879566:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140720640 00000100:00100000:2.0:1789762845.879602:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250338892845 time 250338977556 state 0x0 ref 1 00000100:00100000:2.0:1789762845.879612:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250388977556 time 250338977556 state 0x1 ref 1 00000100:00100000:2.0:1789762845.915898:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250388977556 time 250389049823 state 0x0 ref 1 00000100:00100000:2.0:1789762845.915922:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140720640:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762845.915965:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 63963136, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x1e80b 00010000:00010000:2.0:1789762845.915982:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef8868dd/0xd08452c77c56f906 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.915995:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:2.0:1789762845.915998:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762845.916003:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef8868dd/0xd08452c77c56f906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.916013:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef8868dd/0xd08452c77c56f906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762845.927001:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967632 is committed 00002000:00010000:3.0:1789762845.927038:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:3.0:1789762845.927045:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 124939 -> 126987 00010000:00010000:3.0:1789762845.927057:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef8868dd/0xd08452c77c56f906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.927086:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef8868dd/0xd08452c77c56f906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.927096:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef8868dd/0xd08452c77c56f906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.927102:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f96800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.927106:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef8868dd/0xd08452c77c56f906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.927112:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef8868dd/0xd08452c77c56f906 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.927124:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef8868dd/0xd08452c77c56f906 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.927129:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef8868dd/0xd08452c77c56f906 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.927206:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140720640:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11290us (47686us total) trans 4294967632 rc 0/0 00000100:00100000:3.0:1789762845.927216:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:3.0:1789762845.927226:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250388977556 time 250389049823 state 0x2 ref 0 00000100:00100000:1.0:1789762845.929339:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762845.929398:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140720768 00000100:00100000:0.0:1789762845.929407:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140720768 00000100:00100000:0.0:1789762845.929449:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250388977556 time 250389049823 state 0x0 ref 1 00000100:00100000:0.0:1789762845.929465:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250439049823 time 250389049823 state 0x1 ref 1 00000100:00100000:3.0:1789762845.965993:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250439049823 time 250439149586 state 0x0 ref 1 00000100:00100000:3.0:1789762845.966008:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140720768:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762845.966040:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 65011712, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x1f00b 00010000:00010000:3.0:1789762845.966046:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f90d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.966057:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762845.966060:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.966064:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f90d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.966091:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f90d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762845.977443:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967633 is committed 00002000:00010000:3.0:1789762845.977465:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:3.0:1789762845.977471:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 126987 -> 129035 00010000:00010000:3.0:1789762845.977480:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f90d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.977501:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f90d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.977508:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f90d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.977513:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762845.977517:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f90d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.977523:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f90d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.977535:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f90d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.977540:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f90d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.977597:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140720768:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11591us (48257us total) trans 4294967633 rc 0/0 00000100:00100000:3.0:1789762845.977603:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:3.0:1789762845.977611:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250439049823 time 250439149586 state 0x2 ref 0 00000100:00100000:0.0:1789762845.980022:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762845.980084:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140720896 00000100:00100000:2.0:1789762845.980093:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140720896 00000100:00100000:2.0:1789762845.980143:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250439049823 time 250439149586 state 0x0 ref 1 00000100:00100000:2.0:1789762845.980159:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250489149586 time 250439149586 state 0x1 ref 1 00000100:00100000:3.0:1789762846.016116:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250489149586 time 250489270768 state 0x0 ref 1 00000100:00100000:3.0:1789762846.016141:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140720896:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.016176:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 66060288, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x1f80b 00010000:00010000:3.0:1789762846.016183:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f914 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.016194:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762846.016197:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.016202:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.016211:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762846.027138:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967634 is committed 00002000:00010000:3.0:1789762846.027158:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:3.0:1789762846.027163:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 129035 -> 131083 00010000:00010000:3.0:1789762846.027172:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.027181:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.027187:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.027192:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.027202:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.027210:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f914 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.027221:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f914 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.027226:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f914 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.027279:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140720896:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11140us (47259us total) trans 4294967634 rc 0/0 00000100:00100000:3.0:1789762846.027286:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:3.0:1789762846.027294:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250489149586 time 250489270768 state 0x2 ref 0 00000100:00100000:1.0:1789762846.029386:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762846.029442:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140721024 00000100:00100000:0.0:1789762846.029450:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140721024 00000100:00100000:0.0:1789762846.029489:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250489149586 time 250489270768 state 0x0 ref 1 00000100:00100000:0.0:1789762846.029504:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250539270768 time 250489270768 state 0x1 ref 1 00000100:00100000:3.0:1789762846.066214:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250539270768 time 250539370086 state 0x0 ref 1 00000100:00100000:3.0:1789762846.066230:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140721024:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.066259:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 67108864, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x2000b 00010000:00010000:3.0:1789762846.066266:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f91b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.066276:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762846.066287:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.066291:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f91b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.066301:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f91b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762846.077754:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967635 is committed 00002000:00010000:3.0:1789762846.077819:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:3.0:1789762846.077824:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 131083 -> 133131 00010000:00010000:3.0:1789762846.077849:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f91b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.077859:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f91b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.077865:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f91b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.077870:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.077873:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f91b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.077879:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f91b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.077892:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f91b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.077908:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f91b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.077966:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140721024:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11739us (48579us total) trans 4294967635 rc 0/0 00000100:00100000:3.0:1789762846.077973:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:3.0:1789762846.077982:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250539270768 time 250539370086 state 0x2 ref 0 00000100:00100000:0.0:1789762846.080467:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762846.080514:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140721152 00000100:00100000:2.0:1789762846.080522:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140721152 00000100:00100000:2.0:1789762846.080559:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250539270768 time 250539370086 state 0x0 ref 1 00000100:00100000:2.0:1789762846.080569:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250589370086 time 250539370086 state 0x1 ref 1 00000100:00100000:3.0:1789762846.116292:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250589370086 time 250589445677 state 0x0 ref 1 00000100:00100000:3.0:1789762846.116311:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140721152:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.116353:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 68157440, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x2080b 00010000:00010000:3.0:1789762846.116360:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f922 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.116372:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762846.116375:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.116388:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.116398:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762846.128024:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967636 is committed 00002000:00010000:3.0:1789762846.128045:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:3.0:1789762846.128056:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 133131 -> 135179 00010000:00010000:3.0:1789762846.128083:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.128093:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f922 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.128101:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f922 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.128106:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.128110:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f922 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.128116:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f922 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.128130:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f922 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.128135:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f922 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.128199:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140721152:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11891us (47731us total) trans 4294967636 rc 0/0 00000100:00100000:3.0:1789762846.128207:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:3.0:1789762846.128216:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250589370086 time 250589445677 state 0x2 ref 0 00000100:00100000:1.0:1789762846.130358:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762846.130416:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140721280 00000100:00100000:0.0:1789762846.130431:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140721280 00000100:00100000:0.0:1789762846.130474:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250589370086 time 250589445677 state 0x0 ref 1 00000100:00100000:0.0:1789762846.130489:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250639445677 time 250589445677 state 0x1 ref 1 00000100:00100000:3.0:1789762846.166386:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250639445677 time 250639535633 state 0x0 ref 1 00000100:00100000:3.0:1789762846.166406:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140721280:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.166453:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 69206016, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x2100b 00010000:00010000:3.0:1789762846.166460:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f929 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.166474:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762846.166477:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.166482:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.166492:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762846.177261:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967637 is committed 00002000:00010000:3.0:1789762846.177268:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 69206016 -> 70254592 00002000:00010000:3.0:1789762846.177274:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 135179 -> 137227 00010000:00010000:3.0:1789762846.177283:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.177293:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f929 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.177299:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.177315:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.177319:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.177325:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f929 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.177340:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f929 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.177345:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f929 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.177397:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140721280:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10995us (47038us total) trans 4294967637 rc 0/0 00000100:00100000:3.0:1789762846.177405:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:3.0:1789762846.177414:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250639445677 time 250639535633 state 0x2 ref 0 00000100:00100000:1.0:1789762846.179615:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762846.179692:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140721408 00000100:00100000:2.0:1789762846.179700:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140721408 00000100:00100000:2.0:1789762846.179744:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250639445677 time 250639535633 state 0x0 ref 1 00000100:00100000:2.0:1789762846.179755:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250689535633 time 250639535633 state 0x1 ref 1 00000100:00100000:3.0:1789762846.216494:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250689535633 time 250689644102 state 0x0 ref 1 00000100:00100000:3.0:1789762846.216518:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140721408:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.216572:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 70254592, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x2180b 00010000:00010000:3.0:1789762846.216582:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f930 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.216614:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762846.216618:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.216623:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.216635:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762846.227374:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967638 is committed 00002000:00010000:3.0:1789762846.227381:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:3.0:1789762846.227386:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 137227 -> 139275 00010000:00010000:3.0:1789762846.227396:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.227405:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.227411:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.227416:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.227419:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.227426:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f930 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.227449:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f930 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.227455:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f930 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.227504:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140721408:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10995us (47890us total) trans 4294967638 rc 0/0 00000100:00100000:3.0:1789762846.227511:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:3.0:1789762846.227519:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250689535633 time 250689644102 state 0x2 ref 0 00000100:00100000:0.0:1789762846.229854:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762846.229914:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140721536 00000100:00100000:1.0:1789762846.229929:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140721536 00000100:00100000:1.0:1789762846.229968:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250689535633 time 250689644102 state 0x0 ref 1 00000100:00100000:1.0:1789762846.229982:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250739644102 time 250689644102 state 0x1 ref 1 00000100:00100000:3.0:1789762846.266591:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250739644102 time 250739746941 state 0x0 ref 1 00000100:00100000:3.0:1789762846.266607:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140721536:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.266648:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 71303168, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x2200b 00010000:00010000:3.0:1789762846.266654:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f937 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.266665:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762846.266668:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.266672:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.266681:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762846.276938:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967639 is committed 00002000:00010000:3.0:1789762846.276963:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:3.0:1789762846.276967:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 139275 -> 141323 00010000:00010000:3.0:1789762846.276976:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.276985:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f937 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.276992:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f937 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.276996:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.277000:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f937 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.277006:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f937 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.277019:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f937 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.277024:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f937 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.277092:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140721536:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10488us (47238us total) trans 4294967639 rc 0/0 00000100:00100000:3.0:1789762846.277106:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:3.0:1789762846.277114:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250739644102 time 250739746941 state 0x2 ref 0 00000100:00100000:1.0:1789762846.279555:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762846.279604:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140721664 00000100:00100000:2.0:1789762846.279612:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140721664 00000100:00100000:2.0:1789762846.279653:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250739644102 time 250739746941 state 0x0 ref 1 00000100:00100000:2.0:1789762846.279664:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250789746941 time 250739746941 state 0x1 ref 1 00000100:00100000:3.0:1789762846.316691:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250789746941 time 250789845375 state 0x0 ref 1 00000100:00100000:3.0:1789762846.316712:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140721664:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.316754:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 72351744, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x2280b 00010000:00010000:3.0:1789762846.316761:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f93e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.316774:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762846.316778:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.316783:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f93e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.316794:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f93e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762846.327673:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967640 is committed 00002000:00010000:3.0:1789762846.327692:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:3.0:1789762846.327697:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 141323 -> 143371 00010000:00010000:3.0:1789762846.327706:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f93e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.327715:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f93e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.327732:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f93e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.327737:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.327740:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f93e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.327746:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f93e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.327759:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f93e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.327764:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f93e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.327827:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140721664:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11119us (48270us total) trans 4294967640 rc 0/0 00000100:00100000:3.0:1789762846.327874:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:3.0:1789762846.327886:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250789746941 time 250789845375 state 0x2 ref 0 00000100:00100000:0.0:1789762846.330932:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762846.330981:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140721792 00000100:00100000:1.0:1789762846.330991:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140721792 00000100:00100000:1.0:1789762846.331037:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250789746941 time 250789845375 state 0x0 ref 1 00000100:00100000:1.0:1789762846.331048:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250839845375 time 250789845375 state 0x1 ref 1 00000100:00100000:3.0:1789762846.366753:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250839845375 time 250839907568 state 0x0 ref 1 00000100:00100000:3.0:1789762846.366773:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140721792:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.366825:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 73400320, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x2300b 00010000:00010000:3.0:1789762846.366853:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f945 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.366866:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762846.366869:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.366875:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.366885:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762846.378487:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967641 is committed 00002000:00010000:3.0:1789762846.378605:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:3.0:1789762846.378611:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 143371 -> 145419 00010000:00010000:3.0:1789762846.378625:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.378638:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.378649:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.378656:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.378661:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.378687:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.378713:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f945 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.378722:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f945 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.378878:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140721792:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12106us (47945us total) trans 4294967641 rc 0/0 00000100:00100000:3.0:1789762846.378889:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:3.0:1789762846.378902:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250839845375 time 250839907568 state 0x2 ref 0 00000100:00100000:0.0:1789762846.382415:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762846.382464:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140721920 00000100:00100000:2.0:1789762846.382476:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140721920 00000100:00100000:2.0:1789762846.382528:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250839845375 time 250839907568 state 0x0 ref 1 00000100:00100000:2.0:1789762846.382540:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250889907568 time 250839907568 state 0x1 ref 1 00000100:00100000:3.0:1789762846.416863:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250889907568 time 250890018557 state 0x0 ref 1 00000100:00100000:3.0:1789762846.416880:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140721920:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.416921:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 74448896, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x2380b 00010000:00010000:3.0:1789762846.416928:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f94c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.416941:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762846.416944:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.416949:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f94c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.416970:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f94c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762846.427887:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967642 is committed 00002000:00010000:3.0:1789762846.427923:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:3.0:1789762846.427928:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 145419 -> 147467 00010000:00010000:3.0:1789762846.427937:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f94c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.427946:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f94c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.427952:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f94c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.427957:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.427961:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f94c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.427967:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f94c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.427980:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f94c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.427985:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f94c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.428050:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140721920:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11172us (45637us total) trans 4294967642 rc 0/0 00000100:00100000:3.0:1789762846.428058:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:3.0:1789762846.428079:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250889907568 time 250890018557 state 0x2 ref 0 00000100:00100000:0.0:1789762846.430248:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762846.430304:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140722048 00000100:00100000:1.0:1789762846.430313:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140722048 00000100:00100000:1.0:1789762846.430351:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250889907568 time 250890018557 state 0x0 ref 1 00000100:00100000:1.0:1789762846.430363:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250940018557 time 250890018557 state 0x1 ref 1 00000100:00100000:3.0:1789762846.466935:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250940018557 time 250940091533 state 0x0 ref 1 00000100:00100000:3.0:1789762846.466951:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140722048:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.466982:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 75497472, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x2400b 00010000:00010000:3.0:1789762846.466989:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f953 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.467000:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762846.467004:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.467008:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.467019:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762846.477790:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967643 is committed 00002000:00010000:3.0:1789762846.477813:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 75497472 -> 76546048 00002000:00010000:3.0:1789762846.477819:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 147467 -> 149515 00010000:00010000:3.0:1789762846.477828:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.477859:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.477866:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f953 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.477871:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.477874:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f953 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.477880:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f953 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.477893:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f953 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.477898:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f953 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.477955:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140722048:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11007us (47707us total) trans 4294967643 rc 0/0 00000100:00100000:3.0:1789762846.477963:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:3.0:1789762846.477971:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250940018557 time 250940091533 state 0x2 ref 0 00000100:00100000:0.0:1789762846.480132:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762846.480184:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140722176 00000100:00100000:2.0:1789762846.480193:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140722176 00000100:00100000:2.0:1789762846.480228:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250940018557 time 250940091533 state 0x0 ref 1 00000100:00100000:2.0:1789762846.480238:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250990091533 time 250940091533 state 0x1 ref 1 00000100:00100000:3.0:1789762846.517026:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250990091533 time 250990176104 state 0x0 ref 1 00000100:00100000:3.0:1789762846.517060:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140722176:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.517116:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 76546048, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x2480b 00010000:00010000:3.0:1789762846.517123:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f95a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.517136:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1789762846.517140:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.517144:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f95a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.517154:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f95a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762846.528389:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967644 is committed 00002000:00010000:3.0:1789762846.528431:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:3.0:1789762846.528436:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 149515 -> 151563 00010000:00010000:3.0:1789762846.528445:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f95a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.528454:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f95a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.528461:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f95a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.528466:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.528476:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f95a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.528483:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f95a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.528498:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f95a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.528503:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f95a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.528559:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140722176:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11503us (48426us total) trans 4294967644 rc 0/0 00000100:00100000:3.0:1789762846.528566:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:3.0:1789762846.528575:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250990091533 time 250990176104 state 0x2 ref 0 00000100:00100000:0.0:1789762846.530710:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762846.530767:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140722304 00000100:00100000:1.0:1789762846.530775:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140722304 00000100:00100000:1.0:1789762846.530816:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 250990091533 time 250990176104 state 0x0 ref 1 00000100:00100000:1.0:1789762846.530830:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251040176104 time 250990176104 state 0x1 ref 1 00000100:00100000:3.0:1789762846.567099:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251040176104 time 251040255206 state 0x0 ref 1 00000100:00100000:3.0:1789762846.567115:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140722304:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.567148:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 77594624, mtime: 0x6aad9d1d, atime: 0x0, ctime: 0x6aad9d1d, blocks: 0x2500b 00010000:00010000:3.0:1789762846.567154:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f961 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.567165:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:3.0:1789762846.567176:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.567181:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.567190:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762846.578557:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967645 is committed 00002000:00010000:3.0:1789762846.578585:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:3.0:1789762846.578590:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb mtime from disk: 1789762845 -> 1789762846 00002000:00010000:3.0:1789762846.578592:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb ctime from disk: 1789762845 -> 1789762846 00002000:00010000:3.0:1789762846.578594:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 151563 -> 153611 00010000:00010000:3.0:1789762846.578603:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.578612:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f961 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.578619:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f961 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.578624:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.578628:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f961 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.578634:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f961 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.578658:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f961 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.578664:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f961 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.578729:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140722304:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11615us (48018us total) trans 4294967645 rc 0/0 00000100:00100000:3.0:1789762846.578736:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:3.0:1789762846.578745:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251040176104 time 251040255206 state 0x2 ref 0 00000100:00100000:0.0:1789762846.580825:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762846.580905:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140722432 00000100:00100000:2.0:1789762846.580918:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140722432 00000100:00100000:2.0:1789762846.580954:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251040176104 time 251040255206 state 0x0 ref 1 00000100:00100000:2.0:1789762846.580965:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251090255206 time 251040255206 state 0x1 ref 1 00000100:00100000:3.0:1789762846.617181:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251090255206 time 251090335862 state 0x0 ref 1 00000100:00100000:3.0:1789762846.617199:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140722432:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.617234:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 78643200, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2580b 00010000:00010000:3.0:1789762846.617241:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f968 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.617252:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:3.0:1789762846.617256:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.617260:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f968 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.617270:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f968 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762846.628472:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 78643200 -> 79691776 00002000:00010000:2.0:1789762846.628477:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 153611 -> 155659 00010000:00010000:2.0:1789762846.628487:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f968 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.628496:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f968 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762846.628498:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967646 is committed 00010000:00010000:2.0:1789762846.628507:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f968 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.628514:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762846.628518:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f968 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.628524:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f968 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.628536:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f968 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.628541:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed56eb9f/0xd08452c77c56f968 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762846.628602:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140722432:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11407us (47777us total) trans 4294967646 rc 0/0 00000100:00100000:2.0:1789762846.628611:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:2.0:1789762846.628619:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251090255206 time 251090335862 state 0x2 ref 0 00000100:00100000:3.0:1789762846.630594:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762846.630652:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140722560 00000100:00100000:1.0:1789762846.630661:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140722560 00000100:00100000:1.0:1789762846.630699:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251090255206 time 251090335862 state 0x0 ref 1 00000100:00100000:1.0:1789762846.630712:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251140335862 time 251090335862 state 0x1 ref 1 00000100:00100000:3.0:1789762846.667247:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251140335862 time 251140401616 state 0x0 ref 1 00000100:00100000:3.0:1789762846.667265:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140722560:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.667300:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 79691776, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2600b 00010000:00010000:3.0:1789762846.667306:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f96f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.667317:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:3.0:1789762846.667320:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.667325:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f96f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.667334:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f96f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762846.679409:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967647 is committed 00002000:00010000:3.0:1789762846.679422:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:3.0:1789762846.679427:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 155659 -> 157707 00010000:00010000:3.0:1789762846.679438:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f96f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.679447:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f96f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.679469:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f96f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.679478:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002bc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.679483:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f96f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.679494:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f96f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.679514:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f96f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.679520:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f96f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.679582:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140722560:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12320us (48988us total) trans 4294967647 rc 0/0 00000100:00100000:3.0:1789762846.679589:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:3.0:1789762846.679598:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251140335862 time 251140401616 state 0x2 ref 0 00000100:00100000:3.0:1789762846.681818:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762846.681863:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140722688 00000100:00100000:2.0:1789762846.681871:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140722688 00000100:00100000:2.0:1789762846.681908:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251140335862 time 251140401616 state 0x0 ref 1 00000100:00100000:2.0:1789762846.681918:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251190401616 time 251140401616 state 0x1 ref 1 00000100:00100000:2.0:1789762846.717312:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251190401616 time 251190462504 state 0x0 ref 1 00000100:00100000:2.0:1789762846.717336:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140722688:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762846.717382:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 80740352, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2680b 00010000:00010000:2.0:1789762846.717389:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f976 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.717402:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:2.0:1789762846.717405:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762846.717410:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.717420:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762846.729227:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 80740352 -> 81788928 00000001:00080000:0.0:1789762846.729229:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967648 is committed 00002000:00010000:2.0:1789762846.729235:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 157707 -> 159755 00010000:00010000:2.0:1789762846.729247:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.729257:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f976 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.729263:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f976 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.729270:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762846.729274:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f976 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.729285:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f976 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.729305:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f976 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.729315:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f976 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762846.729381:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140722688:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12053us (47561us total) trans 4294967648 rc 0/0 00000100:00100000:2.0:1789762846.729396:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:2.0:1789762846.729404:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251190401616 time 251190462504 state 0x2 ref 0 00000100:00100000:3.0:1789762846.731578:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762846.731636:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140722816 00000100:00100000:1.0:1789762846.731644:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140722816 00000100:00100000:1.0:1789762846.731688:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251190401616 time 251190462504 state 0x0 ref 1 00000100:00100000:1.0:1789762846.731702:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251240462504 time 251190462504 state 0x1 ref 1 00010000:00010000:3.0:1789762846.758945:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762846.767378:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251240462504 time 251240530993 state 0x0 ref 1 00000100:00100000:3.0:1789762846.767408:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140722816:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.767449:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 81788928, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2700b 00010000:00010000:3.0:1789762846.767456:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f97d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.767469:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:3.0:1789762846.767472:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.767477:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f97d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.767486:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f97d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762846.780142:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967649 is committed 00002000:00010000:3.0:1789762846.780165:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 81788928 -> 82837504 00002000:00010000:3.0:1789762846.780171:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 159755 -> 161803 00010000:00010000:3.0:1789762846.780183:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f97d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.780194:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f97d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.780201:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f97d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.780206:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002bc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.780216:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f97d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.780224:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f97d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.780239:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f97d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.780244:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f97d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.780320:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140722816:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12913us (48741us total) trans 4294967649 rc 0/0 00000100:00100000:3.0:1789762846.780328:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:3.0:1789762846.780338:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251240462504 time 251240530993 state 0x2 ref 0 00000100:00100000:0.0:1789762846.782541:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762846.782595:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140722944 00000100:00100000:2.0:1789762846.782604:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140722944 00000100:00100000:2.0:1789762846.782649:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251240462504 time 251240530993 state 0x0 ref 1 00000100:00100000:2.0:1789762846.782659:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251290530993 time 251240530993 state 0x1 ref 1 00000100:00100000:2.0:1789762846.817431:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251290530993 time 251290586619 state 0x0 ref 1 00000100:00100000:2.0:1789762846.817450:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140722944:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762846.817489:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 82837504, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2780b 00010000:00010000:2.0:1789762846.817496:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f984 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.817508:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:2.0:1789762846.817511:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762846.817516:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762846.817526:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762846.828937:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967650 is committed 00002000:00010000:3.0:1789762846.828942:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:3.0:1789762846.828947:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 161803 -> 163853 00010000:00010000:3.0:1789762846.828959:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.828969:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.828976:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.828992:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.828996:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.829002:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f984 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.829017:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f984 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.829025:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049df24dd/0xd08452c77c56f984 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.829113:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140722944:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11665us (46569us total) trans 4294967650 rc 0/0 00000100:00100000:3.0:1789762846.829121:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:3.0:1789762846.829130:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251290530993 time 251290586619 state 0x2 ref 0 00000100:00100000:3.0:1789762846.831208:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762846.831260:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140723072 00000100:00100000:1.0:1789762846.831268:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140723072 00000100:00100000:1.0:1789762846.831311:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251290530993 time 251290586619 state 0x0 ref 1 00000100:00100000:1.0:1789762846.831326:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251340586619 time 251290586619 state 0x1 ref 1 00000100:00100000:3.0:1789762846.867561:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251340586619 time 251340710553 state 0x0 ref 1 00000100:00100000:3.0:1789762846.867585:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140723072:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.867634:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 83886080, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2800d 00010000:00010000:3.0:1789762846.867657:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f98b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.867670:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:3.0:1789762846.867674:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.867678:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f98b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.867689:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f98b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762846.879754:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967651 is committed 00002000:00010000:0.0:1789762846.879755:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:0.0:1789762846.879761:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 163853 -> 165901 00010000:00010000:0.0:1789762846.879774:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f98b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.879785:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f98b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.879792:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f98b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.879797:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002bc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762846.879807:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f98b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.879814:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f98b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.879830:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f98b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.879853:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d7d7cf/0xd08452c77c56f98b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762846.879928:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140723072:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12348us (48717us total) trans 4294967651 rc 0/0 00000100:00100000:0.0:1789762846.879937:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:0.0:1789762846.879947:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251340586619 time 251340710553 state 0x2 ref 0 00000100:00100000:3.0:1789762846.882290:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762846.882347:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140723200 00000100:00100000:2.0:1789762846.882356:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140723200 00000100:00100000:2.0:1789762846.882397:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251340586619 time 251340710553 state 0x0 ref 1 00000100:00100000:2.0:1789762846.882408:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251390710553 time 251340710553 state 0x1 ref 1 00000100:00100000:3.0:1789762846.917677:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251390710553 time 251390830385 state 0x0 ref 1 00000100:00100000:3.0:1789762846.917697:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140723200:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762846.917746:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 84934656, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2880d 00010000:00010000:3.0:1789762846.917753:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f992 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.917765:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:3.0:1789762846.917769:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.917773:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.917783:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762846.929731:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967652 is committed 00002000:00010000:3.0:1789762846.929735:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:3.0:1789762846.929740:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 165901 -> 167949 00010000:00010000:3.0:1789762846.929752:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.929762:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.929769:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f992 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.929773:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762846.929777:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f992 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.929784:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f992 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.929798:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f992 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.929803:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f992 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.929888:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140723200:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12195us (47597us total) trans 4294967652 rc 0/0 00000100:00100000:3.0:1789762846.929902:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:3.0:1789762846.929912:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251390710553 time 251390830385 state 0x2 ref 0 00000100:00100000:3.0:1789762846.932156:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762846.932209:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140723328 00000100:00100000:1.0:1789762846.932219:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140723328 00000100:00100000:1.0:1789762846.932261:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251390710553 time 251390830385 state 0x0 ref 1 00000100:00100000:1.0:1789762846.932275:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251440830385 time 251390830385 state 0x1 ref 1 00000100:00100000:0.0:1789762846.967753:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251440830385 time 251440904940 state 0x0 ref 1 00000100:00100000:0.0:1789762846.967774:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140723328:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762846.967817:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 85983232, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2900d 00010000:00010000:0.0:1789762846.967824:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070ca2dae/0xd08452c77c56f999 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.967856:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:0.0:1789762846.967869:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762846.967874:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070ca2dae/0xd08452c77c56f999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.967885:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070ca2dae/0xd08452c77c56f999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762846.979491:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967653 is committed 00002000:00010000:1.0:1789762846.979520:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:1.0:1789762846.979526:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 167949 -> 169997 00010000:00010000:1.0:1789762846.979539:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070ca2dae/0xd08452c77c56f999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.979552:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070ca2dae/0xd08452c77c56f999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.979562:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070ca2dae/0xd08452c77c56f999 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.979569:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0452b6e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762846.979573:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070ca2dae/0xd08452c77c56f999 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.979583:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070ca2dae/0xd08452c77c56f999 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.979601:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070ca2dae/0xd08452c77c56f999 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.979609:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070ca2dae/0xd08452c77c56f999 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762846.979690:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140723328:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11918us (47529us total) trans 4294967653 rc 0/0 00000100:00100000:1.0:1789762846.979711:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:1.0:1789762846.979724:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251440830385 time 251440904940 state 0x2 ref 0 00000100:00100000:0.0:1789762846.982012:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762846.982103:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140723456 00000100:00100000:2.0:1789762846.982112:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140723456 00000100:00100000:2.0:1789762846.982150:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251440830385 time 251440904940 state 0x0 ref 1 00000100:00100000:2.0:1789762846.982161:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251490904940 time 251440904940 state 0x1 ref 1 00000100:00100000:3.0:1789762847.017882:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251490904940 time 251491031821 state 0x0 ref 1 00000100:00100000:3.0:1789762847.017917:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140723456:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762847.017963:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 87031808, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2980d 00000100:00080000:1.0:1789762847.017965:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762847.017970:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.017984:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:3.0:1789762847.017987:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762847.017992:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.018002:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762847.029222:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967654 is committed 00002000:00010000:3.0:1789762847.029225:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 87031808 -> 88080384 00002000:00010000:3.0:1789762847.029231:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 169997 -> 172045 00010000:00010000:3.0:1789762847.029241:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.029252:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.029266:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.029271:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762847.029274:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.029280:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.029294:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.029300:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762847.029359:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140723456:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11462us (47347us total) trans 4294967654 rc 0/0 00000100:00100000:3.0:1789762847.029366:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:3.0:1789762847.029375:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251490904940 time 251491031821 state 0x2 ref 0 00000100:00100000:0.0:1789762847.031649:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762847.031704:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140723584 00000100:00100000:1.0:1789762847.031713:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140723584 00000100:00100000:1.0:1789762847.031758:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251490904940 time 251491031821 state 0x0 ref 1 00000100:00100000:1.0:1789762847.031772:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251541031821 time 251491031821 state 0x1 ref 1 00000100:00100000:1.0:1789762847.067937:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251541031821 time 251541091296 state 0x0 ref 1 00000100:00100000:1.0:1789762847.067955:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140723584:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762847.067991:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 88080384, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2a00d 00010000:00010000:1.0:1789762847.067999:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.068013:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:1.0:1789762847.068017:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.068024:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.068037:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762847.079092:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967655 is committed 00002000:00010000:1.0:1789762847.079115:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:1.0:1789762847.079121:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 172045 -> 174093 00010000:00010000:1.0:1789762847.079132:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.079143:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.079152:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.079159:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.079164:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.079173:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.079189:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.079197:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.079264:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140723584:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11310us (47613us total) trans 4294967655 rc 0/0 00000100:00100000:1.0:1789762847.079282:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:1.0:1789762847.079294:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251541031821 time 251541091296 state 0x2 ref 0 00000100:00100000:3.0:1789762847.081366:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762847.081449:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140723712 00000100:00100000:2.0:1789762847.081457:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140723712 00000100:00100000:2.0:1789762847.081493:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251541031821 time 251541091296 state 0x0 ref 1 00000100:00100000:2.0:1789762847.081503:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251591091296 time 251541091296 state 0x1 ref 1 00000100:00100000:3.0:1789762847.118020:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251591091296 time 251591170576 state 0x0 ref 1 00000100:00100000:3.0:1789762847.118043:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140723712:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762847.118113:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 89128960, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2a80d 00010000:00010000:3.0:1789762847.118122:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.118134:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:3.0:1789762847.118138:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762847.118142:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.118153:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762847.129317:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967656 is committed 00002000:00010000:1.0:1789762847.129341:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:1.0:1789762847.129348:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 174093 -> 176141 00010000:00010000:1.0:1789762847.129360:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.129372:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.129382:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.129389:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.129395:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.129404:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.129422:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.129430:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862688fd/0xd08452c77c56f9ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.129518:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140723712:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11479us (48148us total) trans 4294967656 rc 0/0 00000100:00100000:1.0:1789762847.129530:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:1.0:1789762847.129542:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251591091296 time 251591170576 state 0x2 ref 0 00000100:00100000:0.0:1789762847.131797:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762847.131858:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140723840 00000100:00100000:1.0:1789762847.131866:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140723840 00000100:00100000:1.0:1789762847.131910:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251591091296 time 251591170576 state 0x0 ref 1 00000100:00100000:1.0:1789762847.131925:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251641170576 time 251591170576 state 0x1 ref 1 00000100:00100000:1.0:1789762847.168089:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251641170576 time 251641241746 state 0x0 ref 1 00000100:00100000:1.0:1789762847.168110:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140723840:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762847.168149:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 90177536, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2b00d 00010000:00010000:1.0:1789762847.168157:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.168172:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:1.0:1789762847.168176:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.168183:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.168196:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762847.179663:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967657 is committed 00002000:00010000:1.0:1789762847.179726:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:1.0:1789762847.179732:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 176141 -> 178189 00010000:00010000:1.0:1789762847.179743:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.179756:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.179765:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.179773:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.179778:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.179788:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.179805:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.179813:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.179914:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140723840:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11806us (48115us total) trans 4294967657 rc 0/0 00000100:00100000:1.0:1789762847.179931:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:1.0:1789762847.179943:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251641170576 time 251641241746 state 0x2 ref 0 00000100:00100000:3.0:1789762847.181974:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762847.182021:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140723968 00000100:00100000:2.0:1789762847.182030:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140723968 00000100:00100000:2.0:1789762847.182082:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251641170576 time 251641241746 state 0x0 ref 1 00000100:00100000:2.0:1789762847.182103:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251691241746 time 251641241746 state 0x1 ref 1 00000100:00100000:1.0:1789762847.218167:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251691241746 time 251691317986 state 0x0 ref 1 00000100:00100000:1.0:1789762847.218190:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140723968:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762847.218235:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 91226112, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2b80d 00010000:00010000:1.0:1789762847.218243:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.218257:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:1.0:1789762847.218261:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.218268:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.218281:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762847.229789:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967658 is committed 00002000:00010000:1.0:1789762847.229815:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:1.0:1789762847.229821:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 178189 -> 180237 00010000:00010000:1.0:1789762847.229850:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.229862:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.229884:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.229891:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.229896:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.229905:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.229922:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.229930:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.229998:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140723968:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11813us (48021us total) trans 4294967658 rc 0/0 00000100:00100000:1.0:1789762847.230007:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:1.0:1789762847.230019:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251691241746 time 251691317986 state 0x2 ref 0 00000100:00100000:3.0:1789762847.232069:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762847.232105:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140724096 00000100:00100000:1.0:1789762847.232114:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140724096 00000100:00100000:1.0:1789762847.232153:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251691241746 time 251691317986 state 0x0 ref 1 00000100:00100000:1.0:1789762847.232178:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251741317986 time 251691317986 state 0x1 ref 1 00000100:00100000:1.0:1789762847.268216:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251741317986 time 251741369470 state 0x0 ref 1 00000100:00100000:1.0:1789762847.268235:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140724096:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762847.268274:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 92274688, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2c00d 00010000:00010000:1.0:1789762847.268283:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.268297:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:1.0:1789762847.268302:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.268308:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.268321:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762847.279993:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967659 is committed 00002000:00010000:1.0:1789762847.280011:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 92274688 -> 93323264 00002000:00010000:1.0:1789762847.280017:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 180237 -> 182285 00010000:00010000:1.0:1789762847.280030:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.280042:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.280083:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.280091:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.280096:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.280106:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.280125:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.280134:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.280212:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140724096:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11977us (48149us total) trans 4294967659 rc 0/0 00000100:00100000:1.0:1789762847.280223:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:1.0:1789762847.280235:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251741317986 time 251741369470 state 0x2 ref 0 00000100:00100000:3.0:1789762847.282452:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762847.282500:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140724224 00000100:00100000:2.0:1789762847.282510:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140724224 00000100:00100000:2.0:1789762847.282556:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251741317986 time 251741369470 state 0x0 ref 1 00000100:00100000:2.0:1789762847.282572:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251791369470 time 251741369470 state 0x1 ref 1 00000100:00100000:1.0:1789762847.318303:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251791369470 time 251791455296 state 0x0 ref 1 00000100:00100000:1.0:1789762847.318326:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140724224:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762847.318388:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 93323264, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2c80d 00010000:00010000:1.0:1789762847.318397:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.318412:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:1.0:1789762847.318417:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.318424:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.318437:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762847.329913:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967660 is committed 00002000:00010000:1.0:1789762847.329941:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 93323264 -> 94371840 00002000:00010000:1.0:1789762847.329947:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 182285 -> 184333 00010000:00010000:1.0:1789762847.329958:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.329970:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.329979:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.329986:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.329991:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.330014:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.330033:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.330041:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.330126:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140724224:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11805us (47671us total) trans 4294967660 rc 0/0 00000100:00100000:1.0:1789762847.330138:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:1.0:1789762847.330150:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251791369470 time 251791455296 state 0x2 ref 0 00000100:00100000:3.0:1789762847.332237:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762847.332278:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140724352 00000100:00100000:1.0:1789762847.332286:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140724352 00000100:00100000:1.0:1789762847.332328:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251791369470 time 251791455296 state 0x0 ref 1 00000100:00100000:1.0:1789762847.332341:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251841455296 time 251791455296 state 0x1 ref 1 00000100:00100000:1.0:1789762847.368380:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251841455296 time 251841520196 state 0x0 ref 1 00000100:00100000:1.0:1789762847.368406:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140724352:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762847.368456:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 94371840, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2d00d 00010000:00010000:1.0:1789762847.368474:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.368490:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:1.0:1789762847.368494:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.368500:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.368516:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762847.381000:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967661 is committed 00002000:00010000:1.0:1789762847.381029:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 94371840 -> 95420416 00002000:00010000:1.0:1789762847.381034:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 184333 -> 186381 00010000:00010000:1.0:1789762847.381046:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.381071:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.381081:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.381088:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.381094:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.381103:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.381127:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.381136:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.381207:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140724352:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12806us (48966us total) trans 4294967661 rc 0/0 00000100:00100000:1.0:1789762847.381218:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:1.0:1789762847.381229:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251841455296 time 251841520196 state 0x2 ref 0 00000100:00100000:0.0:1789762847.383304:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762847.383355:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140724480 00000100:00100000:2.0:1789762847.383364:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140724480 00000100:00100000:2.0:1789762847.383402:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251841455296 time 251841520196 state 0x0 ref 1 00000100:00100000:2.0:1789762847.383412:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251891520196 time 251841520196 state 0x1 ref 1 00000100:00100000:1.0:1789762847.418412:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251891520196 time 251891560411 state 0x0 ref 1 00000100:00100000:1.0:1789762847.418519:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140724480:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762847.418576:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 95420416, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2d80d 00010000:00010000:1.0:1789762847.418585:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.418601:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:1.0:1789762847.418607:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.418614:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.418658:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789762847.424868:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000004:00080000:2.0:1789762847.424887:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000100:00100000:1.0:1789762847.425009:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149023104:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789762847.425066:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149023232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789762847.425082:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762847.425118:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762847.425319:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149023360:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789762847.425360:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762847.425403:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789762847.425412:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149023488:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789762847.425414:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149023104 00000100:00100000:1.0:1789762847.425423:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149023104 00000100:00100000:2.0:1789762847.425437:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762847.425485:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149023232 00000100:00100000:1.0:1789762847.425491:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149023360 00000100:00100000:2.0:1789762847.425496:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149023232 00000100:00100000:1.0:1789762847.425498:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149023360 00000100:00100000:1.0:1789762847.425529:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149023488 00000100:00100000:1.0:1789762847.425534:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149023488 00000100:00100000:2.0:1789762847.425538:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789762847.425550:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149023104:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762847.425568:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00002000:00080000:2.0:1789762847.425568:0:6654:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:10 count 1 00000100:00100000:1.0:1789762847.425584:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149023360:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1789762847.425593:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 8388608, mtime: 0x6aad9d19, atime: 0x0, ctime: 0x6aad9d19, blocks: 0x4007 00010000:00010000:2.0:1789762847.425601:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd8e7409/0xd08452c77c56f9df lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789762847.425603:0:10283:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:9 count 1 00010000:00010000:2.0:1789762847.425615:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=251s v=(0 0) 00010000:00010000:2.0:1789762847.425619:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.425623:0:10283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.425624:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd8e7409/0xd08452c77c56f9df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.425652:0:6654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd8e7409/0xd08452c77c56f9df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.425658:0:10283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029b24162/0xd08452c77c56f5fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e84b expref: 9 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.425665:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd8e7409/0xd08452c77c56f9df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.425673:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1789762847.425675:0:6654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd8e7409/0xd08452c77c56f9df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.425679:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.425687:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.425696:0:6654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762847.425708:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762847.425717:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd8e7409/0xd08452c77c56f9df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.425721:0:10283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029b24162/0xd08452c77c56f5fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e84b expref: 9 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.425733:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f96400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762847.425740:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd8e7409/0xd08452c77c56f9df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.425749:0:10283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029b24162/0xd08452c77c56f5fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e84b expref: 9 pid: 6656 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.425750:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd8e7409/0xd08452c77c56f9df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.425768:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd8e7409/0xd08452c77c56f9df lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.425775:0:10283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a257480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10283:1876702149023616:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762847.425778:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd8e7409/0xd08452c77c56f9df lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.425804:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762847.425807:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762847.425810:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762847.425872:0:10283:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17b475900 going to sleep for 11 seconds 00000100:00100000:2.0:1789762847.426472:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3278:x1876702149023104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 923us (1390us total) trans 4294967663 rc 0/0 00000100:00100000:2.0:1789762847.426481:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789762847.426534:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789762847.426550:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16fbf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149023232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789762847.426564:0:6654:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:7 count 1 00002000:00010000:2.0:1789762847.426584:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 8388608, mtime: 0x6aad9d19, atime: 0x0, ctime: 0x6aad9d19, blocks: 0x4007 00010000:00010000:2.0:1789762847.426591:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049df24dd/0xd08452c77c56f9ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.426602:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=251s v=(0 0) 00010000:00010000:2.0:1789762847.426605:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762847.426609:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049df24dd/0xd08452c77c56f9ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.426621:0:6654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049df24dd/0xd08452c77c56f9ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.426628:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049df24dd/0xd08452c77c56f9ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.426634:0:6654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049df24dd/0xd08452c77c56f9ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762847.426690:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967353 is committed 00010000:00010000:2.0:1789762847.426703:0:6654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1789762847.426738:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967360 is committed 00000100:00100000:3.0:1789762847.426929:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762847.426956:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140724608 00000100:00100000:0.0:1789762847.426961:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140724608 00010000:00010000:0.0:1789762847.426983:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029b24162/0xd08452c77c56f5fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e84b expref: 10 pid: 6656 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789762847.426985:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762847.426993:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762847.427017:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:1.0:1789762847.427024:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789762847.427028:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a049850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+10:2345:x1876702140724608:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762847.427038:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789762847.427042:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149023488:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789762847.427045:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029b24162/0xd08452c77c56f5fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e84b expref: 10 pid: 6656 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.427073:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029b24162/0xd08452c77c56f5fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e84b expref: 10 pid: 6656 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789762847.427080:0:8803:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6 count 1 00010000:00010000:0.0:1789762847.427087:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762847.427092:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762847.427095:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.427102:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762847.427105:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8388608, mtime: 0x6aad9d19, atime: 0x0, ctime: 0x6aad9d19, blocks: 0x4007 00010000:00010000:1.0:1789762847.427116:0:8803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0d3e28f/0xd08452c77c56f9f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.427128:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762847.427128:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=251s v=(0 0) 00010000:00010000:1.0:1789762847.427134:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.427140:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d3e28f/0xd08452c77c56f9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.427153:0:8803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0d3e28f/0xd08452c77c56f9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762847.427162:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a049850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+10:2345:x1876702140724608:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 136us (236us total) trans 0 rc 0/0 00010000:00010000:1.0:1789762847.427166:0:8803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0d3e28f/0xd08452c77c56f9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762847.427174:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00010000:00010000:1.0:1789762847.427184:0:8803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d3e28f/0xd08452c77c56f9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.427219:0:8803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1789762847.427268:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16fbf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3279:x1876702149023232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 721us (2151us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1789762847.427274:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00010000:2.0:1789762847.427430:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789762847.427435:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049df24dd/0xd08452c77c56f9ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.427450:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762847.427454:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049df24dd/0xd08452c77c56f9ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.427461:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049df24dd/0xd08452c77c56f9ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.427471:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049df24dd/0xd08452c77c56f9ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.427478:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049df24dd/0xd08452c77c56f9ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.427491:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762847.427494:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0d3e28f/0xd08452c77c56f9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.427498:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ea00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762847.427502:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d3e28f/0xd08452c77c56f9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.427508:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d3e28f/0xd08452c77c56f9f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.427516:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0d3e28f/0xd08452c77c56f9f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.427526:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0d3e28f/0xd08452c77c56f9f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.427537:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762847.427538:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762847.427539:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789762847.427567:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d1463cd500/2, rc 0, transno 4294967361 00000100:00100000:2.0:1789762847.427572:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149023232:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789762847.427593:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d148cc2a00/2, rc 0, transno 4294967663 00000100:00100000:2.0:1789762847.427597:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149023104:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1789762847.427640:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967431 is committed 00000004:00080000:3.0:1789762847.427645:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000004:00080000:3.0:1789762847.427654:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:3.0:1789762847.427677:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967440 is committed 00000100:00100000:1.0:1789762847.427716:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3276:x1876702149023488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 678us (2276us total) trans 4294967362 rc 0/0 00000004:00080000:2.0:1789762847.427722:0:3276:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d1463cc000/2, rc 0, transno 4294967362 00000100:00100000:1.0:1789762847.427727:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789762847.427730:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149023488:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789762847.427818:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762847.427883:0:10283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029b24162/0xd08452c77c56f5fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e84b expref: 9 pid: 6656 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.427899:0:10283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a257480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10283:1876702149023616:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789762847.427922:0:10283:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.427933:0:10283:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.427941:0:10283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.427951:0:10283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.427960:0:10283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.427981:0:10283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762847.427989:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762847.427995:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.428003:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762847.428006:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.428012:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.428023:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.428035:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c56f9e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.428048:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762847.428051:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762847.428067:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762847.428626:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3276:x1876702149023360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3044us (3262us total) trans 4294967664 rc 0/0 00000100:00100000:1.0:1789762847.428636:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000004:00080000:2.0:1789762847.428661:0:3276:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d148cc3100/2, rc 0, transno 4294967664 00000100:00100000:2.0:1789762847.428669:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149023360:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1789762847.433726:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967662 is committed 00002000:00010000:1.0:1789762847.433744:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 95420416 -> 96468992 00002000:00010000:1.0:1789762847.433750:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 186381 -> 188429 00010000:00010000:1.0:1789762847.433759:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.433769:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.433777:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.433784:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.433787:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.433795:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.433806:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.433814:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.433883:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140724480:12345-192.168.203.31@tcp:4:dd.500 Request processed in 15455us (50578us total) trans 4294967662 rc 0/0 00000100:00100000:1.0:1789762847.433900:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:1.0:1789762847.433911:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251891520196 time 251891560411 state 0x2 ref 0 00000100:00100000:3.0:1789762847.435880:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762847.435919:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140724736 00000100:00100000:1.0:1789762847.435925:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140724736 00000100:00100000:1.0:1789762847.435956:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251891520196 time 251891560411 state 0x0 ref 1 00000100:00100000:1.0:1789762847.435970:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251941560411 time 251891560411 state 0x1 ref 1 00000100:00100000:1.0:1789762847.468461:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251941560411 time 251941615296 state 0x0 ref 1 00000100:00100000:1.0:1789762847.468478:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140724736:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762847.468511:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 96468992, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2e00d 00010000:00010000:1.0:1789762847.468518:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.468530:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:1.0:1789762847.468534:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.468539:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.468551:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762847.482336:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967665 is committed 00000001:00080000:0.0:1789762847.482348:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967664 is committed 00002000:00010000:1.0:1789762847.482365:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:1.0:1789762847.482378:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 188429 -> 190477 00010000:00010000:1.0:1789762847.482391:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.482404:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.482413:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.482421:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.482426:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.482435:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.482452:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.482461:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56f9fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.482529:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140724736:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14051us (46645us total) trans 4294967665 rc 0/0 00000100:00100000:1.0:1789762847.482541:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:1.0:1789762847.482552:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251941560411 time 251941615296 state 0x2 ref 0 00000100:00100000:3.0:1789762847.484621:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762847.484700:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140724864 00000100:00100000:2.0:1789762847.484709:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140724864 00000100:00100000:2.0:1789762847.484747:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251941560411 time 251941615296 state 0x0 ref 1 00000100:00100000:2.0:1789762847.484758:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251991615296 time 251941615296 state 0x1 ref 1 00000100:00100000:1.0:1789762847.518552:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251991615296 time 251991706562 state 0x0 ref 1 00000100:00100000:1.0:1789762847.518570:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140724864:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762847.518611:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 97517568, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2e80d 00010000:00010000:1.0:1789762847.518620:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56fa02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.518634:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=251s v=(0 0) 00010000:00010000:1.0:1789762847.518638:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.518644:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56fa02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.518656:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56fa02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762847.529780:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967666 is committed 00002000:00010000:2.0:1789762847.529794:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 97517568 -> 98566144 00002000:00010000:2.0:1789762847.529800:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 190477 -> 192525 00010000:00010000:2.0:1789762847.529810:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56fa02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.529820:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56fa02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.529827:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56fa02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.529865:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762847.529869:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56fa02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.529875:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56fa02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.529890:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56fa02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.529895:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c56fa02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762847.529956:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140724864:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11389us (45333us total) trans 4294967666 rc 0/0 00000100:00100000:2.0:1789762847.529964:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:2.0:1789762847.529975:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251991615296 time 251991706562 state 0x2 ref 0 00000100:00100000:0.0:1789762847.532124:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762847.532178:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140724992 00000100:00100000:1.0:1789762847.532187:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140724992 00000100:00100000:1.0:1789762847.532232:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 251991615296 time 251991706562 state 0x0 ref 1 00000100:00100000:1.0:1789762847.532246:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252041706562 time 251991706562 state 0x1 ref 1 00000100:00100000:1.0:1789762847.568614:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252041706562 time 252041762317 state 0x0 ref 1 00000100:00100000:1.0:1789762847.568639:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1519f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140724992:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762847.568699:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 98566144, mtime: 0x6aad9d1e, atime: 0x0, ctime: 0x6aad9d1e, blocks: 0x2f00d 00010000:00010000:1.0:1789762847.568709:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.568724:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=252s v=(0 0) 00010000:00010000:1.0:1789762847.568729:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.568736:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.568749:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762847.581072:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967667 is committed 00002000:00010000:1.0:1789762847.581100:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:1.0:1789762847.581106:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb mtime from disk: 1789762846 -> 1789762847 00002000:00010000:1.0:1789762847.581109:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb ctime from disk: 1789762846 -> 1789762847 00002000:00010000:1.0:1789762847.581111:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 192525 -> 194573 00010000:00010000:1.0:1789762847.581125:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.581138:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.581148:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.581156:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ec00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.581168:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.581179:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.581199:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.581208:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.581291:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1519f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140724992:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12657us (49163us total) trans 4294967667 rc 0/0 00000100:00100000:1.0:1789762847.581303:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:1.0:1789762847.581315:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252041706562 time 252041762317 state 0x2 ref 0 00000100:00100000:3.0:1789762847.583602:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762847.583686:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140725120 00000100:00100000:2.0:1789762847.583695:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140725120 00000100:00100000:2.0:1789762847.583737:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252041706562 time 252041762317 state 0x0 ref 1 00000100:00100000:2.0:1789762847.583748:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252091762317 time 252041762317 state 0x1 ref 1 00000100:00100000:2.0:1789762847.618646:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252091762317 time 252091801377 state 0x0 ref 1 00000100:00100000:2.0:1789762847.618671:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140725120:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762847.618710:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 99614720, mtime: 0x6aad9d1f, atime: 0x0, ctime: 0x6aad9d1f, blocks: 0x2f80d 00010000:00010000:2.0:1789762847.618717:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.618729:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=252s v=(0 0) 00010000:00010000:2.0:1789762847.618733:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762847.618737:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.618747:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762847.629946:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967668 is committed 00002000:00010000:2.0:1789762847.629952:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:2.0:1789762847.629957:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 194573 -> 196621 00010000:00010000:2.0:1789762847.629967:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.629977:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.629984:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.629989:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762847.629999:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.630006:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.630020:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.630025:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762847.630099:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140725120:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11428us (46495us total) trans 4294967668 rc 0/0 00000100:00100000:2.0:1789762847.630107:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:2.0:1789762847.630114:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252091762317 time 252091801377 state 0x2 ref 0 00000100:00100000:3.0:1789762847.632118:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762847.632172:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140725248 00000100:00100000:1.0:1789762847.632180:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140725248 00000100:00100000:1.0:1789762847.632223:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252091762317 time 252091801377 state 0x0 ref 1 00000100:00100000:1.0:1789762847.632237:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252141801377 time 252091801377 state 0x1 ref 1 00000100:00100000:1.0:1789762847.668733:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252141801377 time 252141881017 state 0x0 ref 1 00000100:00100000:1.0:1789762847.668758:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140725248:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762847.668819:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 100663296, mtime: 0x6aad9d1f, atime: 0x0, ctime: 0x6aad9d1f, blocks: 0x3000d 00010000:00010000:1.0:1789762847.668828:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.668874:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=252s v=(0 0) 00010000:00010000:1.0:1789762847.668879:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.668886:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.668900:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762847.680372:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967669 is committed 00002000:00010000:1.0:1789762847.680400:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:1.0:1789762847.680406:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 196621 -> 198669 00010000:00010000:1.0:1789762847.680419:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.680432:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.680442:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.680450:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ec00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.680454:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.680477:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.680497:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.680506:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.680582:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140725248:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11829us (48461us total) trans 4294967669 rc 0/0 00000100:00100000:1.0:1789762847.680593:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:1.0:1789762847.680606:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252141801377 time 252141881017 state 0x2 ref 0 00000100:00100000:0.0:1789762847.682790:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762847.682852:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140725376 00000100:00100000:2.0:1789762847.682860:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140725376 00000100:00100000:2.0:1789762847.682902:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252141801377 time 252141881017 state 0x0 ref 1 00000100:00100000:2.0:1789762847.682913:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252191881017 time 252141881017 state 0x1 ref 1 00000100:00100000:2.0:1789762847.718789:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252191881017 time 252191940219 state 0x0 ref 1 00000100:00100000:2.0:1789762847.718812:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140725376:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762847.718885:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 101711872, mtime: 0x6aad9d1f, atime: 0x0, ctime: 0x6aad9d1f, blocks: 0x3080d 00010000:00010000:2.0:1789762847.718894:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.718908:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=252s v=(0 0) 00010000:00010000:2.0:1789762847.718911:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762847.718916:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.718927:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762847.729988:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967670 is committed 00002000:00010000:2.0:1789762847.729991:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 101711872 -> 102760448 00002000:00010000:2.0:1789762847.729996:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 198669 -> 200717 00010000:00010000:2.0:1789762847.730007:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.730017:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.730024:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.730030:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762847.730034:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.730064:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.730081:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.730087:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762847.730150:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140725376:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11342us (47356us total) trans 4294967670 rc 0/0 00000100:00100000:2.0:1789762847.730157:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:2.0:1789762847.730166:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252191881017 time 252191940219 state 0x2 ref 0 00000100:00100000:0.0:1789762847.732245:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762847.732299:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140725504 00000100:00100000:1.0:1789762847.732308:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140725504 00000100:00100000:1.0:1789762847.732345:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252191881017 time 252191940219 state 0x0 ref 1 00000100:00100000:1.0:1789762847.732356:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252241940219 time 252191940219 state 0x1 ref 1 00000100:00100000:1.0:1789762847.768857:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252241940219 time 252241996587 state 0x0 ref 1 00000100:00100000:1.0:1789762847.768875:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140725504:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762847.768921:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 102760448, mtime: 0x6aad9d1f, atime: 0x0, ctime: 0x6aad9d1f, blocks: 0x3100d 00010000:00010000:1.0:1789762847.768928:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.768940:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=252s v=(0 0) 00010000:00010000:1.0:1789762847.768943:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.768947:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.768957:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762847.780274:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967671 is committed 00002000:00010000:1.0:1789762847.780297:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:1.0:1789762847.780302:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 200717 -> 202765 00010000:00010000:1.0:1789762847.780313:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.780323:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.780329:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.780334:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ec00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.780338:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.780354:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.780368:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.780373:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.780434:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140725504:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11560us (48185us total) trans 4294967671 rc 0/0 00000100:00100000:1.0:1789762847.780444:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:1.0:1789762847.780456:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252241940219 time 252241996587 state 0x2 ref 0 00000100:00100000:0.0:1789762847.782530:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762847.782582:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140725632 00000100:00100000:2.0:1789762847.782591:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140725632 00000100:00100000:2.0:1789762847.782629:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252241940219 time 252241996587 state 0x0 ref 1 00000100:00100000:2.0:1789762847.782640:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252291996587 time 252241996587 state 0x1 ref 1 00010000:00010000:0.0:1789762847.782905:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762847.818886:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252291996587 time 252292040754 state 0x0 ref 1 00000100:00100000:2.0:1789762847.818904:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140725632:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762847.818951:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 103809024, mtime: 0x6aad9d1f, atime: 0x0, ctime: 0x6aad9d1f, blocks: 0x3180d 00010000:00010000:2.0:1789762847.818958:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.818969:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=252s v=(0 0) 00010000:00010000:2.0:1789762847.818972:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762847.818977:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.818986:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762847.829781:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967672 is committed 00002000:00010000:2.0:1789762847.829781:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:2.0:1789762847.829788:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 202765 -> 204813 00010000:00010000:2.0:1789762847.829799:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.829809:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.829816:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.829821:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762847.829824:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.829858:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.829872:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.829878:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2ffc8c6/0xd08452c77c56fa2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762847.829936:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140725632:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11035us (47404us total) trans 4294967672 rc 0/0 00000100:00100000:2.0:1789762847.829944:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:2.0:1789762847.829952:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252291996587 time 252292040754 state 0x2 ref 0 00000100:00100000:3.0:1789762847.831335:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762847.831371:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140725888 00000100:00100000:2.0:1789762847.831380:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140725888 00000100:00080000:1.0:1789762847.831428:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762847.831444:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1789762847.831453:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+8:12251:x1876702140725888:12345-192.168.203.31@tcp:35:dd.500 00000001:00080000:2.0:1789762847.831639:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000100:00100000:2.0:1789762847.831699:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+10:12251:x1876702140725888:12345-192.168.203.31@tcp:35:dd.500 Request processed in 248us (366us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1789762847.831704:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000020:00080000:2.0:1789762847.831708:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789762847.870743:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762847.870794:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140726144 00000100:00100000:2.0:1789762847.870803:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140726144 00000100:00100000:2.0:1789762847.870872:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:2.0:1789762847.870881:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+10:12266:x1876702140726144:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:2.0:1789762847.870900:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762847.870959:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56fa33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e89f expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.871069:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56fa3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.871081:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56fa3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.871090:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56fa3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762847.871099:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1d:0x0]: returning size 104857600 00010000:00010000:2.0:1789762847.871196:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97c00/0xd08452c77c56fa33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e89f expref: 13 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.871215:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56fa3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e89f expref: 12 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.871222:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff95d142a04b00) 00010000:00010000:2.0:1789762847.871225:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789762847.871227:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f97200, rc 0) 00000100:00100000:2.0:1789762847.871269:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+12:12266:x1876702140726144:12345-192.168.203.31@tcp:101:dd.500 Request processed in 390us (532us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789762847.871274:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:0.0:1789762847.872425:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762847.872463:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140726272 00000100:00100000:2.0:1789762847.872476:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140726272 00000100:00100000:2.0:1789762847.872514:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:2.0:1789762847.872521:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140726272:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:2.0:1789762847.872529:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762847.872540:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56fa48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e8a6 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762847.872565:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 104857600, mtime: 0x6aad9d1f, atime: 0x0, ctime: 0x6aad9d1f, blocks: 0x3200d 00010000:00010000:2.0:1789762847.872576:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=252s v=(0 0) 00010000:00010000:2.0:1789762847.872580:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762847.872586:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56fa48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8a6 expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.872597:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56fa48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8a6 expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.872605:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148f96c00, rc 0) 00000100:00100000:2.0:1789762847.872631:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140726272:12345-192.168.203.31@tcp:101:dd.500 Request processed in 111us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762847.872638:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:3.0:1789762847.874808:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762847.874865:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140726400 00000100:00100000:1.0:1789762847.874870:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140726400 00000100:00100000:1.0:1789762847.874908:0:11722:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 3 deadline 0 time 252348065882 state 0x0 ref 1 00000100:00100000:1.0:1789762847.874917:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 3 deadline 252448065882 time 252348065882 state 0x1 ref 1 00000100:00100000:1.0:1789762847.874937:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 2 deadline 252448065882 time 252348099687 state 0x0 ref 1 00000100:00100000:1.0:1789762847.874945:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140726400:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762847.874968:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa4f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.874976:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.874979:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.874983:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa4f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.874990:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa4f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.878309:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa4f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.878319:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa4f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.878326:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.878332:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ec00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.878336:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.878343:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.878355:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.878367:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c56fa4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.878413:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140726400:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3467us (3606us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762847.878420:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:1.0:1789762847.878427:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 2 deadline 252448065882 time 252348099687 state 0x2 ref 0 00000100:00100000:0.0:1789762847.880130:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762847.880163:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140726528 00000100:00100000:1.0:1789762847.880168:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140726528 00000100:00100000:1.0:1789762847.880192:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 2 deadline 252448065882 time 252348099687 state 0x0 ref 1 00000100:00100000:1.0:1789762847.880201:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 2 deadline 252448099687 time 252348099687 state 0x1 ref 1 00000100:00100000:1.0:1789762847.880221:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 1 deadline 252448099687 time 252353384791 state 0x0 ref 1 00000100:00100000:1.0:1789762847.880229:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140726528:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762847.880244:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c56fa56 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.880252:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.880255:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.880259:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c56fa56 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.880277:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c56fa56 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.882474:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c56fa56 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.882482:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c56fa56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.882488:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c56fa56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.882493:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.882496:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c56fa56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.882501:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c56fa56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.882512:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c56fa56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.882517:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c56fa56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.882556:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140726528:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2326us (2426us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762847.882575:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:1.0:1789762847.882584:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 1 deadline 252448099687 time 252353384791 state 0x2 ref 0 00000100:00100000:2.0:1789762847.884145:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762847.884178:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140726656 00000100:00100000:1.0:1789762847.884183:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140726656 00000100:00100000:1.0:1789762847.884206:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 1 deadline 252448099687 time 252353384791 state 0x0 ref 1 00000100:00100000:1.0:1789762847.884215:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 1 deadline 252453384791 time 252353384791 state 0x1 ref 1 00000100:00100000:1.0:1789762847.884235:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252453384791 time 252357397861 state 0x0 ref 1 00000100:00100000:1.0:1789762847.884243:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140726656:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762847.884256:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa5d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.884264:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.884267:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.884270:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.884278:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.886479:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.886496:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.886502:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.886507:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762847.886510:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.886516:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.886527:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.886533:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.886584:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140726656:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2340us (2438us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762847.886591:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:1.0:1789762847.886597:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252453384791 time 252357397861 state 0x2 ref 0 00000100:00100000:2.0:1789762847.888262:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762847.888296:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140726784 00000100:00100000:1.0:1789762847.888307:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140726784 00000100:00100000:1.0:1789762847.888330:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252453384791 time 252357397861 state 0x0 ref 1 00000100:00100000:1.0:1789762847.888338:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252457397861 time 252357397861 state 0x1 ref 1 00000100:00100000:2.0:1789762847.984322:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252457397861 time 252457471013 state 0x0 ref 1 00000100:00100000:2.0:1789762847.984345:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140726784:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762847.984399:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56fa64 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.984413:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762847.984416:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762847.984420:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56fa64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.984431:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56fa64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.986998:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56fa64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.987011:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56fa64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.987020:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56fa64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.987027:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cdc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762847.987032:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56fa64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.987042:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56fa64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.987072:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56fa64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.987082:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5d97dee/0xd08452c77c56fa64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762847.987137:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140726784:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2798us (98874us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762847.987158:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:3.0:1789762847.987169:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252457397861 time 252457471013 state 0x2 ref 0 00000100:00100000:3.0:1789762847.988961:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762847.989007:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140726912 00000100:00100000:1.0:1789762847.989015:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140726912 00000100:00100000:1.0:1789762847.989065:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252457397861 time 252457471013 state 0x0 ref 1 00000100:00100000:1.0:1789762847.989076:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252557471013 time 252457471013 state 0x1 ref 1 00000100:00100000:1.0:1789762848.084385:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252557471013 time 252557535300 state 0x0 ref 1 00000100:00100000:1.0:1789762848.084409:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140726912:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762848.084445:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa6b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.084458:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762848.084461:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762848.084465:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa6b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.084476:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa6b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.087005:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa6b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.087025:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.087033:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.087039:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762848.087044:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.087059:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.087073:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.087079:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762848.087124:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140726912:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2724us (98164us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762848.087137:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:1.0:1789762848.087148:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252557471013 time 252557535300 state 0x2 ref 0 00000100:00100000:0.0:1789762848.089160:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762848.089193:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140727040 00000100:00100000:1.0:1789762848.089206:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140727040 00000100:00100000:1.0:1789762848.089241:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252557471013 time 252557535300 state 0x0 ref 1 00000100:00100000:1.0:1789762848.089252:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252657535300 time 252557535300 state 0x1 ref 1 00000100:00100000:3.0:1789762848.184490:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252657535300 time 252657635810 state 0x0 ref 1 00000100:00100000:3.0:1789762848.184519:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140727040:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762848.184557:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa72 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.184573:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762848.184577:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762848.184584:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa72 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.184599:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa72 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.187727:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa72 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.187742:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.187751:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.187768:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762848.187774:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.187782:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.187799:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.187807:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762848.187888:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140727040:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3377us (98727us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762848.187899:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:3.0:1789762848.187910:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252657535300 time 252657635810 state 0x2 ref 0 00000100:00100000:0.0:1789762848.189676:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762848.189723:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140727168 00000100:00100000:1.0:1789762848.189731:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140727168 00000100:00100000:1.0:1789762848.189770:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252657535300 time 252657635810 state 0x0 ref 1 00000100:00100000:1.0:1789762848.189781:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252757635810 time 252657635810 state 0x1 ref 1 00000100:00100000:1.0:1789762848.284544:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252757635810 time 252757694275 state 0x0 ref 1 00000100:00100000:1.0:1789762848.284580:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140727168:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762848.284623:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa79 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.284637:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762848.284640:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762848.284645:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa79 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.284656:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa79 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.287189:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa79 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.287207:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.287218:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.287227:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762848.287232:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.287243:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.287264:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.287273:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762848.287337:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140727168:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2776us (97660us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762848.287345:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:1.0:1789762848.287357:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252757635810 time 252757694275 state 0x2 ref 0 00000100:00100000:0.0:1789762848.289289:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762848.289339:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140727296 00000100:00100000:1.0:1789762848.289354:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140727296 00000100:00100000:1.0:1789762848.289395:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252757635810 time 252757694275 state 0x0 ref 1 00000100:00100000:1.0:1789762848.289406:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252857694275 time 252757694275 state 0x1 ref 1 00000100:00100000:3.0:1789762848.384646:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252857694275 time 252857791685 state 0x0 ref 1 00000100:00100000:3.0:1789762848.384673:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140727296:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762848.384712:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa80 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.384745:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762848.384750:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762848.384757:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa80 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.384771:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa80 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.387627:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa80 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.387639:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.387648:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.387655:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762848.387660:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.387669:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.387685:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.387707:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762848.387760:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140727296:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3097us (98474us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762848.387772:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:3.0:1789762848.387783:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252857694275 time 252857791685 state 0x2 ref 0 00000100:00100000:2.0:1789762848.389535:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762848.389589:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140727424 00000100:00100000:1.0:1789762848.389596:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140727424 00000100:00100000:1.0:1789762848.389634:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252857694275 time 252857791685 state 0x0 ref 1 00000100:00100000:1.0:1789762848.389644:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252957791685 time 252857791685 state 0x1 ref 1 00000100:00100000:1.0:1789762848.484705:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252957791685 time 252957854543 state 0x0 ref 1 00000100:00100000:1.0:1789762848.484729:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140727424:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762848.484766:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa87 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.484779:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762848.484783:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762848.484787:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.484798:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.487375:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.487394:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.487402:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.487407:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762848.487411:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.487418:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.487432:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.487438:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762848.487487:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140727424:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2766us (97952us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762848.487495:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:1.0:1789762848.487504:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252957791685 time 252957854543 state 0x2 ref 0 00000100:00100000:2.0:1789762848.489246:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762848.489284:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140727552 00000100:00100000:1.0:1789762848.489297:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140727552 00000100:00100000:1.0:1789762848.489329:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 252957791685 time 252957854543 state 0x0 ref 1 00000100:00100000:1.0:1789762848.489339:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253057854543 time 252957854543 state 0x1 ref 1 00000100:00100000:3.0:1789762848.584859:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253057854543 time 253057978818 state 0x0 ref 1 00000100:00100000:3.0:1789762848.584892:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140727552:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762848.584929:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa8e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.584944:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762848.584947:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762848.584952:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.584965:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.587608:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.587628:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.587634:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.587639:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762848.587643:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.587650:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.587664:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.587669:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762848.587727:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140727552:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2848us (98479us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762848.587736:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:3.0:1789762848.587744:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253057854543 time 253057978818 state 0x2 ref 0 00000100:00100000:3.0:1789762848.589531:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762848.589587:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140727680 00000100:00100000:1.0:1789762848.589595:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140727680 00000100:00100000:1.0:1789762848.589645:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253057854543 time 253057978818 state 0x0 ref 1 00000100:00100000:1.0:1789762848.589657:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253157978818 time 253057978818 state 0x1 ref 1 00000100:00100000:1.0:1789762848.684895:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253157978818 time 253158044611 state 0x0 ref 1 00000100:00100000:1.0:1789762848.684918:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140727680:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762848.684955:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa95 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.684969:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762848.684972:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762848.684977:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.684988:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.687707:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.687724:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.687732:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.687738:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762848.687741:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.687748:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.687762:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.687767:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fa95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762848.687814:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140727680:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2905us (98285us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762848.687821:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:1.0:1789762848.687829:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253157978818 time 253158044611 state 0x2 ref 0 00000100:00100000:3.0:1789762848.689634:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762848.689677:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140727808 00000100:00100000:1.0:1789762848.689694:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140727808 00000100:00100000:1.0:1789762848.689741:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253157978818 time 253158044611 state 0x0 ref 1 00000100:00100000:1.0:1789762848.689757:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253258044611 time 253158044611 state 0x1 ref 1 00000100:00100000:3.0:1789762848.784983:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253258044611 time 253258132551 state 0x0 ref 1 00000100:00100000:3.0:1789762848.785008:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140727808:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762848.785064:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa9c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.785083:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762848.785087:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762848.785092:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa9c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.785103:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa9c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.788009:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa9c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.788021:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa9c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.788032:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.788041:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762848.788060:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.788078:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.788094:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.788099:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fa9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762848.788145:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140727808:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3147us (98512us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762848.788152:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:3.0:1789762848.788160:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253258044611 time 253258132551 state 0x2 ref 0 00000100:00100000:3.0:1789762848.789912:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762848.789956:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140727936 00000100:00100000:1.0:1789762848.789964:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140727936 00000100:00100000:1.0:1789762848.790006:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253258044611 time 253258132551 state 0x0 ref 1 00000100:00100000:1.0:1789762848.790022:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253358132551 time 253258132551 state 0x1 ref 1 00010000:00010000:2.0:1789762848.806964:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762848.885038:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253358132551 time 253358188683 state 0x0 ref 1 00000100:00100000:1.0:1789762848.885078:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140727936:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762848.885111:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faa3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.885125:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762848.885129:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762848.885133:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.885144:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.887888:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.887908:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.887915:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.887921:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762848.887924:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.887930:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faa3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.887944:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faa3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.887949:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faa3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762848.887999:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140727936:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2930us (98087us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762848.888007:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:1.0:1789762848.888015:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253358132551 time 253358188683 state 0x2 ref 0 00000100:00100000:3.0:1789762848.890065:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762848.890115:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140728064 00000100:00100000:1.0:1789762848.890129:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140728064 00000100:00100000:1.0:1789762848.890164:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253358132551 time 253358188683 state 0x0 ref 1 00000100:00100000:1.0:1789762848.890177:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253458188683 time 253358188683 state 0x1 ref 1 00000100:00100000:3.0:1789762848.985143:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253458188683 time 253458290517 state 0x0 ref 1 00000100:00100000:3.0:1789762848.985171:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140728064:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762848.985214:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56faaa lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.985231:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762848.985236:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762848.985258:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56faaa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.985274:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56faaa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.988421:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56faaa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.988434:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56faaa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.988442:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56faaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.988448:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762848.988452:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56faaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.988458:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56faaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.988473:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56faaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.988478:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56faaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762848.988553:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140728064:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3383us (98480us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762848.988562:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:3.0:1789762848.988571:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253458188683 time 253458290517 state 0x2 ref 0 00000100:00100000:3.0:1789762848.990266:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762848.990315:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140728192 00000100:00100000:1.0:1789762848.990324:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140728192 00000100:00100000:1.0:1789762848.990378:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253458188683 time 253458290517 state 0x0 ref 1 00000100:00100000:1.0:1789762848.990393:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253558290517 time 253458290517 state 0x1 ref 1 00000100:00100000:1.0:1789762849.085203:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253558290517 time 253558352835 state 0x0 ref 1 00000100:00100000:1.0:1789762849.085240:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140728192:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:2.0:1789762849.085272:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762849.085275:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fab1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.085291:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.085294:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.085299:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fab1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.085309:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fab1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.088003:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fab1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.088029:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fab1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.088058:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fab1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.088068:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762849.088074:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fab1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.088086:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fab1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.088104:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fab1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.088111:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fab1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762849.088159:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140728192:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2941us (97894us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762849.088166:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:1.0:1789762849.088174:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253558290517 time 253558352835 state 0x2 ref 0 00000100:00100000:2.0:1789762849.089995:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762849.090078:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140728320 00000100:00100000:1.0:1789762849.090102:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140728320 00000100:00100000:1.0:1789762849.090139:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253558290517 time 253558352835 state 0x0 ref 1 00000100:00100000:1.0:1789762849.090150:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253658352835 time 253558352835 state 0x1 ref 1 00000100:00100000:3.0:1789762849.185329:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253658352835 time 253658478783 state 0x0 ref 1 00000100:00100000:3.0:1789762849.185351:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140728320:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762849.185387:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fab8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.185401:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762849.185404:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762849.185409:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fab8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.185420:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fab8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.188127:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fab8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.188137:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fab8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.188150:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.188155:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762849.188159:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.188166:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fab8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.188181:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fab8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.188187:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fab8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762849.188231:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140728320:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2887us (98236us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762849.188238:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:3.0:1789762849.188245:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253658352835 time 253658478783 state 0x2 ref 0 00000100:00100000:0.0:1789762849.189995:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762849.190052:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140728448 00000100:00100000:1.0:1789762849.190061:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140728448 00000100:00100000:1.0:1789762849.190097:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253658352835 time 253658478783 state 0x0 ref 1 00000100:00100000:1.0:1789762849.190109:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253758478783 time 253658478783 state 0x1 ref 1 00000100:00100000:1.0:1789762849.285391:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253758478783 time 253758541357 state 0x0 ref 1 00000100:00100000:1.0:1789762849.285415:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140728448:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762849.285467:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fabf lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.285481:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.285485:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.285491:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fabf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.285505:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fabf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.288599:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fabf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.288619:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fabf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.288626:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fabf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.288631:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762849.288636:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fabf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.288642:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fabf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.288656:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fabf lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.288661:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fabf lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762849.288708:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140728448:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3303us (98714us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762849.288715:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:1.0:1789762849.288723:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253758478783 time 253758541357 state 0x2 ref 0 00000100:00100000:2.0:1789762849.290475:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762849.290518:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140728576 00000100:00100000:1.0:1789762849.290536:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140728576 00000100:00100000:1.0:1789762849.290585:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253758478783 time 253758541357 state 0x0 ref 1 00000100:00100000:1.0:1789762849.290602:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253858541357 time 253758541357 state 0x1 ref 1 00000100:00100000:3.0:1789762849.385472:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253858541357 time 253858621908 state 0x0 ref 1 00000100:00100000:3.0:1789762849.385495:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140728576:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762849.385559:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fac6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.385577:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762849.385581:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762849.385586:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fac6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.385597:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fac6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.388094:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fac6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.388107:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fac6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.388118:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fac6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.388128:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16002a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762849.388144:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fac6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.388153:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fac6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.388170:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fac6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.388178:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a413596f/0xd08452c77c56fac6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762849.388238:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140728576:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2750us (97763us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762849.388248:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:2.0:1789762849.388259:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253858541357 time 253858621908 state 0x2 ref 0 00000100:00100000:0.0:1789762849.389929:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762849.389975:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140728704 00000100:00100000:1.0:1789762849.389984:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140728704 00000100:00100000:1.0:1789762849.390027:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253858541357 time 253858621908 state 0x0 ref 1 00000100:00100000:1.0:1789762849.390038:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253958621908 time 253858621908 state 0x1 ref 1 00000100:00100000:2.0:1789762849.446998:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149023744:0@lo:400:kworker.0 00000100:00100000:3.0:1789762849.446999:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149023872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762849.447011:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149024000:0@lo:400:kworker.0 00000100:00100000:1.0:1789762849.447050:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149024128:0@lo:400:kworker.0 00000100:00100000:0.0:1789762849.447104:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762849.447104:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762849.447105:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762849.447142:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149024000 00000100:00100000:1.0:1789762849.447149:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149024000 00000100:00100000:3.0:1789762849.447175:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149024384:0@lo:400:kworker.0 00000100:00100000:0.0:1789762849.447179:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149024512:0@lo:400:kworker.0 00000100:00100000:2.0:1789762849.447179:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149024256:0@lo:400:kworker.0 00000100:00100000:1.0:1789762849.447199:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789762849.447210:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762849.447213:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149024000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762849.447229:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762849.447256:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149024384 00000100:00100000:2.0:1789762849.447258:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149023872 00000100:00100000:3.0:1789762849.447261:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149024384 00000100:00100000:2.0:1789762849.447263:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149023872 00000100:00100000:1.0:1789762849.447273:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149024000:12345-0@lo:400:kworker.0 Request processed in 64us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762849.447279:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789762849.447286:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149024000:0@lo:400:kworker.0 00000100:00100000:1.0:1789762849.447309:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789762849.447321:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149024384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762849.447327:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789762849.447332:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789762849.447332:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762849.447338:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762849.447342:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1876702149023872:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762849.447362:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149023744 00000100:00100000:3.0:1789762849.447366:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149023744 00000100:00100000:1.0:1789762849.447376:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149024384:12345-0@lo:400:kworker.0 Request processed in 59us (167us total) trans 0 rc 0/0 00002000:00000024:2.0:1789762849.447377:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3843031040 avail 3840933888 00000100:00100000:1.0:1789762849.447388:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789762849.447399:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789762849.447404:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762849.447413:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149023744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762849.447417:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149024512 00000100:00100000:1.0:1789762849.447422:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149024512 00000100:00100000:2.0:1789762849.447429:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1876702149023872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762849.447445:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789762849.447467:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149023744:12345-0@lo:400:kworker.0 Request processed in 56us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762849.447468:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149024256 00000100:00100000:0.0:1789762849.447469:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149024384:0@lo:400:kworker.0 00000100:00100000:1.0:1789762849.447474:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149024256 00000100:00100000:2.0:1789762849.447480:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789762849.447484:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789762849.447491:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3276:x1876702149024512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762849.447501:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149023872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762849.447522:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789762849.447530:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149024128 00000100:00100000:1.0:1789762849.447535:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149024256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762849.447546:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149024128 00000100:00080000:0.0:1789762849.447553:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762849.447557:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3276:x1876702149024512:12345-0@lo:400:kworker.0 Request processed in 67us (328us total) trans 0 rc 0/0 00000100:00080000:0.0:1789762849.447560:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762849.447570:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789762849.447592:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149024256:12345-0@lo:400:kworker.0 Request processed in 60us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762849.447596:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149024512:0@lo:400:kworker.0 00000100:00100000:3.0:1789762849.447597:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789762849.447608:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789762849.447613:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149024128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762849.447619:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967664 gen 2 00000004:00080000:2.0:1789762849.447625:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d148cc2a00, transno 4294967663 00000004:00080000:2.0:1789762849.447635:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d148cc3100, transno 4294967664 00000100:00100000:2.0:1789762849.447642:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149024256:0@lo:400:kworker.0 00000100:00100000:2.0:1789762849.447663:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149023744:0@lo:400:kworker.0 00000100:00100000:3.0:1789762849.447668:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149024128:12345-0@lo:400:kworker.0 Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762849.447676:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789762849.447679:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149024128:0@lo:400:kworker.0 00000100:00100000:1.0:1789762849.485531:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253958621908 time 253958676083 state 0x0 ref 1 00000100:00100000:1.0:1789762849.485560:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140728704:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762849.485598:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56facd lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.485612:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.485616:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.485620:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56facd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.485631:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56facd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.488174:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56facd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.488185:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56facd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.488205:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56facd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.488211:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762849.488214:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56facd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.488221:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56facd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.488235:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56facd lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.488249:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56facd lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762849.488299:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140728704:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2750us (98369us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762849.488307:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:1.0:1789762849.488316:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253958621908 time 253958676083 state 0x2 ref 0 00000100:00100000:0.0:1789762849.490081:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762849.490120:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140728832 00000100:00100000:1.0:1789762849.490129:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140728832 00000100:00100000:1.0:1789762849.490165:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 253958621908 time 253958676083 state 0x0 ref 1 00000100:00100000:1.0:1789762849.490184:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254058676083 time 253958676083 state 0x1 ref 1 00000100:00100000:2.0:1789762849.585609:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254058676083 time 254058758207 state 0x0 ref 1 00000100:00100000:2.0:1789762849.585634:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140728832:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762849.585672:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fad4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.585686:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762849.585689:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762849.585701:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fad4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.585714:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fad4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.588270:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fad4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.588283:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fad4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.588293:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fad4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.588302:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762849.588307:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fad4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.588318:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fad4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.588338:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fad4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.588348:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fad4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762849.588403:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140728832:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2778us (98322us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762849.588413:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:2.0:1789762849.588437:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254058676083 time 254058758207 state 0x2 ref 0 00000100:00100000:3.0:1789762849.590157:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762849.590198:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140728960 00000100:00100000:1.0:1789762849.590207:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140728960 00000100:00100000:1.0:1789762849.590252:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254058676083 time 254058758207 state 0x0 ref 1 00000100:00100000:1.0:1789762849.590264:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254158758207 time 254058758207 state 0x1 ref 1 00000100:00100000:0.0:1789762849.652203:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762849.652234:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762849.652249:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140729216 00000100:00100000:0.0:1789762849.652258:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762849.652260:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140729216 00000100:00100000:0.0:1789762849.652286:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762849.652290:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140729088 00000100:00100000:1.0:1789762849.652296:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140729088 00000100:00100000:2.0:1789762849.652309:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140729344 00000100:00100000:2.0:1789762849.652315:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140729344 00000100:00100000:3.0:1789762849.652330:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140729472 00000100:00100000:3.0:1789762849.652335:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140729472 00000100:00100000:0.0:1789762849.652336:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:1.0:1789762849.652344:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 271 00000100:00100000:0.0:1789762849.652354:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140729216:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762849.652360:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140729088:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762849.652364:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:3.0:1789762849.652376:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:2.0:1789762849.652379:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140729344:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762849.652390:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140729472:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762849.652426:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140729216:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762849.652427:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140729088:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 70us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762849.652428:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140729344:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 52us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762849.652440:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140729472:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 51us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762849.652449:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:2.0:1789762849.652450:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:1.0:1789762849.652451:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 271 00000100:00100000:3.0:1789762849.652461:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00080000:3.0:1789762849.652489:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762849.652495:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762849.685670:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254158758207 time 254158819247 state 0x0 ref 1 00000100:00100000:1.0:1789762849.685696:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140728960:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762849.685739:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fadb lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.685754:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.685758:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.685762:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fadb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.685786:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fadb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.688549:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fadb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.688559:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fadb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.688567:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fadb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.688572:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762849.688576:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fadb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.688583:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fadb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.688597:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fadb lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.688603:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fadb lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762849.688659:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140728960:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2974us (98502us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762849.688668:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:1.0:1789762849.688676:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254158758207 time 254158819247 state 0x2 ref 0 00000100:00100000:0.0:1789762849.690369:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762849.690414:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140729600 00000100:00100000:1.0:1789762849.690422:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140729600 00000100:00100000:1.0:1789762849.690460:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254158758207 time 254158819247 state 0x0 ref 1 00000100:00100000:1.0:1789762849.690471:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254258819247 time 254158819247 state 0x1 ref 1 00000100:00100000:2.0:1789762849.785750:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254258819247 time 254258899292 state 0x0 ref 1 00000100:00100000:2.0:1789762849.785776:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140729600:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762849.785813:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fae2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.785826:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762849.785830:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762849.785850:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fae2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.785862:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fae2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.788387:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fae2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.788410:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fae2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.788420:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fae2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.788429:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762849.788434:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fae2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.788444:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fae2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.788464:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fae2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.788471:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56fae2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762849.788518:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140729600:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2753us (98149us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762849.788525:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:2.0:1789762849.788534:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254258819247 time 254258899292 state 0x2 ref 0 00000100:00100000:3.0:1789762849.790165:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762849.790210:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140729728 00000100:00100000:1.0:1789762849.790218:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140729728 00000100:00100000:1.0:1789762849.790256:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254258819247 time 254258899292 state 0x0 ref 1 00000100:00100000:1.0:1789762849.790267:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254358899292 time 254258899292 state 0x1 ref 1 00010000:00010000:1.0:1789762849.830912:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762849.885807:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254358899292 time 254358957622 state 0x0 ref 1 00000100:00100000:1.0:1789762849.885849:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140729728:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762849.885886:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fae9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.885916:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.885919:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.885924:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fae9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.885934:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fae9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.888699:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fae9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.888714:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fae9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.888725:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fae9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.888735:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762849.888741:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fae9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.888751:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fae9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.888765:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fae9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.888781:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fae9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762849.888829:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140729728:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3007us (98663us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762849.888865:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:1.0:1789762849.888877:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254358899292 time 254358957622 state 0x2 ref 0 00000100:00100000:0.0:1789762849.890619:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762849.890677:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140729856 00000100:00100000:1.0:1789762849.890686:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140729856 00000100:00100000:1.0:1789762849.890730:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254358899292 time 254358957622 state 0x0 ref 1 00000100:00100000:1.0:1789762849.890740:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254458957622 time 254358957622 state 0x1 ref 1 00000100:00100000:2.0:1789762849.958993:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789762849.959026:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149024640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762849.959107:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762849.959156:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149024640 00000100:00100000:0.0:1789762849.959166:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149024640 00000100:00100000:0.0:1789762849.959219:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789762849.959229:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149024640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762849.959260:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526581760 pending 0 free 3754950656 avail 3752853504 00000100:00100000:0.0:1789762849.959310:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149024640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762849.959315:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789762849.959358:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149024640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762849.985884:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254458957622 time 254459035580 state 0x0 ref 1 00000100:00100000:2.0:1789762849.985907:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140729856:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762849.985939:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56faf0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.985953:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762849.985956:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762849.985961:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56faf0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.985972:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56faf0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.988793:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56faf0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.988804:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56faf0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.988811:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56faf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.988825:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762849.988829:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56faf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.988857:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56faf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.988870:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56faf0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.988875:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c56faf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762849.988921:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140729856:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3022us (98304us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762849.988929:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:3.0:1789762849.988937:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254458957622 time 254459035580 state 0x2 ref 0 00000100:00100000:0.0:1789762849.990608:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762849.990653:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140729984 00000100:00100000:1.0:1789762849.990661:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140729984 00000100:00100000:1.0:1789762849.990708:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254458957622 time 254459035580 state 0x0 ref 1 00000100:00100000:1.0:1789762849.990723:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254559035580 time 254459035580 state 0x1 ref 1 00000100:00100000:1.0:1789762850.085948:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254559035580 time 254559097150 state 0x0 ref 1 00000100:00100000:1.0:1789762850.085974:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140729984:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762850.086028:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faf7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.086054:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762850.086057:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762850.086062:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faf7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.086073:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faf7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.088485:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faf7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.088494:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faf7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.088500:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faf7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.088505:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762850.088509:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faf7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.088516:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faf7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.088541:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faf7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.088547:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56faf7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762850.088596:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140729984:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2631us (97988us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762850.088605:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:1.0:1789762850.088616:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254559035580 time 254559097150 state 0x2 ref 0 00000100:00100000:2.0:1789762850.090570:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762850.090608:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140730112 00000100:00100000:1.0:1789762850.090616:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140730112 00000100:00100000:1.0:1789762850.090658:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254559035580 time 254559097150 state 0x0 ref 1 00000100:00100000:1.0:1789762850.090671:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254659097150 time 254559097150 state 0x1 ref 1 00000100:00100000:3.0:1789762850.186061:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254659097150 time 254659199052 state 0x0 ref 1 00000100:00100000:3.0:1789762850.186084:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140730112:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762850.186120:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fafe lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.186149:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762850.186153:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762850.186158:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fafe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.186168:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fafe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.188896:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fafe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.188904:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fafe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.188910:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fafe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.188915:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0442a6200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762850.188918:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fafe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.188924:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fafe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.188937:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fafe lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.188951:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fafe lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762850.188998:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140730112:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2920us (98426us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762850.189007:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:3.0:1789762850.189017:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254659097150 time 254659199052 state 0x2 ref 0 00000100:00100000:3.0:1789762850.190713:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762850.190757:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140730240 00000100:00100000:1.0:1789762850.190765:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140730240 00000100:00100000:1.0:1789762850.190804:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254659097150 time 254659199052 state 0x0 ref 1 00000100:00100000:1.0:1789762850.190814:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254759199052 time 254659199052 state 0x1 ref 1 00000100:00100000:1.0:1789762850.286124:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254759199052 time 254759274273 state 0x0 ref 1 00000100:00100000:1.0:1789762850.286159:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140730240:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762850.286194:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb05 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.286208:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762850.286211:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762850.286215:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.286226:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.288775:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.288787:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.288794:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.288800:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762850.288804:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.288810:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.288858:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.288864:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762850.288913:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140730240:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2760us (98201us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762850.288921:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:1.0:1789762850.288929:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254759199052 time 254759274273 state 0x2 ref 0 00000100:00100000:0.0:1789762850.290631:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762850.290680:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140730368 00000100:00100000:1.0:1789762850.290690:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140730368 00000100:00100000:1.0:1789762850.290736:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254759199052 time 254759274273 state 0x0 ref 1 00000100:00100000:1.0:1789762850.290753:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254859274273 time 254759274273 state 0x1 ref 1 00000100:00100000:3.0:1789762850.386229:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254859274273 time 254859377818 state 0x0 ref 1 00000100:00100000:3.0:1789762850.386253:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140730368:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762850.386288:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb0c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.386302:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762850.386305:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762850.386310:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.386321:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.389228:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.389247:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.389254:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.389259:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0442a6200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762850.389262:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.389268:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.389280:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.389285:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762850.389331:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140730368:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3088us (98700us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762850.389339:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:3.0:1789762850.389347:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254859274273 time 254859377818 state 0x2 ref 0 00000100:00100000:2.0:1789762850.391139:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762850.391193:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140730496 00000100:00100000:1.0:1789762850.391200:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140730496 00000100:00100000:1.0:1789762850.391234:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254859274273 time 254859377818 state 0x0 ref 1 00000100:00100000:1.0:1789762850.391245:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254959377818 time 254859377818 state 0x1 ref 1 00000100:00100000:1.0:1789762850.486306:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254959377818 time 254959455197 state 0x0 ref 1 00000100:00100000:1.0:1789762850.486343:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140730496:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762850.486381:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb13 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.486395:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762850.486398:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762850.486403:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb13 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.486413:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb13 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.489121:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb13 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.489133:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.489140:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.489146:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762850.489149:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.489156:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.489178:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.489184:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762850.489231:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140730496:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2897us (98093us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762850.489239:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:1.0:1789762850.489249:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254959377818 time 254959455197 state 0x2 ref 0 00000100:00100000:0.0:1789762850.491063:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762850.491102:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140730624 00000100:00100000:1.0:1789762850.491112:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140730624 00000100:00100000:1.0:1789762850.491155:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 254959377818 time 254959455197 state 0x0 ref 1 00000100:00100000:1.0:1789762850.491168:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255059455197 time 254959455197 state 0x1 ref 1 00000100:00100000:3.0:1789762850.586397:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255059455197 time 255059546078 state 0x0 ref 1 00000100:00100000:3.0:1789762850.586436:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140730624:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762850.586472:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb1a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.586487:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762850.586490:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762850.586503:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.586517:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.589289:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.589299:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.589306:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.589311:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0442a6200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762850.589314:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.589320:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.589339:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.589345:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762850.589391:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140730624:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2962us (98328us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762850.589400:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:3.0:1789762850.589410:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255059455197 time 255059546078 state 0x2 ref 0 00000100:00100000:0.0:1789762850.591120:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762850.591165:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140730752 00000100:00100000:1.0:1789762850.591173:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140730752 00000100:00100000:1.0:1789762850.591213:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255059455197 time 255059546078 state 0x0 ref 1 00000100:00100000:1.0:1789762850.591224:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255159546078 time 255059546078 state 0x1 ref 1 00000100:00100000:1.0:1789762850.686481:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255159546078 time 255159625857 state 0x0 ref 1 00000100:00100000:1.0:1789762850.686522:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140730752:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762850.686560:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb21 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.686573:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762850.686577:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762850.686590:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb21 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.686602:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb21 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.689193:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb21 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.689207:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb21 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.689217:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.689226:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762850.689232:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.689243:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.689270:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.689276:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762850.689323:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140730752:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2810us (98204us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762850.689330:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:1.0:1789762850.689338:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255159546078 time 255159625857 state 0x2 ref 0 00000100:00100000:2.0:1789762850.691276:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762850.691316:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140730880 00000100:00100000:1.0:1789762850.691325:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140730880 00000100:00100000:1.0:1789762850.691361:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255159546078 time 255159625857 state 0x0 ref 1 00000100:00100000:1.0:1789762850.691372:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255259625857 time 255159625857 state 0x1 ref 1 00000100:00100000:3.0:1789762850.786613:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255259625857 time 255259762505 state 0x0 ref 1 00000100:00100000:3.0:1789762850.786655:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140730880:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762850.786701:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb28 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.786719:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762850.786724:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762850.786730:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.786744:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.789614:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.789623:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.789639:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.789644:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0442a6200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762850.789648:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.789654:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.789667:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.789672:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d276b6ba/0xd08452c77c56fb28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762850.789718:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140730880:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3089us (98443us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762850.789725:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:2.0:1789762850.789733:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255259625857 time 255259762505 state 0x2 ref 0 00000100:00100000:2.0:1789762850.791431:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762850.791476:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140731008 00000100:00100000:1.0:1789762850.791485:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140731008 00000100:00100000:1.0:1789762850.791522:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255259625857 time 255259762505 state 0x0 ref 1 00000100:00100000:1.0:1789762850.791533:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255359762505 time 255259762505 state 0x1 ref 1 00010000:00010000:2.0:1789762850.854996:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762850.886683:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255359762505 time 255359833393 state 0x0 ref 1 00000100:00100000:1.0:1789762850.886720:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140731008:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762850.886756:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb2f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.886770:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762850.886773:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762850.886778:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.886788:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.889413:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.889422:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.889429:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.889435:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762850.889438:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.889445:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.889466:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.889473:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762850.889517:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140731008:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2803us (98085us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762850.889525:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:1.0:1789762850.889532:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255359762505 time 255359833393 state 0x2 ref 0 00000100:00100000:0.0:1789762850.891324:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762850.891357:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140731136 00000100:00100000:1.0:1789762850.891364:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140731136 00000100:00100000:1.0:1789762850.891398:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255359762505 time 255359833393 state 0x0 ref 1 00000100:00100000:1.0:1789762850.891408:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255459833393 time 255359833393 state 0x1 ref 1 00000100:00100000:2.0:1789762850.986764:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255459833393 time 255459913922 state 0x0 ref 1 00000100:00100000:2.0:1789762850.986805:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140731136:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762850.986859:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb36 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.986874:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762850.986878:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762850.986882:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.986893:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.989561:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.989572:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.989579:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.989583:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d041eaf600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762850.989587:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.989594:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.989620:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.989628:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762850.989697:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140731136:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2898us (98373us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762850.989707:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:2.0:1789762850.989717:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255459833393 time 255459913922 state 0x2 ref 0 00000100:00100000:3.0:1789762850.991459:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762850.991544:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140731264 00000100:00100000:1.0:1789762850.991552:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140731264 00000100:00100000:1.0:1789762850.991590:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255459833393 time 255459913922 state 0x0 ref 1 00000100:00100000:1.0:1789762850.991601:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255559913922 time 255459913922 state 0x1 ref 1 00000100:00100000:1.0:1789762851.086869:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255559913922 time 255559977980 state 0x0 ref 1 00000100:00100000:1.0:1789762851.086919:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140731264:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762851.086955:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb3d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789762851.086955:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762851.086971:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762851.086975:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762851.086980:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb3d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.086992:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb3d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.089636:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb3d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.089647:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb3d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.089654:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.089660:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762851.089663:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.089670:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.089697:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.089707:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762851.089759:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140731264:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2859us (98301us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762851.089768:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:1.0:1789762851.089776:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255559913922 time 255559977980 state 0x2 ref 0 00000100:00100000:3.0:1789762851.091640:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762851.091681:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140731392 00000100:00100000:1.0:1789762851.091691:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140731392 00000100:00100000:1.0:1789762851.091735:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255559913922 time 255559977980 state 0x0 ref 1 00000100:00100000:1.0:1789762851.091747:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255659977980 time 255559977980 state 0x1 ref 1 00000100:00100000:2.0:1789762851.187295:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255659977980 time 255660440715 state 0x0 ref 1 00000100:00100000:2.0:1789762851.187329:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140731392:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762851.187382:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb44 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.187402:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762851.187408:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762851.187415:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.187431:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.190646:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.190659:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.190666:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.190671:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d041eaf600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762851.190675:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.190689:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.190703:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.190708:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762851.190770:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140731392:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3452us (99125us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762851.190778:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:2.0:1789762851.190795:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255659977980 time 255660440715 state 0x2 ref 0 00000100:00100000:3.0:1789762851.192574:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762851.192627:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140731520 00000100:00100000:1.0:1789762851.192635:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140731520 00000100:00100000:1.0:1789762851.192676:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255659977980 time 255660440715 state 0x0 ref 1 00000100:00100000:1.0:1789762851.192687:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255760440715 time 255660440715 state 0x1 ref 1 00000100:00100000:1.0:1789762851.287352:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255760440715 time 255760498747 state 0x0 ref 1 00000100:00100000:1.0:1789762851.287396:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140731520:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762851.287432:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb4b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.287446:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762851.287449:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762851.287454:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.287465:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.290244:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.290254:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.290261:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.290266:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762851.290269:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.290276:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.290298:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.290304:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762851.290349:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140731520:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2963us (97782us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762851.290357:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:1.0:1789762851.290365:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255760440715 time 255760498747 state 0x2 ref 0 00000100:00100000:3.0:1789762851.292416:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762851.292457:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140731648 00000100:00100000:1.0:1789762851.292465:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140731648 00000100:00100000:1.0:1789762851.292509:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255760440715 time 255760498747 state 0x0 ref 1 00000100:00100000:1.0:1789762851.292521:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255860498747 time 255760498747 state 0x1 ref 1 00000100:00100000:2.0:1789762851.387464:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255860498747 time 255860614055 state 0x0 ref 1 00000100:00100000:2.0:1789762851.387491:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140731648:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762851.387528:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb52 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.387547:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762851.387552:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762851.387559:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.387574:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.390261:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.390273:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb52 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.390280:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.390285:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d041eaf600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762851.390299:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.390306:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.390320:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.390325:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762851.390379:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140731648:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2899us (97970us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762851.390387:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:2.0:1789762851.390395:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255860498747 time 255860614055 state 0x2 ref 0 00000100:00100000:0.0:1789762851.392279:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762851.392325:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140731776 00000100:00100000:1.0:1789762851.392334:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140731776 00000100:00100000:1.0:1789762851.392382:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255860498747 time 255860614055 state 0x0 ref 1 00000100:00100000:1.0:1789762851.392398:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255960614055 time 255860614055 state 0x1 ref 1 00000100:00100000:1.0:1789762851.487545:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255960614055 time 255960693395 state 0x0 ref 1 00000100:00100000:1.0:1789762851.487583:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140731776:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762851.487621:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.487636:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762851.487640:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762851.487645:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.487656:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.490558:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.490575:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.490587:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.490594:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762851.490597:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.490605:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.490627:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.490633:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762851.490683:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140731776:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3106us (98403us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762851.490690:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 170 00000100:00100000:1.0:1789762851.490699:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255960614055 time 255960693395 state 0x2 ref 0 00000100:00100000:0.0:1789762851.492868:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762851.492899:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140731904 00000100:00100000:1.0:1789762851.492908:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140731904 00000100:00100000:1.0:1789762851.492946:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 255960614055 time 255960693395 state 0x0 ref 1 00000100:00100000:1.0:1789762851.492957:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256060693395 time 255960693395 state 0x1 ref 1 00000100:00100000:2.0:1789762851.587644:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256060693395 time 256060789544 state 0x0 ref 1 00000100:00100000:2.0:1789762851.587675:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140731904:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762851.587717:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb60 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.587735:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762851.587740:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762851.587747:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb60 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.587778:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb60 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.590495:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb60 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.590509:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb60 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.590519:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.590526:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d041eaf600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762851.590531:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.590541:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.590559:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.590569:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762851.590640:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140731904:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2976us (97773us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762851.590652:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:2.0:1789762851.590663:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256060693395 time 256060789544 state 0x2 ref 0 00000100:00100000:3.0:1789762851.592604:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762851.592690:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140732032 00000100:00100000:1.0:1789762851.592701:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140732032 00000100:00100000:1.0:1789762851.592746:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256060693395 time 256060789544 state 0x0 ref 1 00000100:00100000:1.0:1789762851.592761:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256160789544 time 256060789544 state 0x1 ref 1 00000100:00100000:1.0:1789762851.687728:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256160789544 time 256160873704 state 0x0 ref 1 00000100:00100000:1.0:1789762851.687772:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140732032:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762851.687815:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb67 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.687829:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762851.687859:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762851.687865:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.687876:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.690400:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.690412:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb67 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.690419:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.690425:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762851.690429:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.690435:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.690457:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb67 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.690463:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762851.690514:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140732032:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2751us (97909us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762851.690524:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:1.0:1789762851.690535:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256160789544 time 256160873704 state 0x2 ref 0 00000100:00100000:2.0:1789762851.692385:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762851.692421:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140732160 00000100:00100000:1.0:1789762851.692428:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140732160 00000100:00100000:1.0:1789762851.692464:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256160789544 time 256160873704 state 0x0 ref 1 00000100:00100000:1.0:1789762851.692474:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256260873704 time 256160873704 state 0x1 ref 1 00000100:00100000:2.0:1789762851.787826:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256260873704 time 256260976520 state 0x0 ref 1 00000100:00100000:2.0:1789762851.787869:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140732160:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762851.787906:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb6e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.787920:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762851.787923:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762851.787928:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb6e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.787939:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb6e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.790493:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb6e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.790504:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb6e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.790525:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.790534:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d041eaf600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762851.790540:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.790551:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.790570:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.790576:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762851.790622:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140732160:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2762us (98237us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762851.790629:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:2.0:1789762851.790637:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256260873704 time 256260976520 state 0x2 ref 0 00000100:00100000:2.0:1789762851.792628:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762851.792686:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140732288 00000100:00100000:1.0:1789762851.792696:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140732288 00000100:00100000:1.0:1789762851.792737:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256260873704 time 256260976520 state 0x0 ref 1 00000100:00100000:1.0:1789762851.792749:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256360976520 time 256260976520 state 0x1 ref 1 00010000:00010000:0.0:1789762851.879010:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762851.887876:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256360976520 time 256361028452 state 0x0 ref 1 00000100:00100000:1.0:1789762851.887914:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140732288:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762851.887950:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb75 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.887964:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762851.887967:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762851.887972:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb75 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.887982:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb75 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.891049:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb75 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.891065:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.891075:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.891082:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762851.891086:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.891094:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.891119:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.891129:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762851.891194:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140732288:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3286us (98564us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762851.891206:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:1.0:1789762851.891218:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256360976520 time 256361028452 state 0x2 ref 0 00000100:00100000:3.0:1789762851.893221:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762851.893261:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140732416 00000100:00100000:1.0:1789762851.893269:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140732416 00000100:00100000:1.0:1789762851.893305:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256360976520 time 256361028452 state 0x0 ref 1 00000100:00100000:1.0:1789762851.893316:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256461028452 time 256361028452 state 0x1 ref 1 00000100:00100000:2.0:1789762851.987989:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256461028452 time 256461138334 state 0x0 ref 1 00000100:00100000:2.0:1789762851.988013:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140732416:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762851.988082:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb7c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.988097:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762851.988100:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762851.988105:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb7c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.988116:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb7c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.990783:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb7c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.990794:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb7c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.990801:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.990806:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d041eaf600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762851.990809:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.990815:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.990856:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.990863:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762851.990908:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140732416:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2905us (97690us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762851.990915:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:2.0:1789762851.990923:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256461028452 time 256461138334 state 0x2 ref 0 00000100:00100000:0.0:1789762851.993016:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762851.993080:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140732544 00000100:00100000:1.0:1789762851.993089:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140732544 00000100:00100000:1.0:1789762851.993127:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256461028452 time 256461138334 state 0x0 ref 1 00000100:00100000:1.0:1789762851.993138:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256561138334 time 256461138334 state 0x1 ref 1 00000100:00100000:1.0:1789762852.088084:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256561138334 time 256561232764 state 0x0 ref 1 00000100:00100000:1.0:1789762852.088124:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140732544:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762852.088163:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb83 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.088177:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762852.088180:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762852.088185:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb83 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.088196:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb83 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.091293:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb83 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.091307:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.091319:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.091328:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762852.091333:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.091343:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.091370:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.091376:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762852.091428:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140732544:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3309us (98410us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762852.091437:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:1.0:1789762852.091448:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256561138334 time 256561232764 state 0x2 ref 0 00000100:00100000:3.0:1789762852.093475:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762852.093513:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140732672 00000100:00100000:1.0:1789762852.093527:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140732672 00000100:00100000:1.0:1789762852.093565:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256561138334 time 256561232764 state 0x0 ref 1 00000100:00100000:1.0:1789762852.093576:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256661232764 time 256561232764 state 0x1 ref 1 00000100:00100000:2.0:1789762852.188174:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256661232764 time 256661322842 state 0x0 ref 1 00000100:00100000:2.0:1789762852.188196:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140732672:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762852.188231:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb8a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.188245:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762852.188249:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762852.188254:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb8a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.188264:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb8a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.190981:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb8a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.190992:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb8a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.190998:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.191003:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d041eaf600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762852.191006:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.191012:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.191039:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb8a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.191056:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016c3cad2/0xd08452c77c56fb8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762852.191104:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140732672:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2915us (97630us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762852.191112:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:3.0:1789762852.191120:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256661232764 time 256661322842 state 0x2 ref 0 00000100:00100000:3.0:1789762852.192848:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762852.192890:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140732800 00000100:00100000:1.0:1789762852.192898:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140732800 00000100:00100000:1.0:1789762852.192936:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256661232764 time 256661322842 state 0x0 ref 1 00000100:00100000:1.0:1789762852.192946:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256761322842 time 256661322842 state 0x1 ref 1 00000100:00100000:1.0:1789762852.288228:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256761322842 time 256761377382 state 0x0 ref 1 00000100:00100000:1.0:1789762852.288263:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140732800:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762852.288298:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb91 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.288313:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762852.288316:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762852.288321:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.288332:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.291182:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.291194:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb91 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.291202:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.291207:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762852.291211:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.291218:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.291242:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.291248:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762852.291298:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140732800:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3040us (98464us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762852.291305:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:1.0:1789762852.291313:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256761322842 time 256761377382 state 0x2 ref 0 00000100:00100000:0.0:1789762852.293431:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762852.293472:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140732928 00000100:00100000:1.0:1789762852.293481:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140732928 00000100:00100000:1.0:1789762852.293528:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256761322842 time 256761377382 state 0x0 ref 1 00000100:00100000:1.0:1789762852.293540:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256861377382 time 256761377382 state 0x1 ref 1 00000100:00100000:3.0:1789762852.388322:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256861377382 time 256861468124 state 0x0 ref 1 00000100:00100000:3.0:1789762852.388352:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140732928:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762852.388392:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fb98 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.388408:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762852.388412:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762852.388418:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fb98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.388433:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fb98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.391443:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fb98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.391467:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fb98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.391474:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fb98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.391480:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d043005000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762852.391483:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fb98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.391490:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fb98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.391503:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fb98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.391508:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fb98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762852.391558:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140732928:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3218us (98128us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762852.391566:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:3.0:1789762852.391575:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256861377382 time 256861468124 state 0x2 ref 0 00000100:00100000:2.0:1789762852.393273:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762852.393328:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140733056 00000100:00100000:1.0:1789762852.393338:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140733056 00000100:00100000:1.0:1789762852.393383:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256861377382 time 256861468124 state 0x0 ref 1 00000100:00100000:1.0:1789762852.393399:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256961468124 time 256861468124 state 0x1 ref 1 00000100:00100000:1.0:1789762852.488388:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256961468124 time 256961532799 state 0x0 ref 1 00000100:00100000:1.0:1789762852.488428:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140733056:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762852.488465:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb9f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.488489:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762852.488493:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762852.488500:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb9f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.488515:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb9f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.491123:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb9f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.491138:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.491149:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.491158:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762852.491164:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.491175:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.491200:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.491206:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fb9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762852.491262:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140733056:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2840us (97988us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762852.491270:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:1.0:1789762852.491279:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256961468124 time 256961532799 state 0x2 ref 0 00000100:00100000:0.0:1789762852.493452:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762852.493487:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140733184 00000100:00100000:1.0:1789762852.493495:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140733184 00000100:00100000:1.0:1789762852.493534:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 256961468124 time 256961532799 state 0x0 ref 1 00000100:00100000:1.0:1789762852.493550:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257061532799 time 256961532799 state 0x1 ref 1 00000001:00080000:0.0:1789762852.529030:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967443 is committed 00000001:00080000:3.0:1789762852.533029:0:13289:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967362 is committed 00000100:00100000:3.0:1789762852.588494:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257061532799 time 257061639919 state 0x0 ref 1 00000100:00100000:3.0:1789762852.588526:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140733184:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762852.588564:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fba6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.588578:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762852.588581:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762852.588585:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fba6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.588598:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fba6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.591063:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fba6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.591074:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fba6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.591081:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fba6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.591088:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d043005000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762852.591091:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fba6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.591098:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fba6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.591112:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fba6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.591117:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b146e1f6/0xd08452c77c56fba6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762852.591165:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140733184:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2652us (97714us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762852.591187:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:2.0:1789762852.591195:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257061532799 time 257061639919 state 0x2 ref 0 00000100:00100000:0.0:1789762852.592900:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762852.592949:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140733312 00000100:00100000:1.0:1789762852.592958:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140733312 00000100:00100000:1.0:1789762852.592994:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257061532799 time 257061639919 state 0x0 ref 1 00000100:00100000:1.0:1789762852.593005:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257161639919 time 257061639919 state 0x1 ref 1 00000100:00100000:1.0:1789762852.688556:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257161639919 time 257161704746 state 0x0 ref 1 00000100:00100000:1.0:1789762852.688593:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140733312:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762852.688630:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbad lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.688643:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762852.688647:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762852.688652:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.688663:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.691418:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.691431:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.691438:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.691444:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762852.691448:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.691454:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.691477:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbad lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.691483:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbad lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762852.691532:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140733312:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2945us (98631us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762852.691540:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:1.0:1789762852.691549:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257161639919 time 257161704746 state 0x2 ref 0 00000100:00100000:3.0:1789762852.693365:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762852.693407:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140733440 00000100:00100000:1.0:1789762852.693415:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140733440 00000100:00100000:1.0:1789762852.693453:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257161639919 time 257161704746 state 0x0 ref 1 00000100:00100000:1.0:1789762852.693463:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257261704746 time 257161704746 state 0x1 ref 1 00000100:00100000:2.0:1789762852.788645:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257261704746 time 257261795137 state 0x0 ref 1 00000100:00100000:2.0:1789762852.788673:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140733440:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762852.788710:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b82c7d8/0xd08452c77c56fbb4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.788724:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762852.788727:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762852.788732:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b82c7d8/0xd08452c77c56fbb4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.788744:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b82c7d8/0xd08452c77c56fbb4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.791483:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b82c7d8/0xd08452c77c56fbb4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.791501:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b82c7d8/0xd08452c77c56fbb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.791512:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b82c7d8/0xd08452c77c56fbb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.791519:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148f97800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762852.791523:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b82c7d8/0xd08452c77c56fbb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.791545:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b82c7d8/0xd08452c77c56fbb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.791560:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b82c7d8/0xd08452c77c56fbb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.791566:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b82c7d8/0xd08452c77c56fbb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762852.791618:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140733440:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2955us (98252us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762852.791628:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:3.0:1789762852.791640:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257261704746 time 257261795137 state 0x2 ref 0 00000100:00100000:3.0:1789762852.793660:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762852.793707:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140733568 00000100:00100000:1.0:1789762852.793715:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140733568 00000100:00100000:1.0:1789762852.793758:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257261704746 time 257261795137 state 0x0 ref 1 00000100:00100000:1.0:1789762852.793769:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257361795137 time 257261795137 state 0x1 ref 1 00000100:00100000:1.0:1789762852.888712:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257361795137 time 257361861527 state 0x0 ref 1 00000100:00100000:1.0:1789762852.888751:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140733568:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762852.888787:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbbb lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.888800:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762852.888805:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762852.888809:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.888819:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.891704:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.891718:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbbb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.891726:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.891732:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762852.891735:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.891743:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.891769:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.891779:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762852.891861:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140733568:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3088us (98171us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762852.891870:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:1.0:1789762852.891880:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257361795137 time 257361861527 state 0x2 ref 0 00000100:00100000:3.0:1789762852.894071:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762852.894105:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140733696 00000100:00100000:1.0:1789762852.894112:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140733696 00000100:00100000:1.0:1789762852.894158:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257361795137 time 257361861527 state 0x0 ref 1 00000100:00100000:1.0:1789762852.894171:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257461861527 time 257361861527 state 0x1 ref 1 00010000:00010000:2.0:1789762852.902939:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762852.988799:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257461861527 time 257461948764 state 0x0 ref 1 00000100:00100000:3.0:1789762852.988825:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140733696:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762852.988879:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56fbc2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.988893:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762852.988896:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762852.988914:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56fbc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.988926:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56fbc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.991860:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56fbc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.991872:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56fbc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.991879:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56fbc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.991891:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762852.991896:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56fbc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.991902:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56fbc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.991917:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56fbc2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.991932:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000113466cf/0xd08452c77c56fbc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762852.991983:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140733696:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3167us (97911us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762852.991992:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:2.0:1789762852.992000:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257461861527 time 257461948764 state 0x2 ref 0 00000100:00100000:2.0:1789762852.994233:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762852.994286:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140733824 00000100:00100000:1.0:1789762852.994295:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140733824 00000100:00100000:1.0:1789762852.994334:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257461861527 time 257461948764 state 0x0 ref 1 00000100:00100000:1.0:1789762852.994349:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257561948764 time 257461948764 state 0x1 ref 1 00000100:00100000:1.0:1789762853.088887:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257561948764 time 257562036951 state 0x0 ref 1 00000100:00100000:1.0:1789762853.088938:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140733824:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762853.088974:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbc9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789762853.088975:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762853.088990:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762853.088994:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762853.088999:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.089010:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.091940:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.091953:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbc9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.091960:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.091966:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762853.091970:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.091977:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.092002:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbc9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.092008:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762853.092070:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140733824:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3152us (97836us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762853.092079:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:1.0:1789762853.092088:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257561948764 time 257562036951 state 0x2 ref 0 00000100:00100000:0.0:1789762853.094046:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762853.094078:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140733952 00000100:00100000:1.0:1789762853.094086:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140733952 00000100:00100000:1.0:1789762853.094121:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257561948764 time 257562036951 state 0x0 ref 1 00000100:00100000:1.0:1789762853.094140:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257662036951 time 257562036951 state 0x1 ref 1 00000100:00100000:2.0:1789762853.188929:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257662036951 time 257662075199 state 0x0 ref 1 00000100:00100000:2.0:1789762853.188955:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140733952:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762853.188992:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbd0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.189029:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762853.189033:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762853.189039:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.189050:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.191909:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.191920:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbd0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.191927:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.191933:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d147cf0200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762853.191937:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.191943:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.191957:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbd0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.191972:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762853.192045:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140733952:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3097us (97999us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762853.192053:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:2.0:1789762853.192061:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257662036951 time 257662075199 state 0x2 ref 0 00000100:00100000:2.0:1789762853.193980:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762853.194023:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140734080 00000100:00100000:1.0:1789762853.194032:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140734080 00000100:00100000:1.0:1789762853.194075:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257662036951 time 257662075199 state 0x0 ref 1 00000100:00100000:1.0:1789762853.194086:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257762075199 time 257662075199 state 0x1 ref 1 00000100:00100000:1.0:1789762853.288994:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257762075199 time 257762143626 state 0x0 ref 1 00000100:00100000:1.0:1789762853.289042:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140734080:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762853.289079:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbd7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.289095:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762853.289100:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762853.289107:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbd7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.289122:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbd7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.291726:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbd7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.291738:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.291750:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.291756:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762853.291760:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.291766:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.291788:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.291794:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762853.291881:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140734080:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2845us (97902us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762853.291890:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:1.0:1789762853.291898:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257762075199 time 257762143626 state 0x2 ref 0 00000100:00100000:0.0:1789762853.293590:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762853.293629:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140734208 00000100:00100000:1.0:1789762853.293636:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140734208 00000100:00100000:1.0:1789762853.293669:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257762075199 time 257762143626 state 0x0 ref 1 00000100:00100000:1.0:1789762853.293680:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257862143626 time 257762143626 state 0x1 ref 1 00000100:00100000:2.0:1789762853.389101:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257862143626 time 257862250992 state 0x0 ref 1 00000100:00100000:2.0:1789762853.389125:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140734208:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762853.389162:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbde lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.389175:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762853.389179:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762853.389183:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbde lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.389194:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbde lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.391984:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbde lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.391998:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbde lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.392005:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.392022:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d147cf0200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762853.392026:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.392033:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.392046:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbde lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.392051:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbde lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762853.392098:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140734208:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2983us (98509us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762853.392105:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:2.0:1789762853.392112:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257862143626 time 257862250992 state 0x2 ref 0 00000100:00100000:2.0:1789762853.394108:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762853.394156:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140734336 00000100:00100000:1.0:1789762853.394164:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140734336 00000100:00100000:1.0:1789762853.394199:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257862143626 time 257862250992 state 0x0 ref 1 00000100:00100000:1.0:1789762853.394210:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257962250992 time 257862250992 state 0x1 ref 1 00000100:00100000:1.0:1789762853.489157:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257962250992 time 257962305312 state 0x0 ref 1 00000100:00100000:1.0:1789762853.489193:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140734336:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762853.489229:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbe5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.489243:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762853.489247:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762853.489251:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbe5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.489262:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbe5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.492673:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbe5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.492686:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbe5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.492694:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbe5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.492700:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762853.492704:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbe5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.492710:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbe5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.492733:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbe5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.492739:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbe5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762853.492789:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140734336:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3602us (98680us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762853.492797:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:1.0:1789762853.492806:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257962250992 time 257962305312 state 0x2 ref 0 00000100:00100000:0.0:1789762853.494887:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762853.494918:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140734464 00000100:00100000:1.0:1789762853.494926:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140734464 00000100:00100000:1.0:1789762853.494969:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 257962250992 time 257962305312 state 0x0 ref 1 00000100:00100000:1.0:1789762853.494985:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258062305312 time 257962305312 state 0x1 ref 1 00000100:00100000:2.0:1789762853.589244:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258062305312 time 258062389251 state 0x0 ref 1 00000100:00100000:2.0:1789762853.589276:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140734464:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762853.589317:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbec lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.589334:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762853.589338:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762853.589345:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.589361:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.592219:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.592231:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.592240:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.592248:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d147cf0200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762853.592253:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.592276:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.592294:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbec lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.592302:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbec lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762853.592358:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140734464:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3094us (97471us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762853.592368:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:2.0:1789762853.592378:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258062305312 time 258062389251 state 0x2 ref 0 00000100:00100000:0.0:1789762853.594394:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762853.594443:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140734592 00000100:00100000:1.0:1789762853.594452:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140734592 00000100:00100000:1.0:1789762853.594488:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258062305312 time 258062389251 state 0x0 ref 1 00000100:00100000:1.0:1789762853.594499:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258162389251 time 258062389251 state 0x1 ref 1 00000100:00100000:1.0:1789762853.689301:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258162389251 time 258162451542 state 0x0 ref 1 00000100:00100000:1.0:1789762853.689332:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140734592:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762853.689367:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbf3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.689388:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762853.689391:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762853.689396:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbf3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.689407:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbf3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.692195:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbf3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.692208:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbf3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.692218:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.692226:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762853.692232:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.692242:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.692269:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbf3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.692276:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fbf3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762853.692326:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140734592:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2997us (97931us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762853.692337:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:1.0:1789762853.692349:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258162389251 time 258162451542 state 0x2 ref 0 00000100:00100000:3.0:1789762853.694678:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762853.694712:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140734720 00000100:00100000:1.0:1789762853.694720:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140734720 00000100:00100000:1.0:1789762853.694758:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258162389251 time 258162451542 state 0x0 ref 1 00000100:00100000:1.0:1789762853.694768:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258262451542 time 258162451542 state 0x1 ref 1 00000100:00100000:2.0:1789762853.789404:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258262451542 time 258262551014 state 0x0 ref 1 00000100:00100000:2.0:1789762853.789432:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140734720:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762853.789469:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbfa lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.789484:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762853.789489:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762853.789495:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbfa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.789527:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbfa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.792642:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbfa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.792653:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbfa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.792662:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.792669:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d147cf0200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762853.792674:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.792683:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbfa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.792699:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbfa lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.792708:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fbfa lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762853.792778:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140734720:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3356us (98099us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762853.792788:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:2.0:1789762853.792798:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258262451542 time 258262551014 state 0x2 ref 0 00000100:00100000:0.0:1789762853.795105:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762853.795164:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140734848 00000100:00100000:1.0:1789762853.795173:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140734848 00000100:00100000:1.0:1789762853.795221:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258262451542 time 258262551014 state 0x0 ref 1 00000100:00100000:1.0:1789762853.795236:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258362551014 time 258262551014 state 0x1 ref 1 00000100:00100000:1.0:1789762853.889461:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258362551014 time 258362611564 state 0x0 ref 1 00000100:00100000:1.0:1789762853.889504:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140734848:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762853.889541:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc01 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.889556:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762853.889559:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762853.889564:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc01 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.889575:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc01 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.892456:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc01 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.892467:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc01 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.892475:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.892488:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762853.892492:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.892498:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.892521:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc01 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.892527:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc01 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762853.892575:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140734848:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3084us (97471us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762853.892583:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:1.0:1789762853.892595:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258362551014 time 258362611564 state 0x2 ref 0 00000100:00100000:0.0:1789762853.894698:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762853.894740:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140734976 00000100:00100000:1.0:1789762853.894748:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140734976 00000100:00100000:1.0:1789762853.894784:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258362551014 time 258362611564 state 0x0 ref 1 00000100:00100000:1.0:1789762853.894796:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258462611564 time 258362611564 state 0x1 ref 1 00010000:00010000:1.0:1789762853.926913:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762853.989549:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258462611564 time 258462698197 state 0x0 ref 1 00000100:00100000:2.0:1789762853.989578:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140734976:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762853.989616:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc08 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.989632:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762853.989636:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762853.989643:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc08 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.989658:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc08 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.992508:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc08 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.992520:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.992547:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.992555:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d147cf0200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762853.992560:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.992571:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.992589:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.992598:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762853.992662:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140734976:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3095us (97963us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762853.992673:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:2.0:1789762853.992683:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258462611564 time 258462698197 state 0x2 ref 0 00000100:00100000:3.0:1789762853.994328:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762853.994385:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140735104 00000100:00100000:1.0:1789762853.994394:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140735104 00000100:00100000:1.0:1789762853.994432:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258462611564 time 258462698197 state 0x0 ref 1 00000100:00100000:1.0:1789762853.994443:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258562698197 time 258462698197 state 0x1 ref 1 00000100:00100000:1.0:1789762854.089608:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258562698197 time 258562756929 state 0x0 ref 1 00000100:00100000:1.0:1789762854.089646:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140735104:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762854.089683:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc0f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.089697:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762854.089701:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762854.089706:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc0f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.089717:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc0f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.092571:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc0f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.092584:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc0f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.092592:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.092598:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762854.092602:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.092608:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.092632:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.092638:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762854.092689:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140735104:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3049us (98360us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762854.092697:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:1.0:1789762854.092706:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258562698197 time 258562756929 state 0x2 ref 0 00000100:00100000:3.0:1789762854.094761:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762854.094800:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140735232 00000100:00100000:1.0:1789762854.094808:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140735232 00000100:00100000:1.0:1789762854.094861:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258562698197 time 258562756929 state 0x0 ref 1 00000100:00100000:1.0:1789762854.094872:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258662756929 time 258562756929 state 0x1 ref 1 00000100:00100000:2.0:1789762854.189727:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258662756929 time 258662876344 state 0x0 ref 1 00000100:00100000:2.0:1789762854.189748:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140735232:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762854.189797:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc16 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.189811:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762854.189815:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762854.189819:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc16 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.189830:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc16 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.192320:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc16 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.192335:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.192343:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.192349:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d147cf0200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762854.192352:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.192359:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.192385:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.192391:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762854.192440:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140735232:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2699us (97679us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762854.192448:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:2.0:1789762854.192456:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258662756929 time 258662876344 state 0x2 ref 0 00000100:00100000:0.0:1789762854.194503:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762854.194563:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140735360 00000100:00100000:1.0:1789762854.194571:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140735360 00000100:00100000:1.0:1789762854.194618:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258662756929 time 258662876344 state 0x0 ref 1 00000100:00100000:1.0:1789762854.194633:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258762876344 time 258662876344 state 0x1 ref 1 00000100:00100000:1.0:1789762854.289805:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258762876344 time 258762950232 state 0x0 ref 1 00000100:00100000:1.0:1789762854.289877:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140735360:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762854.289916:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc1d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.289930:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762854.289934:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762854.289939:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.289950:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.292792:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.292803:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.292809:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.292814:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762854.292817:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.292824:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.292860:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.292866:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762854.292914:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140735360:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3046us (98413us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762854.292922:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:1.0:1789762854.292931:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258762876344 time 258762950232 state 0x2 ref 0 00000100:00100000:3.0:1789762854.294897:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762854.294927:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140735488 00000100:00100000:1.0:1789762854.294934:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140735488 00000100:00100000:1.0:1789762854.294969:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258762876344 time 258762950232 state 0x0 ref 1 00000100:00100000:1.0:1789762854.294980:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258862950232 time 258762950232 state 0x1 ref 1 00000100:00100000:2.0:1789762854.389886:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258862950232 time 258863034201 state 0x0 ref 1 00000100:00100000:2.0:1789762854.389917:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140735488:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762854.389958:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc24 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.389974:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762854.389978:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762854.389985:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.389999:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.393041:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.393052:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.393060:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.393067:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d147cf0200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762854.393071:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.393077:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.393092:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.393098:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762854.393147:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140735488:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3243us (98250us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762854.393154:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:2.0:1789762854.393168:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258862950232 time 258863034201 state 0x2 ref 0 00000100:00100000:2.0:1789762854.394943:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762854.394990:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140735616 00000100:00100000:1.0:1789762854.394998:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140735616 00000100:00100000:1.0:1789762854.395050:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258862950232 time 258863034201 state 0x0 ref 1 00000100:00100000:1.0:1789762854.395062:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258963034201 time 258863034201 state 0x1 ref 1 00000100:00100000:1.0:1789762854.489954:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258963034201 time 258963100503 state 0x0 ref 1 00000100:00100000:1.0:1789762854.489993:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140735616:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762854.490047:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc2b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.490065:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762854.490070:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762854.490077:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc2b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.490092:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc2b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.492870:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc2b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.492884:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.492893:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.492901:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762854.492906:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.492916:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.492941:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.492950:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762854.493020:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140735616:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3033us (98074us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762854.493031:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:1.0:1789762854.493043:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258963034201 time 258963100503 state 0x2 ref 0 00000100:00100000:0.0:1789762854.495153:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762854.495195:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140735744 00000100:00100000:1.0:1789762854.495204:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140735744 00000100:00100000:1.0:1789762854.495247:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 258963034201 time 258963100503 state 0x0 ref 1 00000100:00100000:1.0:1789762854.495262:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259063100503 time 258963100503 state 0x1 ref 1 00000100:00100000:0.0:1789762854.567016:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16019b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149024896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762854.567016:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149024768:0@lo:400:kworker.0 00000100:00100000:2.0:1789762854.567073:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149025024:0@lo:400:kworker.0 00000100:00100000:3.0:1789762854.567088:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149025152:0@lo:400:kworker.0 00000100:00100000:1.0:1789762854.567098:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762854.567102:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762854.567130:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762854.567160:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149024768 00000100:00100000:0.0:1789762854.567165:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149025408:0@lo:400:kworker.0 00000100:00100000:1.0:1789762854.567165:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149025280:0@lo:400:kworker.0 00000100:00100000:3.0:1789762854.567168:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149024768 00000100:00100000:2.0:1789762854.567184:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149025536:0@lo:400:kworker.0 00000100:00100000:0.0:1789762854.567208:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762854.567209:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762854.567231:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789762854.567241:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149024768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762854.567250:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762854.567261:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149024896 00000100:00100000:0.0:1789762854.567267:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149024896 00000100:00100000:1.0:1789762854.567268:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149025280 00000100:00100000:1.0:1789762854.567272:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149025280 00000100:00100000:3.0:1789762854.567310:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149024768:12345-0@lo:400:kworker.0 Request processed in 69us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762854.567318:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149025536 00000100:00100000:3.0:1789762854.567320:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789762854.567326:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789762854.567331:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149025536 00000100:00100000:2.0:1789762854.567338:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762854.567340:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149024896:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762854.567368:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149025024 00000100:00100000:1.0:1789762854.567369:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789762854.567373:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149025024 00002000:00000024:0.0:1789762854.567374:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762854.567379:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149025280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762854.567407:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149025408 00000100:00100000:3.0:1789762854.567411:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149025408 00000100:00100000:2.0:1789762854.567413:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149024768:0@lo:400:kworker.0 00000100:00100000:0.0:1789762854.567434:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149024896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762854.567438:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149025152 00000100:00100000:1.0:1789762854.567440:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149025280:12345-0@lo:400:kworker.0 Request processed in 61us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762854.567443:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149025152 00000100:00100000:1.0:1789762854.567456:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789762854.567456:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149025280:0@lo:400:kworker.0 00000100:00100000:0.0:1789762854.567457:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789762854.567473:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789762854.567482:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149025024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762854.567493:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789762854.567493:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789762854.567511:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789762854.567513:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149025408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762854.567513:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149025536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762854.567522:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149025024:12345-0@lo:400:kworker.0 Request processed in 41us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762854.567529:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149025152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762854.567536:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789762854.567563:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149025408:12345-0@lo:400:kworker.0 Request processed in 61us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762854.567563:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149025536:12345-0@lo:400:kworker.0 Request processed in 60us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762854.567572:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789762854.567572:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789762854.567574:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967362 gen 2 00000004:00080000:3.0:1789762854.567580:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d1463cd500, transno 4294967361 00000004:00080000:3.0:1789762854.567590:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d1463cc000, transno 4294967362 00000100:00100000:3.0:1789762854.567595:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149025536:0@lo:400:kworker.0 00000100:00080000:0.0:1789762854.567604:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762854.567611:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149025152:12345-0@lo:400:kworker.0 Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00080000:0.0:1789762854.567612:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762854.567612:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149025024:0@lo:400:kworker.0 00000100:00080000:0.0:1789762854.567618:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762854.567628:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789762854.567682:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149025152:0@lo:400:kworker.0 00000100:00100000:1.0:1789762854.567707:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149025408:0@lo:400:kworker.0 00000100:00100000:1.0:1789762854.567725:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16019b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149024896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762854.590040:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259063100503 time 259063191413 state 0x0 ref 1 00000100:00100000:2.0:1789762854.590060:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140735744:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762854.590092:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc32 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.590108:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762854.590113:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762854.590130:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.590147:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.592781:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.592794:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.592804:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.592813:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d147cf0200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762854.592819:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.592830:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.592870:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.592880:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762854.592947:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140735744:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2891us (97793us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762854.592957:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:2.0:1789762854.592968:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259063100503 time 259063191413 state 0x2 ref 0 00000100:00100000:3.0:1789762854.594634:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762854.594674:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140735872 00000100:00100000:1.0:1789762854.594681:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140735872 00000100:00100000:1.0:1789762854.594714:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259063100503 time 259063191413 state 0x0 ref 1 00000100:00100000:1.0:1789762854.594724:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259163191413 time 259063191413 state 0x1 ref 1 00000100:00100000:1.0:1789762854.690098:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259163191413 time 259163247979 state 0x0 ref 1 00000100:00100000:1.0:1789762854.690123:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140735872:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762854.690160:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc39 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.690189:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762854.690193:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762854.690197:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.690207:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.692981:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.692998:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.693022:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.693030:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762854.693035:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.693045:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.693063:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.693082:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762854.693135:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140735872:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3019us (98499us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762854.693145:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 202 00000100:00100000:1.0:1789762854.693156:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259163191413 time 259163247979 state 0x2 ref 0 00000100:00100000:3.0:1789762854.694875:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762854.694906:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140736000 00000100:00100000:1.0:1789762854.694914:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140736000 00000100:00100000:1.0:1789762854.694951:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259163191413 time 259163247979 state 0x0 ref 1 00000100:00100000:1.0:1789762854.694962:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259263247979 time 259163247979 state 0x1 ref 1 00000100:00100000:0.0:1789762854.772335:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762854.772370:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762854.772385:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140736256 00000100:00100000:0.0:1789762854.772391:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762854.772394:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140736256 00000100:00100000:1.0:1789762854.772417:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140736128 00000100:00100000:0.0:1789762854.772423:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762854.772424:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140736128 00000100:00100000:3.0:1789762854.772459:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140736512 00000100:00100000:2.0:1789762854.772461:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140736384 00000100:00100000:3.0:1789762854.772464:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140736512 00000100:00080000:0.0:1789762854.772465:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762854.772470:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140736384 00000100:00100000:1.0:1789762854.772483:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 273 00000100:00100000:0.0:1789762854.772489:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 170 00000100:00100000:1.0:1789762854.772496:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140736128:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762854.772520:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+9:2343:x1876702140736256:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762854.772534:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:2.0:1789762854.772540:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:3.0:1789762854.772552:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140736512:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762854.772557:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140736384:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762854.772561:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140736128:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762854.772567:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+9:2343:x1876702140736256:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 52us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762854.772576:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 273 00000100:00100000:0.0:1789762854.772581:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 170 00000100:00100000:3.0:1789762854.772601:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140736512:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 54us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762854.772608:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:2.0:1789762854.772616:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140736384:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 63us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762854.772626:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00080000:1.0:1789762854.772644:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762854.772650:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762854.790164:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259263247979 time 259263315873 state 0x0 ref 1 00000100:00100000:2.0:1789762854.790184:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140736000:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762854.790214:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc40 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.790230:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762854.790235:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762854.790242:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc40 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.790256:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc40 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.792902:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc40 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.792913:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc40 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.792921:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.792938:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d147cf0200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762854.792942:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.792949:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.792963:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.792968:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032edbdee/0xd08452c77c56fc40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762854.793028:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140736000:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2850us (98153us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762854.793035:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:3.0:1789762854.793042:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259263247979 time 259263315873 state 0x2 ref 0 00000100:00100000:0.0:1789762854.795235:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762854.795285:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140736640 00000100:00100000:1.0:1789762854.795298:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140736640 00000100:00100000:1.0:1789762854.795330:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259263247979 time 259263315873 state 0x0 ref 1 00000100:00100000:1.0:1789762854.795341:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259363315873 time 259263315873 state 0x1 ref 1 00000100:00100000:1.0:1789762854.890223:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259363315873 time 259363372256 state 0x0 ref 1 00000100:00100000:1.0:1789762854.890247:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140736640:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762854.890282:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc47 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.890296:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762854.890299:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762854.890304:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.890314:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.893023:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.893036:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.893047:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.893063:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762854.893067:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.893074:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.893089:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.893095:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762854.893143:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140736640:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2905us (97909us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762854.893150:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:1.0:1789762854.893158:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259363315873 time 259363372256 state 0x2 ref 0 00000100:00100000:2.0:1789762854.894880:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762854.894912:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140736768 00000100:00100000:1.0:1789762854.894921:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140736768 00000100:00100000:1.0:1789762854.894957:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259363315873 time 259363372256 state 0x0 ref 1 00000100:00100000:1.0:1789762854.894968:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259463372256 time 259363372256 state 0x1 ref 1 00010000:00010000:2.0:1789762854.950993:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762854.990292:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259463372256 time 259463442781 state 0x0 ref 1 00000100:00100000:3.0:1789762854.990321:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140736768:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762854.990355:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc4e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.990383:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762854.990386:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762854.990391:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc4e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.990401:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc4e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.993281:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc4e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.993290:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc4e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.993296:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.993302:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1742efa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762854.993305:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.993311:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.993326:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.993348:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762854.993398:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140736768:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3085us (98519us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762854.993405:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:3.0:1789762854.993413:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259463372256 time 259463442781 state 0x2 ref 0 00000100:00100000:3.0:1789762854.995194:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762854.995250:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140736896 00000100:00100000:1.0:1789762854.995267:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140736896 00000100:00100000:1.0:1789762854.995304:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259463372256 time 259463442781 state 0x0 ref 1 00000100:00100000:1.0:1789762854.995314:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259563442781 time 259463442781 state 0x1 ref 1 00000100:00100000:2.0:1789762855.079031:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149025664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762855.079092:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762855.079135:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149025664 00000100:00100000:0.0:1789762855.079143:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149025664 00000100:00100000:0.0:1789762855.079190:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789762855.079198:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149025664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762855.079226:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526581760 pending 0 free 3754950656 avail 3752853504 00000100:00100000:0.0:1789762855.079269:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149025664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762855.079275:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789762855.079306:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149025664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762855.090349:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259563442781 time 259563499749 state 0x0 ref 1 00000100:00100000:1.0:1789762855.090377:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140736896:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762855.090403:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc55 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789762855.090405:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762855.090426:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762855.090430:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762855.090435:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.090446:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.093227:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.093239:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.093246:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.093259:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762855.093262:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.093269:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.093290:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.093296:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762855.093352:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140736896:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2988us (98155us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762855.093360:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:1.0:1789762855.093369:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259563442781 time 259563499749 state 0x2 ref 0 00000100:00100000:3.0:1789762855.095141:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762855.095176:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140737024 00000100:00100000:1.0:1789762855.095182:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140737024 00000100:00100000:1.0:1789762855.095215:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259563442781 time 259563499749 state 0x0 ref 1 00000100:00100000:1.0:1789762855.095225:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259663499749 time 259563499749 state 0x1 ref 1 00000100:00100000:3.0:1789762855.190468:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259663499749 time 259663619561 state 0x0 ref 1 00000100:00100000:3.0:1789762855.190490:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140737024:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762855.190524:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc5c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762855.190537:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762855.190540:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762855.190545:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762855.190555:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.193391:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.193403:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.193410:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.193416:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1742efa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762855.193421:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.193427:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.193440:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.193445:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd945137/0xd08452c77c56fc5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762855.193510:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140737024:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3025us (98368us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762855.193522:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:2.0:1789762855.193532:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259663499749 time 259663619561 state 0x2 ref 0 00000100:00100000:2.0:1789762855.195379:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762855.195432:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140737152 00000100:00100000:1.0:1789762855.195446:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140737152 00000100:00100000:1.0:1789762855.195488:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259663499749 time 259663619561 state 0x0 ref 1 00000100:00100000:1.0:1789762855.195499:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259763619561 time 259663619561 state 0x1 ref 1 00000100:00100000:1.0:1789762855.290544:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259763619561 time 259763689206 state 0x0 ref 1 00000100:00100000:1.0:1789762855.290572:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140737152:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762855.290616:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc63 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.290634:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762855.290638:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762855.290644:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.290659:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.293512:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.293527:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.293537:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.293555:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762855.293561:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.293572:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.293591:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.293600:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762855.293660:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140737152:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3096us (98279us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762855.293671:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 208 00000100:00100000:1.0:1789762855.293684:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259763619561 time 259763689206 state 0x2 ref 0 00000100:00100000:2.0:1789762855.295382:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762855.295424:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140737280 00000100:00100000:1.0:1789762855.295433:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140737280 00000100:00100000:1.0:1789762855.295476:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259763619561 time 259763689206 state 0x0 ref 1 00000100:00100000:1.0:1789762855.295491:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259863689206 time 259763689206 state 0x1 ref 1 00000100:00100000:2.0:1789762855.390639:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259863689206 time 259863787956 state 0x0 ref 1 00000100:00100000:2.0:1789762855.390667:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140737280:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762855.390705:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c79d49df/0xd08452c77c56fc6a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.390727:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762855.390731:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762855.390736:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c79d49df/0xd08452c77c56fc6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.390748:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c79d49df/0xd08452c77c56fc6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762855.393499:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c79d49df/0xd08452c77c56fc6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762855.393513:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c79d49df/0xd08452c77c56fc6a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762855.393521:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c79d49df/0xd08452c77c56fc6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762855.393526:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cba400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762855.393529:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c79d49df/0xd08452c77c56fc6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762855.393535:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c79d49df/0xd08452c77c56fc6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762855.393548:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c79d49df/0xd08452c77c56fc6a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762855.393554:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c79d49df/0xd08452c77c56fc6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762855.393601:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140737280:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2946us (98220us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762855.393608:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:3.0:1789762855.393629:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259863689206 time 259863787956 state 0x2 ref 0 00000100:00100000:3.0:1789762855.395274:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762855.395318:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140737408 00000100:00100000:1.0:1789762855.395331:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140737408 00000100:00100000:1.0:1789762855.395367:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259863689206 time 259863787956 state 0x0 ref 1 00000100:00100000:1.0:1789762855.395378:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259963787956 time 259863787956 state 0x1 ref 1 00000100:00100000:1.0:1789762855.490715:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259963787956 time 259963859963 state 0x0 ref 1 00000100:00100000:1.0:1789762855.490746:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140737408:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762855.490790:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc71 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.490816:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762855.490821:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762855.490827:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc71 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.490867:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc71 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.493989:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc71 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.494019:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.494030:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.494051:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762855.494057:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.494067:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.494085:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.494090:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762855.494151:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140737408:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3415us (98873us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762855.494159:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:1.0:1789762855.494169:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259963787956 time 259963859963 state 0x2 ref 0 00000100:00100000:3.0:1789762855.496286:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762855.496333:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140737536 00000100:00100000:1.0:1789762855.496342:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140737536 00000100:00100000:1.0:1789762855.496390:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 259963787956 time 259963859963 state 0x0 ref 1 00000100:00100000:1.0:1789762855.496402:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260063859963 time 259963859963 state 0x1 ref 1 00000100:00100000:3.0:1789762855.590822:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260063859963 time 260063965851 state 0x0 ref 1 00000100:00100000:3.0:1789762855.590881:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140737536:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762855.590928:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56fc78 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762855.590950:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762855.590956:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762855.590964:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56fc78 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762855.590983:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56fc78 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.594159:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56fc78 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.594190:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56fc78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.594200:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56fc78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.594207:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762855.594212:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56fc78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.594222:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56fc78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.594242:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56fc78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.594249:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c56fc78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762855.594312:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140737536:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3441us (98028us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762855.594320:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:2.0:1789762855.594329:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260063859963 time 260063965851 state 0x2 ref 0 00000100:00100000:2.0:1789762855.596542:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762855.596601:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140737664 00000100:00100000:1.0:1789762855.596615:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140737664 00000100:00100000:1.0:1789762855.596657:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260063859963 time 260063965851 state 0x0 ref 1 00000100:00100000:1.0:1789762855.596673:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260163965851 time 260063965851 state 0x1 ref 1 00000100:00100000:1.0:1789762855.690894:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260163965851 time 260164043919 state 0x0 ref 1 00000100:00100000:1.0:1789762855.690919:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140737664:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762855.690957:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc7f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.690975:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762855.690979:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762855.690986:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc7f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.691014:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc7f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.693641:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc7f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.693654:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc7f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.693664:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.693684:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762855.693690:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.693700:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.693718:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc7f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.693726:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc7f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762855.693783:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140737664:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2872us (97241us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762855.693795:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:1.0:1789762855.693807:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260163965851 time 260164043919 state 0x2 ref 0 00000100:00100000:0.0:1789762855.695589:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762855.695635:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140737792 00000100:00100000:1.0:1789762855.695644:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140737792 00000100:00100000:1.0:1789762855.695687:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260163965851 time 260164043919 state 0x0 ref 1 00000100:00100000:1.0:1789762855.695702:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260264043919 time 260164043919 state 0x1 ref 1 00000100:00100000:2.0:1789762855.791028:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260264043919 time 260264176216 state 0x0 ref 1 00000100:00100000:2.0:1789762855.791055:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140737792:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762855.791091:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc86 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.791105:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762855.791109:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762855.791114:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc86 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.791124:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc86 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.793969:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc86 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.793984:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.794005:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.794014:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762855.794020:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.794052:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.794070:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.794077:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762855.794123:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140737792:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3080us (98535us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762855.794131:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:2.0:1789762855.794139:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260264043919 time 260264176216 state 0x2 ref 0 00000100:00100000:3.0:1789762855.795791:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762855.795862:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140737920 00000100:00100000:1.0:1789762855.795878:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140737920 00000100:00100000:1.0:1789762855.795921:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260264043919 time 260264176216 state 0x0 ref 1 00000100:00100000:1.0:1789762855.795935:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260364176216 time 260264176216 state 0x1 ref 1 00000100:00100000:1.0:1789762855.891096:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260364176216 time 260364242421 state 0x0 ref 1 00000100:00100000:1.0:1789762855.891125:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140737920:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762855.891164:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc8d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.891181:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762855.891185:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762855.891192:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.891206:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.894156:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.894170:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.894180:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.894201:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762855.894207:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.894217:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.894234:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.894242:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762855.894301:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140737920:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3186us (98509us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762855.894311:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:1.0:1789762855.894322:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260364176216 time 260364242421 state 0x2 ref 0 00000100:00100000:3.0:1789762855.896127:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762855.896165:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140738048 00000100:00100000:1.0:1789762855.896173:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140738048 00000100:00100000:1.0:1789762855.896217:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260364176216 time 260364242421 state 0x0 ref 1 00000100:00100000:1.0:1789762855.896231:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260464242421 time 260364242421 state 0x1 ref 1 00010000:00010000:0.0:1789762855.975011:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762855.991167:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260464242421 time 260464319231 state 0x0 ref 1 00000100:00100000:2.0:1789762855.991191:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140738048:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762855.991225:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc94 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.991239:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762855.991243:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762855.991247:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc94 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.991273:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc94 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.994150:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc94 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.994161:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.994168:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.994173:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762855.994176:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.994182:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.994194:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.994200:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fc94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762855.994259:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140738048:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3077us (98133us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762855.994268:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:2.0:1789762855.994276:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260464242421 time 260464319231 state 0x2 ref 0 00000100:00100000:0.0:1789762855.996046:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762855.996099:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140738176 00000100:00100000:1.0:1789762855.996116:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140738176 00000100:00100000:1.0:1789762855.996157:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260464242421 time 260464319231 state 0x0 ref 1 00000100:00100000:1.0:1789762855.996173:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260564319231 time 260464319231 state 0x1 ref 1 00000100:00100000:1.0:1789762856.091243:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260564319231 time 260564389296 state 0x0 ref 1 00000100:00100000:1.0:1789762856.091269:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140738176:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762856.091308:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc9b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.091324:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762856.091329:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762856.091335:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.091348:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.094600:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.094614:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.094624:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.094645:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762856.094650:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.094661:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.094678:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.094686:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fc9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762856.094743:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140738176:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3481us (98696us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762856.094754:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:1.0:1789762856.094765:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260564319231 time 260564389296 state 0x2 ref 0 00000100:00100000:3.0:1789762856.096515:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762856.096560:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140738304 00000100:00100000:1.0:1789762856.096568:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140738304 00000100:00100000:1.0:1789762856.096608:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260564319231 time 260564389296 state 0x0 ref 1 00000100:00100000:1.0:1789762856.096622:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260664389296 time 260564389296 state 0x1 ref 1 00000100:00100000:2.0:1789762856.191345:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260664389296 time 260664489979 state 0x0 ref 1 00000100:00100000:2.0:1789762856.191375:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140738304:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762856.191417:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fca2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.191436:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762856.191442:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762856.191448:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fca2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.191474:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fca2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.194813:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fca2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.194823:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fca2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.194856:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fca2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.194862:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762856.194865:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fca2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.194871:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fca2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.194884:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fca2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.194889:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fca2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762856.194934:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140738304:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3571us (98422us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762856.194942:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:2.0:1789762856.194950:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260664389296 time 260664489979 state 0x2 ref 0 00000100:00100000:0.0:1789762856.196965:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762856.197029:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140738432 00000100:00100000:1.0:1789762856.197045:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140738432 00000100:00100000:1.0:1789762856.197087:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260664389296 time 260664489979 state 0x0 ref 1 00000100:00100000:1.0:1789762856.197101:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260764489979 time 260664489979 state 0x1 ref 1 00000100:00100000:1.0:1789762856.291413:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260764489979 time 260764559636 state 0x0 ref 1 00000100:00100000:1.0:1789762856.291437:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140738432:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762856.291475:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fca9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.291491:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762856.291496:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762856.291502:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fca9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.291515:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fca9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.294339:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fca9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.294351:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fca9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.294361:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.294381:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762856.294386:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.294396:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fca9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.294412:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fca9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.294420:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fca9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762856.294473:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140738432:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3044us (97508us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762856.294483:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:1.0:1789762856.294494:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260764489979 time 260764559636 state 0x2 ref 0 00000100:00100000:0.0:1789762856.296273:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762856.296315:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140738560 00000100:00100000:1.0:1789762856.296325:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140738560 00000100:00100000:1.0:1789762856.296363:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260764489979 time 260764559636 state 0x0 ref 1 00000100:00100000:1.0:1789762856.296377:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260864559636 time 260764559636 state 0x1 ref 1 00000100:00100000:2.0:1789762856.391520:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260864559636 time 260864668815 state 0x0 ref 1 00000100:00100000:2.0:1789762856.391556:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140738560:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762856.391606:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcb0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.391619:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762856.391623:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762856.391627:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcb0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.391638:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcb0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.394560:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcb0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.394572:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcb0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.394578:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.394583:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762856.394586:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.394593:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.394616:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.394622:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762856.394676:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140738560:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3137us (98400us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762856.394686:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:2.0:1789762856.394697:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260864559636 time 260864668815 state 0x2 ref 0 00000100:00100000:3.0:1789762856.396624:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762856.396677:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140738688 00000100:00100000:1.0:1789762856.396693:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140738688 00000100:00100000:1.0:1789762856.396736:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260864559636 time 260864668815 state 0x0 ref 1 00000100:00100000:1.0:1789762856.396747:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260964668815 time 260864668815 state 0x1 ref 1 00000100:00100000:1.0:1789762856.491577:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260964668815 time 260964725995 state 0x0 ref 1 00000100:00100000:1.0:1789762856.491602:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140738688:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762856.491639:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcb7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.491653:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762856.491656:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762856.491661:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcb7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.491672:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcb7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.494524:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcb7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.494533:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcb7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.494540:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.494560:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762856.494566:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.494577:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.494596:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcb7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.494605:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcb7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762856.494657:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140738688:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3066us (98034us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762856.494665:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:1.0:1789762856.494672:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260964668815 time 260964725995 state 0x2 ref 0 00000100:00100000:3.0:1789762856.496661:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762856.496700:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140738816 00000100:00100000:1.0:1789762856.496707:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140738816 00000100:00100000:1.0:1789762856.496741:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 260964668815 time 260964725995 state 0x0 ref 1 00000100:00100000:1.0:1789762856.496752:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261064725995 time 260964725995 state 0x1 ref 1 00000100:00100000:2.0:1789762856.591703:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261064725995 time 261064849966 state 0x0 ref 1 00000100:00100000:2.0:1789762856.591731:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140738816:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762856.591768:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcbe lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.591782:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762856.591785:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762856.591790:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.591802:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.595014:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.595031:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.595042:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.595051:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762856.595057:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.595067:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.595084:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcbe lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.595093:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcbe lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762856.595146:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140738816:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3426us (98484us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762856.595156:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:2.0:1789762856.595176:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261064725995 time 261064849966 state 0x2 ref 0 00000100:00100000:3.0:1789762856.597127:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762856.597169:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140738944 00000100:00100000:1.0:1789762856.597183:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140738944 00000100:00100000:1.0:1789762856.597219:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261064725995 time 261064849966 state 0x0 ref 1 00000100:00100000:1.0:1789762856.597230:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261164849966 time 261064849966 state 0x1 ref 1 00000100:00100000:1.0:1789762856.691773:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261164849966 time 261164919920 state 0x0 ref 1 00000100:00100000:1.0:1789762856.691803:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140738944:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762856.691867:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcc5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.691885:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762856.691889:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762856.691895:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.691908:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.694859:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.694872:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.694882:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.694904:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762856.694909:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.694920:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.694939:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.694948:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762856.695017:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140738944:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3226us (97889us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762856.695028:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:1.0:1789762856.695039:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261164849966 time 261164919920 state 0x2 ref 0 00000100:00100000:3.0:1789762856.697047:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762856.697088:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140739072 00000100:00100000:1.0:1789762856.697097:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140739072 00000100:00100000:1.0:1789762856.697138:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261164849966 time 261164919920 state 0x0 ref 1 00000100:00100000:1.0:1789762856.697152:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261264919920 time 261164919920 state 0x1 ref 1 00000100:00100000:2.0:1789762856.791905:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261264919920 time 261265054816 state 0x0 ref 1 00000100:00100000:2.0:1789762856.791933:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140739072:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762856.791971:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fccc lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.792001:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762856.792007:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762856.792014:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fccc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.792029:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fccc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.795007:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fccc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.795018:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fccc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.795025:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fccc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.795030:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762856.795042:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fccc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.795049:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fccc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.795062:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fccc lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.795067:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fccc lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762856.795114:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140739072:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3193us (98067us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762856.795122:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:2.0:1789762856.795130:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261264919920 time 261265054816 state 0x2 ref 0 00000100:00100000:3.0:1789762856.797245:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762856.797293:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140739200 00000100:00100000:1.0:1789762856.797308:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140739200 00000100:00100000:1.0:1789762856.797344:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261264919920 time 261265054816 state 0x0 ref 1 00000100:00100000:1.0:1789762856.797355:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261365054816 time 261265054816 state 0x1 ref 1 00000100:00100000:1.0:1789762856.891967:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261365054816 time 261365116186 state 0x0 ref 1 00000100:00100000:1.0:1789762856.892008:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140739200:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762856.892046:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcd3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.892060:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762856.892063:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762856.892068:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcd3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.892078:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcd3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.894996:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcd3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.895011:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.895022:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.895047:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762856.895051:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.895058:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.895071:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762856.895077:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762856.895126:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140739200:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3144us (97882us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762856.895134:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:1.0:1789762856.895142:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261365054816 time 261365116186 state 0x2 ref 0 00000100:00100000:0.0:1789762856.897042:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762856.897079:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140739328 00000100:00100000:1.0:1789762856.897087:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140739328 00000100:00100000:1.0:1789762856.897123:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261365054816 time 261365116186 state 0x0 ref 1 00000100:00100000:1.0:1789762856.897134:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261465116186 time 261365116186 state 0x1 ref 1 00000100:00100000:2.0:1789762856.992078:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261465116186 time 261465227933 state 0x0 ref 1 00000100:00100000:2.0:1789762856.992103:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140739328:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762856.992148:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcda lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.992161:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762856.992165:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762856.992170:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcda lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.992191:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcda lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.994658:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcda lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.994669:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcda lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.994676:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.994681:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762856.994685:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.994691:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.994704:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcda lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.994709:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcda lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762856.994766:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140739328:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2673us (97724us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762856.994773:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:2.0:1789762856.994781:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261465116186 time 261465227933 state 0x2 ref 0 00000100:00100000:3.0:1789762856.996754:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762856.996800:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140739456 00000100:00100000:2.0:1789762856.996808:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140739456 00000100:00100000:2.0:1789762856.996858:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261465116186 time 261465227933 state 0x0 ref 1 00000100:00100000:2.0:1789762856.996868:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261565227933 time 261465227933 state 0x1 ref 1 00010000:00010000:2.0:1789762856.998917:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762857.092183:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261565227933 time 261565333080 state 0x0 ref 1 00000100:00100000:1.0:1789762857.092236:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140739456:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762857.092272:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fce1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789762857.092274:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762857.092289:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762857.092293:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762857.092298:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fce1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.092314:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fce1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.095289:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fce1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.095301:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fce1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.095312:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fce1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.095321:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762857.095327:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fce1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.095337:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fce1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.095364:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fce1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.095370:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fce1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762857.095420:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140739456:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3206us (98668us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762857.095426:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:1.0:1789762857.095433:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261565227933 time 261565333080 state 0x2 ref 0 00000100:00100000:3.0:1789762857.097512:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762857.097549:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140739584 00000100:00100000:1.0:1789762857.097557:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140739584 00000100:00100000:1.0:1789762857.097592:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261565227933 time 261565333080 state 0x0 ref 1 00000100:00100000:1.0:1789762857.097603:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261665333080 time 261565333080 state 0x1 ref 1 00000100:00100000:2.0:1789762857.192273:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261665333080 time 261665422810 state 0x0 ref 1 00000100:00100000:2.0:1789762857.192296:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140739584:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762857.192332:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fce8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.192346:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762857.192349:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762857.192353:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fce8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.192363:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fce8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.195269:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fce8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.195279:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fce8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.195286:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fce8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.195291:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762857.195295:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fce8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.195301:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fce8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.195313:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fce8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.195318:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fce8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762857.195364:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140739584:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3077us (97852us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762857.195371:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:2.0:1789762857.195385:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261665333080 time 261665422810 state 0x2 ref 0 00000100:00100000:3.0:1789762857.197272:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762857.197308:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140739712 00000100:00100000:2.0:1789762857.197315:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140739712 00000100:00100000:2.0:1789762857.197349:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261665333080 time 261665422810 state 0x0 ref 1 00000100:00100000:2.0:1789762857.197359:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261765422810 time 261665422810 state 0x1 ref 1 00000100:00100000:1.0:1789762857.292386:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261765422810 time 261765535765 state 0x0 ref 1 00000100:00100000:1.0:1789762857.292411:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140739712:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762857.292447:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcef lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.292461:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762857.292477:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762857.292482:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.292494:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.295153:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.295165:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.295173:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.295179:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762857.295182:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.295189:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.295203:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcef lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.295209:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcef lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762857.295274:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140739712:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2873us (98002us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762857.295282:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 228 00000100:00100000:1.0:1789762857.295290:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261765422810 time 261765535765 state 0x2 ref 0 00000100:00100000:3.0:1789762857.297487:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762857.297520:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140739840 00000100:00100000:1.0:1789762857.297528:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140739840 00000100:00100000:1.0:1789762857.297564:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261765422810 time 261765535765 state 0x0 ref 1 00000100:00100000:1.0:1789762857.297574:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261865535765 time 261765535765 state 0x1 ref 1 00000100:00100000:2.0:1789762857.392495:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261865535765 time 261865645743 state 0x0 ref 1 00000100:00100000:2.0:1789762857.392522:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140739840:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762857.392559:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcf6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.392573:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762857.392576:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762857.392581:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcf6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.392592:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcf6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.395117:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcf6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.395128:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcf6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.395142:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.395147:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762857.395151:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.395157:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.395169:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcf6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.395175:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fcf6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762857.395223:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140739840:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2713us (97737us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762857.395229:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:2.0:1789762857.395237:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261865535765 time 261865645743 state 0x2 ref 0 00000100:00100000:3.0:1789762857.397307:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762857.397342:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140739968 00000100:00100000:2.0:1789762857.397350:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140739968 00000100:00100000:2.0:1789762857.397384:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261865535765 time 261865645743 state 0x0 ref 1 00000100:00100000:2.0:1789762857.397405:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261965645743 time 261865645743 state 0x1 ref 1 00000100:00100000:1.0:1789762857.492568:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261965645743 time 261965721003 state 0x0 ref 1 00000100:00100000:1.0:1789762857.492589:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140739968:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762857.492623:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcfd lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.492636:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762857.492640:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762857.492644:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.492654:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.495292:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.495303:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcfd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.495313:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.495323:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762857.495328:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.495339:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.495358:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcfd lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.495364:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c56fcfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762857.495410:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140739968:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2829us (98104us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762857.495416:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 230 00000100:00100000:1.0:1789762857.495429:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261965645743 time 261965721003 state 0x2 ref 0 00000100:00100000:3.0:1789762857.497153:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762857.497184:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140740096 00000100:00100000:1.0:1789762857.497192:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140740096 00000100:00100000:1.0:1789762857.497228:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 261965645743 time 261965721003 state 0x0 ref 1 00000100:00100000:1.0:1789762857.497238:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 262065721003 time 261965721003 state 0x1 ref 1 00000100:00100000:2.0:1789762857.592663:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 262065721003 time 262065809345 state 0x0 ref 1 00000100:00100000:2.0:1789762857.592695:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140740096:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762857.592737:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fd04 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.592754:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762857.592758:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762857.592765:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fd04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.592782:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fd04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.595648:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fd04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.595660:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fd04 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.595669:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fd04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.595690:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762857.595694:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fd04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.595704:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fd04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.595723:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fd04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.595732:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c56fd04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762857.595788:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140740096:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3107us (98634us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762857.595798:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:2.0:1789762857.595808:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 262065721003 time 262065809345 state 0x2 ref 0 00000100:00100000:3.0:1789762857.616777:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762857.616866:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140740224 00000100:00100000:0.0:1789762857.616876:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140740224 00000100:00100000:0.0:1789762857.616932:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1789762857.616941:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+6:5571:x1876702140740224:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762857.616956:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762857.617003:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d293936/0xd08452c77c56fa48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8a6 expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762857.617038:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762857.617082:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+5:5571:x1876702140740224:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 142us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762857.617089:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1789762857.625898:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762857.625947:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140740352 00000100:00100000:2.0:1789762857.625958:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140740352 00000100:00080000:0.0:1789762857.626097:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762857.626133:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:2.0:1789762857.626144:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+9:11955:x1876702140740352:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1789762857.626161:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762857.626177:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fd0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e8ad expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.626240:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.626251:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.626261:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762857.626289:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 16384 00000004:00200000:2.0:1789762857.626291:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762857.626303:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.626321:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fd0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8ad expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.626333:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8ad expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.626339:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff95d15055df00) 00010000:00010000:2.0:1789762857.626341:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762857.626344:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9000, rc 0) 00000100:00100000:2.0:1789762857.626384:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+10:11955:x1876702140740352:12345-192.168.203.31@tcp:101:bash.0 Request processed in 244us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762857.626390:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:2.0:1789762857.630409:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762857.630468:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140740608 00000100:00100000:0.0:1789762857.630475:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140740608 00000100:00100000:0.0:1789762857.630513:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:0.0:1789762857.630522:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+10:12280:x1876702140740608:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:0.0:1789762857.630542:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762857.630559:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fd19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e8b4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762857.630615:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 16384 00010000:00010000:0.0:1789762857.630747:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fd19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8b4 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762857.630760:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:0.0:1789762857.630763:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789762857.630767:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fd19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8b4 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762857.630779:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15829a200, rc 0) 00000100:00100000:0.0:1789762857.630820:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+11:12280:x1876702140740608:12345-192.168.203.31@tcp:101:rm.0 Request processed in 300us (413us total) trans 4294967444 rc 301/301 00000100:00100000:0.0:1789762857.630867:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:3.0:1789762857.632235:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762857.632279:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140740736 00000100:00100000:1.0:1789762857.632285:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140740736 00000100:00100000:1.0:1789762857.632314:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:1.0:1789762857.632320:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15177e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+11:12280:x1876702140740736:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:1.0:1789762857.634161:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15177e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+11:12280:x1876702140740736:12345-192.168.203.31@tcp:37:rm.0 Request processed in 1838us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762857.634167:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:2.0:1789762857.635453:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762857.635521:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140740992 00000100:00100000:1.0:1789762857.635528:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140740992 00000100:00100000:1.0:1789762857.635573:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:1.0:1789762857.635584:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+11:12280:x1876702140740992:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:1.0:1789762857.635732:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+12:12280:x1876702140740992:12345-192.168.203.31@tcp:35:rm.0 Request processed in 149us (291us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1789762857.635740:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1789762857.637144:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762857.637181:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140741248 00000100:00100000:0.0:1789762857.637193:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140741248 00000100:00100000:0.0:1789762857.637224:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:0.0:1789762857.637231:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+12:12280:x1876702140741248:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:0.0:1789762857.637244:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762857.637256:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fd27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e8bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762857.637308:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829aa00/0xd08452c77c56fd2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762857.637318:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829aa00/0xd08452c77c56fd2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762857.637326:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829aa00/0xd08452c77c56fd2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762857.637333:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 16384 00010000:00010000:0.0:1789762857.637392:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fd27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8bb expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762857.637404:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829aa00/0xd08452c77c56fd2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8bb expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762857.637410:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff95d15055df00) 00010000:00010000:0.0:1789762857.637412:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789762857.637414:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15829aa00, rc 0) 00000100:00100000:0.0:1789762857.637470:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+14:12280:x1876702140741248:12345-192.168.203.31@tcp:101:rm.0 Request processed in 238us (327us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789762857.637478:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:3.0:1789762857.638613:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762857.638659:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140741376 00000100:00100000:0.0:1789762857.638666:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140741376 00000100:00100000:0.0:1789762857.638699:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:0.0:1789762857.638706:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+14:12280:x1876702140741376:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:0.0:1789762857.638749:0:13232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7614758912 avail 7603224576 00000100:00100000:0.0:1789762857.638788:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+14:12280:x1876702140741376:12345-192.168.203.31@tcp:41:rm.0 Request processed in 83us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762857.638793:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:2.0:1789762857.639902:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762857.639932:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140741632 00000100:00100000:2.0:1789762857.639937:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140741632 00000100:00100000:2.0:1789762857.639995:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1789762857.640008:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+14:12280:x1876702140741632:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:2.0:1789762857.640315:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+15:12280:x1876702140741632:12345-192.168.203.31@tcp:35:rm.0 Request processed in 311us (414us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1789762857.640322:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1789762857.641236:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762857.641263:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140741888 00000100:00100000:2.0:1789762857.641267:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140741888 00000100:00100000:2.0:1789762857.641299:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:2.0:1789762857.641308:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+15:12280:x1876702140741888:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762857.641336:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762857.641357:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97200/0xd08452c77c56fa3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e89f expref: 15 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.641372:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f97a00/0xd08452c77c56f74d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e898 expref: 14 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.641380:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff95d142a04b00) 00010000:00010000:2.0:1789762857.641392:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8ad expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.641399:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff95d15055df00) 00010000:00010000:2.0:1789762857.641401:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762857.641414:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56fd3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.641429:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56fd3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.641436:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56fd3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.641473:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56fd43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.641479:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56fd43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.641485:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56fd43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.641892:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fd4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.641900:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fd4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.641907:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fd4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762857.643385:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].11, 64 off8896 00000004:00080000:2.0:1789762857.643393:0:5813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 262116559098ns, next at 263116557491ns, rc = 0 00010000:00010000:2.0:1789762857.643443:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56fd51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643450:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56fd51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643466:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56fd51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643471:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56fd51 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643477:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56fd51 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643481:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56fd51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643500:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762857.643512:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fd4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643516:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fd4a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762857.643519:0:6671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762857.643521:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fd4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643529:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762857.643529:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56fd51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643534:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fd4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762857.643540:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762857.643544:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fd4a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762857.643546:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56fd51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643561:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff95d142a04500) 00010000:00010000:3.0:1789762857.643562:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56fd51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643568:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762857.643577:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fd4a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762857.643583:0:6671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff95d142a04500) 00010000:00010000:2.0:1789762857.643584:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fd4a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762857.643590:0:6671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789762857.643595:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56fd51 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762857.643601:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9200/0xd08452c77c56fd51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643605:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56fd3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643612:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56fd3c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643617:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56fd3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762857.643619:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762857.643623:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762857.643624:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762857.643629:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762857.643630:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56fd3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643637:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56fd3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643650:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff95d15055df00) 00010000:00010000:2.0:1789762857.643652:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762857.643656:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56fd3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.643663:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56fd3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762857.643678:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dc49936 reply state 000000004ff5d304 transno 4294967448 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56fd43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762857.643698:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762857.643748:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+14:12280:x1876702140741888:12345-192.168.203.31@tcp:36:rm.0 Request processed in 2442us (2513us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1789762857.643755:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 187 00010000:00010000:1.0:1789762857.644476:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56fd43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.644488:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56fd43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.644503:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56fd43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.644511:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762857.644515:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56fd43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.644521:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56fd43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.644531:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x4009f790 (ffff95d142a04300) 00010000:00010000:1.0:1789762857.644533:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762857.644536:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56fd43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762857.644540:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56fd43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762857.645146:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762857.645198:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140742144 00000100:00100000:2.0:1789762857.645205:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140742144 00000100:00100000:2.0:1789762857.645248:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:2.0:1789762857.645257:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+13:12280:x1876702140742144:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:2.0:1789762857.645410:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+14:12280:x1876702140742144:12345-192.168.203.31@tcp:35:rm.0 Request processed in 153us (268us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789762857.645418:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:2.0:1789762857.646164:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762857.646192:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140742400 00000100:00100000:2.0:1789762857.646197:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140742400 00000100:00100000:2.0:1789762857.646239:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:2.0:1789762857.646249:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+14:12280:x1876702140742400:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762857.646274:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762857.646288:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829aa00/0xd08452c77c56fd2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8bb expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.646310:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16002ac00/0xd08452c77c56f731 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e891 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.646325:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff95d15055df00) 00010000:00010000:2.0:1789762857.646340:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148f96e00/0xd08452c77c56f6cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e87c expref: 12 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.646361:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:2.0:1789762857.646369:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762857.646383:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd58 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.646391:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd58 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.646397:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd58 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.646425:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56fd5f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.646431:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56fd5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.646436:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56fd5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.646731:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56fd66 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.646739:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56fd66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.646746:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56fd66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762857.647408:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 16384 00010000:00010000:2.0:1789762857.647418:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56fd66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.647428:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56fd66 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.647434:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56fd66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.647438:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762857.647441:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56fd66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.647448:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56fd66 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.647461:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff95d142a04e00) 00010000:00010000:2.0:1789762857.647465:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762857.647469:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56fd66 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.647475:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8a00/0xd08452c77c56fd66 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.647495:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd58 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.647500:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd58 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.647504:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd58 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.647508:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762857.647517:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd58 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.647522:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd58 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.647530:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04c00) 00010000:00010000:2.0:1789762857.647532:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762857.647534:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd58 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.647539:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9000/0xd08452c77c56fd58 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762857.647548:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f99f4db reply state 00000000dfe39923 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56fd5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762857.647553:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762857.647592:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+13:12280:x1876702140742400:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1345us (1428us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789762857.647599:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 188 00000001:00080000:0.0:1789762857.648021:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967446 is committed 00010000:00010000:2.0:1789762857.648089:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56fd5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.648099:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56fd5f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.648107:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56fd5f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.648113:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762857.648116:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56fd5f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.648127:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56fd5f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.648134:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d142a04b00) 00010000:00010000:2.0:1789762857.648135:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762857.648138:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56fd5f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762857.648142:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8200/0xd08452c77c56fd5f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762858.022938:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789762858.476216:0:13399:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 262949380556ns, next at 263116557491ns, rc = 0 00000004:00080000:0.0:1789762858.484713:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000001:00080000:0.0:1789762858.484732:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967450 is committed 00000004:00080000:0.0:1789762858.484740:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000100:00100000:0.0:1789762858.484820:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789762858.484854:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149025792:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789762858.484913:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762858.484944:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149025792 00000100:00100000:1.0:1789762858.484952:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149025792 00000100:00080000:0.0:1789762858.484998:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762858.485026:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789762858.485038:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149025792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789762858.485063:0:8803:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:11 count 1 00002000:00010000:1.0:1789762858.485093:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 104857600, mtime: 0x6aad9d1f, atime: 0x0, ctime: 0x6aad9d1f, blocks: 0x3200d 00010000:00010000:1.0:1789762858.485102:0:8803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c56fd6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762858.485119:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=262s v=(0 0) 00010000:00010000:1.0:1789762858.485130:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762858.485136:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c56fd6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762858.485148:0:8803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c56fd6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762858.485156:0:8803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c56fd6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762858.485161:0:8803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c56fd6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762858.485175:0:8803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762858.485190:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762858.485197:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c56fd6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762858.485206:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762858.485210:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c56fd6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762858.485224:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c56fd6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762858.485239:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c56fd6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762858.485244:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c56fd6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762858.485258:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762858.485260:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762858.485261:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762858.485583:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149025792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 548us (669us total) trans 4294967673 rc 0/0 00000100:00100000:1.0:1789762858.485590:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:0.0:1789762858.485615:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d174126300/2, rc 0, transno 4294967673 00000100:00100000:0.0:1789762858.485628:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149025792:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789762858.485751:0:13399:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 262958915943ns, next at 249800095200ns, rc = 0 00000004:00080000:1.0:1789762858.486549:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00010000:00010000:2.0:1789762859.046954:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762859.686973:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789762859.687001:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149026304:0@lo:400:kworker.0 00000100:00100000:2.0:1789762859.687001:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d04271b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149026176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762859.687035:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149026432:0@lo:400:kworker.0 00000100:00100000:0.0:1789762859.687062:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149026048:0@lo:400:kworker.0 00000100:00100000:1.0:1789762859.687078:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762859.687085:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762859.687091:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762859.687127:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762859.687131:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149025920:0@lo:400:kworker.0 00000100:00100000:2.0:1789762859.687139:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149026688:0@lo:400:kworker.0 00000100:00100000:3.0:1789762859.687166:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149026304 00000100:00100000:0.0:1789762859.687167:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149026560:0@lo:400:kworker.0 00000100:00100000:1.0:1789762859.687171:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762859.687175:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149026304 00000100:00100000:2.0:1789762859.687184:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762859.687210:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762859.687230:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149026176 00000100:00100000:1.0:1789762859.687235:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149026176 00000100:00100000:3.0:1789762859.687240:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149026048 00000100:00100000:2.0:1789762859.687244:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149026432 00000100:00100000:3.0:1789762859.687244:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149026048 00000100:00100000:2.0:1789762859.687252:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149026432 00000100:00100000:3.0:1789762859.687276:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149026560 00000100:00100000:3.0:1789762859.687281:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149026560 00000100:00100000:0.0:1789762859.687282:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789762859.687285:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789762859.687298:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149026304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762859.687300:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149026176:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762859.687300:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149026688 00000100:00100000:2.0:1789762859.687308:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149026688 00000100:00100000:3.0:1789762859.687324:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789762859.687334:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149026048:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789762859.687343:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762859.687349:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789762859.687355:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149026304:12345-0@lo:400:kworker.0 Request processed in 63us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762859.687365:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789762859.687366:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149026432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762859.687383:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149026048:12345-0@lo:400:kworker.0 Request processed in 51us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762859.687391:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789762859.687402:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149026176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762859.687407:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789762859.687412:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149026560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762859.687418:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789762859.687432:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149026432:12345-0@lo:400:kworker.0 Request processed in 71us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762859.687443:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789762859.687448:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149025920 00000100:00100000:3.0:1789762859.687453:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149025920 00000100:00100000:1.0:1789762859.687458:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789762859.687459:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149026560:12345-0@lo:400:kworker.0 Request processed in 47us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762859.687467:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789762859.687471:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149026688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762859.687498:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789762859.687508:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149025920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762859.687519:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149026688:12345-0@lo:400:kworker.0 Request processed in 52us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762859.687528:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789762859.687528:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149026432:0@lo:400:kworker.0 00000100:00100000:0.0:1789762859.687535:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149026048:0@lo:400:kworker.0 00000100:00100000:0.0:1789762859.687565:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149026560:0@lo:400:kworker.0 00000100:00100000:1.0:1789762859.687574:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149026688:0@lo:400:kworker.0 00000100:00100000:3.0:1789762859.687577:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149025920:12345-0@lo:400:kworker.0 Request processed in 67us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762859.687588:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789762859.687597:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d04271b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149026176:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789762859.687602:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789762859.687609:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762859.687625:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149026304:0@lo:400:kworker.0 00000100:00100000:0.0:1789762859.687638:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149025920:0@lo:400:kworker.0 00000100:00100000:2.0:1789762859.892517:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762859.892556:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762859.892572:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140742528 00000100:00100000:3.0:1789762859.892582:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140742528 00000100:00100000:2.0:1789762859.892596:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762859.892620:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140742656 00000100:00100000:0.0:1789762859.892628:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140742656 00000100:00100000:2.0:1789762859.892634:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762859.892640:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 275 00000100:00100000:3.0:1789762859.892652:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140742528:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762859.892661:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140742912 00000100:00100000:1.0:1789762859.892668:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140742912 00000100:00100000:0.0:1789762859.892711:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:1.0:1789762859.892711:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140742784 00000100:00100000:2.0:1789762859.892712:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762859.892716:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140742784 00000100:00100000:3.0:1789762859.892722:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140742528:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 70us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762859.892729:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140742656:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762859.892747:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:3.0:1789762859.892747:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 275 00000100:00100000:1.0:1789762859.892760:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140742912:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762859.892783:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140742656:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 58us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762859.892792:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:1.0:1789762859.892800:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140742912:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762859.892808:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:3.0:1789762859.892810:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140743040 00000100:00100000:3.0:1789762859.892815:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140743040 00000100:00100000:1.0:1789762859.892829:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:1.0:1789762859.892866:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140742784:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:2.0:1789762859.892888:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762859.892889:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140742784:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 24us (259us total) trans 0 rc 0/0 00000100:00080000:2.0:1789762859.892897:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789762859.892902:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762859.892909:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:3.0:1789762859.892925:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:3.0:1789762859.892935:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140743040:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762859.893054:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140743040:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 120us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762859.893118:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 176 00010000:00010000:3.0:1789762860.071906:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762860.198957:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149026816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762860.199028:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762860.199059:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149026816 00000100:00100000:0.0:1789762860.199066:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149026816 00000100:00080000:2.0:1789762860.199108:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762860.199121:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789762860.199130:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149026816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762860.199159:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526581760 pending 0 free 3754950656 avail 3752853504 00000100:00100000:0.0:1789762860.199200:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149026816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762860.199206:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789762860.199231:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149026816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762861.095026:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762862.118959:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762863.142929:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789762863.304712:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967673 is committed 00010000:00010000:2.0:1789762864.166975:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762864.807009:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149027328:0@lo:400:kworker.0 00000100:00100000:3.0:1789762864.807022:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149026944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762864.807034:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149027200:0@lo:400:kworker.0 00000100:00100000:0.0:1789762864.807069:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149027072:0@lo:400:kworker.0 00000100:00100000:2.0:1789762864.807095:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762864.807095:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762864.807114:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762864.807136:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149026944 00000100:00100000:1.0:1789762864.807143:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149026944 00000100:00100000:0.0:1789762864.807173:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149027584:0@lo:400:kworker.0 00000100:00100000:3.0:1789762864.807175:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149027456:0@lo:400:kworker.0 00000100:00100000:2.0:1789762864.807192:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762864.807201:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789762864.807212:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149026944:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762864.807220:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762864.807223:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17463f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149027712:0@lo:400:kworker.0 00000100:00100000:3.0:1789762864.807224:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789762864.807246:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762864.807274:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762864.807281:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149027328 00000100:00100000:0.0:1789762864.807286:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149027328 00000100:00100000:3.0:1789762864.807286:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149027072 00000100:00100000:3.0:1789762864.807293:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149027072 00000100:00100000:1.0:1789762864.807302:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149026944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762864.807310:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789762864.807321:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149027200 00000100:00100000:2.0:1789762864.807326:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149027200 00000100:00100000:0.0:1789762864.807335:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149027584 00000100:00100000:3.0:1789762864.807340:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789762864.807341:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149027584 00000100:00100000:1.0:1789762864.807347:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789762864.807354:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149027072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762864.807360:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149027328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762864.807365:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789762864.807376:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149027200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762864.807389:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789762864.807403:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149027584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762864.807418:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149027072:12345-0@lo:400:kworker.0 Request processed in 65us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762864.807428:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789762864.807434:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149027328:12345-0@lo:400:kworker.0 Request processed in 79us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762864.807439:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149027200:12345-0@lo:400:kworker.0 Request processed in 64us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762864.807445:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789762864.807452:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789762864.807465:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149027584:12345-0@lo:400:kworker.0 Request processed in 64us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762864.807474:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:1.0:1789762864.807474:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762864.807475:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149027456 00000100:00100000:2.0:1789762864.807480:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149027712 00000100:00080000:1.0:1789762864.807481:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762864.807484:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149027712 00000100:00100000:3.0:1789762864.807491:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149027456 00000100:00100000:0.0:1789762864.807526:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149027072:0@lo:400:kworker.0 00000100:00100000:2.0:1789762864.807535:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1789762864.807536:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762864.807546:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149027712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762864.807550:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149027584:0@lo:400:kworker.0 00000100:00100000:3.0:1789762864.807556:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789762864.807567:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149027456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762864.807589:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149027712:12345-0@lo:400:kworker.0 Request processed in 45us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762864.807594:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789762864.807612:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149027456:12345-0@lo:400:kworker.0 Request processed in 47us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762864.807619:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789762864.807631:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149027328:0@lo:400:kworker.0 00000100:00100000:3.0:1789762864.807662:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149026944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762864.807665:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149027200:0@lo:400:kworker.0 00000100:00100000:3.0:1789762864.807680:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967673 gen 2 00000100:00100000:2.0:1789762864.807685:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17463f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149027712:0@lo:400:kworker.0 00000004:00080000:3.0:1789762864.807688:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d174126300, transno 4294967673 00000100:00100000:3.0:1789762864.807703:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149027456:0@lo:400:kworker.0 00000100:00100000:2.0:1789762865.012367:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762865.012415:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762865.012434:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140743168 00000100:00100000:1.0:1789762865.012445:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140743168 00000100:00100000:2.0:1789762865.012449:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762865.012461:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140743424 00000100:00100000:3.0:1789762865.012468:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140743424 00000100:00100000:1.0:1789762865.012500:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 277 00000100:00100000:1.0:1789762865.012511:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140743168:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762865.012529:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:0.0:1789762865.012540:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140743296 00000100:00100000:3.0:1789762865.012545:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140743424:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762865.012547:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140743296 00000100:00100000:1.0:1789762865.012584:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140743168:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 73us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762865.012587:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140743424:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 48us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762865.012598:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:1.0:1789762865.012605:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 277 00000100:00100000:3.0:1789762865.012605:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:0.0:1789762865.012610:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140743296:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762865.012648:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140743296:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 41us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762865.012656:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00080000:3.0:1789762865.012657:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762865.012675:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762865.014431:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762865.014453:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762865.014505:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140743552 00000100:00100000:0.0:1789762865.014509:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140743680 00000100:00100000:2.0:1789762865.014511:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140743552 00000100:00100000:0.0:1789762865.014515:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140743680 00000100:00080000:3.0:1789762865.014557:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762865.014563:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00080000:3.0:1789762865.014564:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762865.014570:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:2.0:1789762865.014578:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2341:x1876702140743552:12345-192.168.203.31@tcp:9:kworker.0 00000100:00100000:0.0:1789762865.014589:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140743680:12345-192.168.203.31@tcp:400:kworker.0 00000020:00000080:2.0:1789762865.014598:0:6656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd08452c77c56f54e 00000100:00080000:2.0:1789762865.014608:0:6656:0:(import.c:65:import_set_state_nolock()) ffff95d14722a000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789762865.014633:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140743680:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 47us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762865.014639:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 181 00010000:00010000:3.0:1789762865.014640:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789762865.014642:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967362 00000100:00100000:2.0:1789762865.014858:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+2:2341:x1876702140743552:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 285us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762865.014864:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 109 00010000:00010000:0.0:1789762865.191026:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762865.319123:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149027840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762865.319186:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762865.319227:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149027840 00000100:00100000:0.0:1789762865.319235:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149027840 00000100:00100000:0.0:1789762865.319277:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789762865.319286:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149027840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762865.319315:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526581760 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762865.319360:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149027840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762865.319366:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789762865.319408:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149027840:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762866.215045:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762867.238983:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789762867.887819:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:0.0:1789762867.887827:0:7606:0:(genops.c:885:class_export_put()) final put ffff95d147229000/77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:1.0:1789762867.887859:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d147229000/77777931-b235-4c03-82d2-4b1d12553008 for lustre-OST0001 00000020:00000080:1.0:1789762867.887921:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d14722a000 for lustre-OST0001 00010000:00010000:3.0:1789762868.262980:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762869.287062:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762869.927013:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789762869.927033:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17463c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149028352:0@lo:400:kworker.0 00000100:00100000:3.0:1789762869.927053:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17463f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149028480:0@lo:400:kworker.0 00000100:00100000:1.0:1789762869.927062:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17463e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149028224:0@lo:400:kworker.0 00000100:00100000:2.0:1789762869.927104:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762869.927108:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762869.927114:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17463dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149028096:0@lo:400:kworker.0 00000100:00100000:1.0:1789762869.927140:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149028352 00000100:00100000:1.0:1789762869.927148:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149028352 00000100:00100000:0.0:1789762869.927162:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762869.927168:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149027968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762869.927197:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762869.927206:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17463e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149028608:0@lo:400:kworker.0 00000100:00100000:1.0:1789762869.927206:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789762869.927218:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149028352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762869.927236:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149028480 00000100:00100000:2.0:1789762869.927247:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149028096 00000100:00100000:0.0:1789762869.927248:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762869.927253:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149028096 00000100:00100000:3.0:1789762869.927255:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149028480 00000100:00100000:1.0:1789762869.927281:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149028352:12345-0@lo:400:kworker.0 Request processed in 66us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762869.927289:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789762869.927293:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789762869.927303:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149028096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762869.927310:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762869.927311:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149028608 00000100:00100000:1.0:1789762869.927316:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149028608 00000100:00100000:0.0:1789762869.927337:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17463c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149028736:0@lo:400:kworker.0 00000100:00100000:1.0:1789762869.927345:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149028224 00000100:00100000:1.0:1789762869.927348:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149028224 00000100:00100000:2.0:1789762869.927352:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149028096:12345-0@lo:400:kworker.0 Request processed in 52us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.927360:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789762869.927370:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762869.927378:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789762869.927388:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149028608:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789762869.927394:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789762869.927401:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762869.927419:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789762869.927428:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149028224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762869.927434:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17463dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149028096:0@lo:400:kworker.0 00000100:00100000:3.0:1789762869.927437:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149028736 00000100:00100000:1.0:1789762869.927438:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149028608:12345-0@lo:400:kworker.0 Request processed in 51us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762869.927444:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149028736 00000100:00100000:2.0:1789762869.927454:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17463e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149028608:0@lo:400:kworker.0 00000100:00100000:1.0:1789762869.927457:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789762869.927490:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149028224:12345-0@lo:400:kworker.0 Request processed in 62us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762869.927494:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789762869.927499:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17463c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149028352:0@lo:400:kworker.0 00000100:00100000:0.0:1789762869.927505:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789762869.927510:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149028480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762869.927512:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789762869.927528:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149028736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762869.927542:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149027968 00000100:00100000:0.0:1789762869.927546:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17463e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149028224:0@lo:400:kworker.0 00000100:00100000:2.0:1789762869.927547:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149027968 00000100:00100000:3.0:1789762869.927567:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149028480:12345-0@lo:400:kworker.0 Request processed in 62us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762869.927574:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789762869.927584:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789762869.927592:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149027968:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762869.927602:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149028736:12345-0@lo:400:kworker.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00080000:3.0:1789762869.927603:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762869.927615:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00002000:00000024:2.0:1789762869.927617:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762869.927628:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17463c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149028736:0@lo:400:kworker.0 00000100:00100000:2.0:1789762869.927658:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149027968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.927672:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789762869.927713:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149027968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762869.927716:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17463f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149028480:0@lo:400:kworker.0 00000100:00100000:1.0:1789762870.132410:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762870.132467:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762870.132497:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762870.132517:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140743936 00000100:00100000:2.0:1789762870.132520:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140743808 00000100:00100000:2.0:1789762870.132529:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140743808 00000100:00100000:3.0:1789762870.132530:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140743936 00000100:00100000:1.0:1789762870.132536:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762870.132572:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140744192 00000100:00100000:1.0:1789762870.132577:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140744192 00000100:00100000:0.0:1789762870.132585:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140744064 00000100:00100000:2.0:1789762870.132585:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 279 00000100:00100000:0.0:1789762870.132594:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140744064 00000100:00100000:3.0:1789762870.132595:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:2.0:1789762870.132601:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140743808:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762870.132612:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140743936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762870.132631:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:1.0:1789762870.132645:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140744192:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762870.132649:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:0.0:1789762870.132664:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140744064:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762870.132674:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140743808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 73us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762870.132674:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140743936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 62us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762870.132692:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140744192:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 50us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762870.132693:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:2.0:1789762870.132694:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 279 00000100:00100000:0.0:1789762870.132706:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140744064:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762870.132713:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:0.0:1789762870.132718:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00080000:3.0:1789762870.132729:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762870.132734:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789762870.311031:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762870.439005:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149028864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762870.439068:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762870.439108:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149028864 00000100:00100000:0.0:1789762870.439117:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149028864 00000100:00100000:0.0:1789762870.439161:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789762870.439170:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149028864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762870.439201:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526581760 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762870.439245:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149028864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762870.439250:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789762870.439294:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149028864:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762871.334999:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762872.359003:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762873.383031:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762874.406998:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762875.046975:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789762875.046988:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789762875.046991:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149029120:0@lo:400:kworker.0 00000100:00100000:1.0:1789762875.046994:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17412e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149028992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762875.047004:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149029504:0@lo:400:kworker.0 00000100:00100000:0.0:1789762875.047023:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149029248:0@lo:400:kworker.0 00000100:00100000:2.0:1789762875.047076:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762875.047084:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762875.047089:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762875.047089:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762875.047132:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149029376:0@lo:400:kworker.0 00000100:00100000:0.0:1789762875.047134:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149029760:0@lo:400:kworker.0 00000100:00100000:2.0:1789762875.047140:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149029632:0@lo:400:kworker.0 00000100:00100000:1.0:1789762875.047145:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149028992 00000100:00100000:1.0:1789762875.047152:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149028992 00000100:00100000:3.0:1789762875.047169:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762875.047199:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762875.047200:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762875.047212:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789762875.047223:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149028992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762875.047223:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149029504 00000100:00100000:3.0:1789762875.047229:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149029504 00000100:00100000:0.0:1789762875.047248:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149029760 00000100:00100000:0.0:1789762875.047252:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149029760 00002000:00000024:1.0:1789762875.047257:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762875.047261:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149029248 00000100:00100000:2.0:1789762875.047268:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149029248 00000100:00100000:3.0:1789762875.047282:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789762875.047289:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789762875.047293:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149029504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762875.047305:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149028992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762875.047313:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149029760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762875.047313:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149029376 00000100:00100000:1.0:1789762875.047318:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789762875.047320:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149029376 00000100:00100000:3.0:1789762875.047344:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149029504:12345-0@lo:400:kworker.0 Request processed in 55us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762875.047352:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789762875.047356:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149029632 00000100:00100000:2.0:1789762875.047361:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149029632 00000100:00100000:0.0:1789762875.047365:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149029760:12345-0@lo:400:kworker.0 Request processed in 59us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762875.047374:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789762875.047379:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00080000:3.0:1789762875.047385:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762875.047391:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762875.047392:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149029248:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789762875.047395:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762875.047417:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789762875.047427:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789762875.047430:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149029376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762875.047432:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149029504:0@lo:400:kworker.0 00000100:00100000:1.0:1789762875.047435:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149029248:12345-0@lo:400:kworker.0 Request processed in 46us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762875.047443:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149029632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762875.047448:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789762875.047474:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149029120 00000100:00100000:3.0:1789762875.047477:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149029120 00000100:00100000:0.0:1789762875.047487:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149029376:12345-0@lo:400:kworker.0 Request processed in 61us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762875.047495:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789762875.047509:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149029632:12345-0@lo:400:kworker.0 Request processed in 63us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762875.047513:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789762875.047522:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789762875.047527:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149029120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762875.047537:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149029248:0@lo:400:kworker.0 00000100:00100000:0.0:1789762875.047551:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149029760:0@lo:400:kworker.0 00000100:00100000:3.0:1789762875.047569:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149029120:12345-0@lo:400:kworker.0 Request processed in 45us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762875.047577:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149029632:0@lo:400:kworker.0 00000100:00100000:3.0:1789762875.047578:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789762875.047589:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149029376:0@lo:400:kworker.0 00000100:00100000:2.0:1789762875.047600:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149029120:0@lo:400:kworker.0 00000100:00100000:0.0:1789762875.047635:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17412e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149028992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762875.252340:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762875.252375:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762875.252392:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762875.252421:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140744448 00000100:00100000:3.0:1789762875.252421:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140744320 00000100:00100000:0.0:1789762875.252428:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762875.252434:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140744448 00000100:00100000:3.0:1789762875.252434:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140744320 00000100:00100000:2.0:1789762875.252458:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140744704 00000100:00100000:2.0:1789762875.252465:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140744704 00000100:00100000:0.0:1789762875.252469:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140744576 00000100:00100000:0.0:1789762875.252475:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140744576 00000100:00100000:3.0:1789762875.252502:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 281 00000100:00100000:3.0:1789762875.252515:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140744320:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762875.252522:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:2.0:1789762875.252530:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:1.0:1789762875.252537:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140744448:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762875.252545:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140744704:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762875.252547:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:0.0:1789762875.252562:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140744576:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762875.252581:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140744320:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762875.252590:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140744448:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 56us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762875.252592:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140744704:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 53us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762875.252595:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 281 00000100:00100000:0.0:1789762875.252612:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140744576:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 52us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762875.252612:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:0.0:1789762875.252624:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:1.0:1789762875.252624:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00080000:3.0:1789762875.252656:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762875.252663:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789762875.431010:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762875.559065:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1747f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149029888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762875.559132:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762875.559172:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149029888 00000100:00100000:0.0:1789762875.559181:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149029888 00000100:00100000:0.0:1789762875.559232:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789762875.559240:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149029888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762875.559271:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526581760 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762875.559316:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149029888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762875.559321:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789762875.559361:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1747f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149029888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789762876.454945:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762876.927474:0:13916:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.31@tcp 00000100:00100000:0.0:1789762876.927493:0:13916:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:0.0:1789762876.927501:0:13916:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:0.0:1789762876.927509:0:13916:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.31@tcp 00000100:00100000:0.0:1789762876.927525:0:13916:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:0.0:1789762876.927531:0:13916:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d044015b00 rate 20 gen 0 00000100:00100000:0.0:1789762876.927536:0:13916:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:0.0:1789762876.927542:0:13916:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.31@tcp 00000100:00100000:0.0:1789762876.927556:0:13916:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:0.0:1789762876.927561:0:13916:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d044015d00 rate 20 gen 0 00000100:00100000:0.0:1789762876.927705:0:13916:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.31@tcp 00000100:00100000:0.0:1789762876.927719:0:13916:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:0.0:1789762876.927726:0:13916:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:0.0:1789762876.927730:0:13916:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.31@tcp 00000100:00100000:0.0:1789762876.927737:0:13916:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:0.0:1789762876.927741:0:13916:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d044015300 rate 10 gen 0 00000100:00100000:0.0:1789762876.927744:0:13916:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:0.0:1789762876.927756:0:13916:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.31@tcp 00000100:00100000:0.0:1789762876.927769:0:13916:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:0.0:1789762876.927774:0:13916:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d044015400 rate 10 gen 0 00000100:00100000:1.0:1789762876.938754:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762876.938794:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140744832 00000100:00100000:3.0:1789762876.938804:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140744832 00000100:00100000:3.0:1789762876.938894:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:3.0:1789762876.938905:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+5:12773:x1876702140744832:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:3.0:1789762876.938924:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762876.938942:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fec00/0xd08452c77c56fd74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e8c2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.939014:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56fd7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.939029:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56fd7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.939044:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56fd7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762876.939085:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789762876.939089:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762876.939110:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56fd7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.939145:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fec00/0xd08452c77c56fd74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8c2 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.939166:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56fd7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8c2 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.939175:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d000) 00010000:00010000:3.0:1789762876.939179:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762876.939182:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747fe000, rc 0) 00000100:00100000:3.0:1789762876.939246:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+6:12773:x1876702140744832:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 345us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762876.939257:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:2.0:1789762876.940202:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762876.940236:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140745088 00000100:00100000:2.0:1789762876.940242:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140745088 00000100:00100000:2.0:1789762876.940278:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:2.0:1789762876.940288:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+6:12773:x1876702140745088:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:2.0:1789762876.940323:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762876.940340:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe000/0xd08452c77c56fd7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8c2 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.940355:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d000) 00010000:00010000:2.0:1789762876.940371:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762876.940556:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56fd82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.940567:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56fd82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.940578:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56fd82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.940594:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56fd89 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.940604:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56fd89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.940611:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56fd89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762876.941500:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00010000:00010000:2.0:1789762876.941510:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56fd82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.941519:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56fd82 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.941527:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56fd82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.941534:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762876.941539:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56fd82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.941553:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56fd82 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.941564:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04e00) 00010000:00010000:2.0:1789762876.941567:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762876.941571:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56fd82 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.941578:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56fd82 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762876.941593:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea363114 reply state 00000000ad8cb8aa transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56fd89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762876.941603:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762876.941649:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+7:12773:x1876702140745088:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 1361us (1450us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1789762876.941657:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 190 00010000:00010000:1.0:1789762876.942102:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56fd89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.942112:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56fd89 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.942120:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56fd89 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.942127:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762876.942131:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56fd89 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.942139:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56fd89 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.942149:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d142a04800) 00010000:00010000:1.0:1789762876.942160:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762876.942164:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56fd89 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.942171:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8800/0xd08452c77c56fd89 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762876.946732:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762876.946825:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140745216 00000100:00100000:3.0:1789762876.946864:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140745216 00000100:00100000:3.0:1789762876.946912:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:3.0:1789762876.946920:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+6:12774:x1876702140745216:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762876.946935:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762876.946950:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fec00/0xd08452c77c56fd90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e8c9 expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.946990:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fd97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.947001:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fd97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.947012:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fd97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762876.947038:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789762876.947044:0:13232:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762876.947061:0:13232:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fd97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.947083:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fec00/0xd08452c77c56fd90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8c9 expref: 8 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.947099:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fd97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8c9 expref: 7 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.947120:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d900) 00010000:00010000:3.0:1789762876.947122:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762876.947125:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747fe600, rc 0) 00000100:00100000:3.0:1789762876.947167:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+7:12774:x1876702140745216:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 248us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762876.947172:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:0.0:1789762876.948206:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762876.948246:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140745472 00000100:00100000:3.0:1789762876.948251:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140745472 00000100:00100000:3.0:1789762876.948281:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:3.0:1789762876.948288:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+7:12774:x1876702140745472:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762876.948296:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762876.948298:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789762876.948312:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fd97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8c9 expref: 7 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948323:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d900) 00010000:00010000:3.0:1789762876.948330:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762876.948338:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fd9e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e8d0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948427:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fda5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948434:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948440:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948457:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948463:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948472:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948538:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fdb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948545:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948550:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762876.948556:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00010000:00010000:3.0:1789762876.948565:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948570:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fdb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948574:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fdb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948579:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747ff800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762876.948581:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fdb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948595:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fdb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948604:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055d600) 00010000:00010000:3.0:1789762876.948606:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762876.948608:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fdb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948612:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fdb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948624:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948629:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fda5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948632:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fda5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948636:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747ff000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762876.948638:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fda5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948643:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fda5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948647:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055dc00) 00010000:00010000:3.0:1789762876.948649:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762876.948651:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fda5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948663:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fda5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948671:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948675:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948679:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948683:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fee00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762876.948685:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948689:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948693:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055df00) 00010000:00010000:3.0:1789762876.948695:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762876.948697:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948701:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948718:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fd9e lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8d0 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948734:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055dc00) 00010000:00010000:3.0:1789762876.948736:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762876.948739:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fd9e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8d0 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.948750:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747ffa00, rc 0) 00000100:00100000:3.0:1789762876.948779:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+6:12774:x1876702140745472:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 493us (577us total) trans 0 rc 301/301 00000100:00100000:3.0:1789762876.948784:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:1.0:1789762876.949504:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762876.949541:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140745600 00000100:00100000:2.0:1789762876.949547:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140745600 00000100:00100000:2.0:1789762876.949586:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:2.0:1789762876.949597:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+6:12774:x1876702140745600:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762876.949608:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762876.949622:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56fdba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e8d7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.949650:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fdc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.949666:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.949672:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762876.949687:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762876.949689:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762876.949698:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.949711:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56fdba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8d7 expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.949721:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fdc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8d7 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762876.949726:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04e00) 00010000:00010000:2.0:1789762876.949729:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762876.949731:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a8e00, rc 0) 00000100:00100000:2.0:1789762876.949765:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+7:12774:x1876702140745600:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 169us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762876.949773:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:2.0:1789762876.950519:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762876.950551:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140745856 00000100:00100000:0.0:1789762876.950557:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140745856 00000100:00100000:0.0:1789762876.950589:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:0.0:1789762876.950596:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+7:12774:x1876702140745856:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789762876.950604:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762876.950614:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829aa00/0xd08452c77c56fdc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e8de expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950645:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fdcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950653:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fdcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950659:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fdcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950668:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fdd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950674:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950679:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762876.950724:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00010000:00010000:0.0:1789762876.950797:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fdcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950803:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fdcf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950808:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fdcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950811:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829bc00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762876.950814:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fdcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950818:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fdcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950824:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04e00) 00010000:00010000:0.0:1789762876.950826:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762876.950829:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fdcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950869:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fdcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950882:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950887:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fdd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950892:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fdd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950904:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762876.950907:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fdd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950912:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fdd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950919:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d151e90b00) 00010000:00010000:0.0:1789762876.950921:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762876.950923:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fdd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950927:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fdd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950953:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829aa00/0xd08452c77c56fdc8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8de expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950959:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04e00) 00010000:00010000:0.0:1789762876.950961:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789762876.950964:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829aa00/0xd08452c77c56fdc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8de expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.950970:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15829aa00, rc 0) 00000100:00100000:0.0:1789762876.951001:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+8:12774:x1876702140745856:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 406us (482us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1789762876.951008:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:1.0:1789762876.951709:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762876.951774:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140746112 00000100:00100000:0.0:1789762876.951786:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140746112 00000100:00100000:0.0:1789762876.951818:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:0.0:1789762876.951824:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+8:12774:x1876702140746112:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:0.0:1789762876.951899:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fde4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.951908:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fde4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.951914:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fde4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762876.952029:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2ecc621 reply state 000000005f5c578c transno 4294967453 ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fde4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762876.952037:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789762876.952041:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00000100:00100000:0.0:1789762876.952083:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+10:12774:x1876702140746112:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 260us (376us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1789762876.952089:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 195 00010000:00010000:3.0:1789762876.952536:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fde4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.952543:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fde4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.952548:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fde4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.952554:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762876.952558:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fde4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.952565:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fde4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.952576:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d151e90c00) 00010000:00010000:3.0:1789762876.952580:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789762876.952583:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fde4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.952647:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a200/0xd08452c77c56fde4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762876.952704:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762876.952771:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140746368 00000100:00100000:0.0:1789762876.952776:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140746368 00000100:00100000:0.0:1789762876.952813:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1789762876.952822:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+9:12774:x1876702140746368:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1789762876.952976:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+10:12774:x1876702140746368:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 156us (273us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789762876.952982:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:2.0:1789762876.956825:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762876.956893:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140746496 00000100:00100000:3.0:1789762876.956899:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140746496 00000100:00100000:3.0:1789762876.956935:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:3.0:1789762876.956943:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+10:12775:x1876702140746496:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:3.0:1789762876.956955:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762876.956966:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fdeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e8e5 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957001:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdf2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957009:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957015:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957028:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fdf9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957033:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957038:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957089:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957103:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957108:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762876.957125:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00000004:00200000:3.0:1789762876.957127:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762876.957137:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957144:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957149:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdf2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957153:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957157:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fee00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762876.957161:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957165:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdf2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957172:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04e00) 00010000:00010000:3.0:1789762876.957174:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762876.957176:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957190:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fdf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957200:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957204:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fdf9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957208:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957212:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747ff000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762876.957214:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957218:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fdf9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957223:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055dc00) 00010000:00010000:3.0:1789762876.957225:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762876.957226:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fdf9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957230:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fdf9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957249:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fdeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8e5 expref: 12 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957259:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8e5 expref: 11 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.957271:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055df00) 00010000:00010000:3.0:1789762876.957272:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762876.957274:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747ff800, rc 0) 00000100:00100000:3.0:1789762876.957306:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+11:12775:x1876702140746496:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 366us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762876.957311:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:1.0:1789762876.958140:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762876.958173:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140746752 00000100:00100000:3.0:1789762876.958178:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140746752 00000100:00100000:3.0:1789762876.958207:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:3.0:1789762876.958214:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+11:12775:x1876702140746752:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:3.0:1789762876.958235:0:13232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762876.958253:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8e5 expref: 11 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.958263:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055df00) 00010000:00010000:3.0:1789762876.958268:0:13232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762876.958282:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fe07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.958289:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fe07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.958295:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fe07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762876.958405:0:13232:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062f78818 reply state 00000000b106e15d transno 4294967455 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fe07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762876.958421:0:13232:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762876.958425:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00000100:00100000:3.0:1789762876.958465:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+12:12775:x1876702140746752:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 250us (324us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789762876.958473:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 197 00010000:00010000:3.0:1789762876.958990:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fe07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.958997:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fe07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.959001:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fe07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.959005:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fe600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762876.959008:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fe07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.959013:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fe07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.959020:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055d600) 00010000:00010000:3.0:1789762876.959022:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789762876.959025:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fe07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.959029:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fe07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762876.970053:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762876.970141:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140746880 00000100:00100000:3.0:1789762876.970154:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140746880 00000100:00100000:3.0:1789762876.970201:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:3.0:1789762876.970214:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+11:12779:x1876702140746880:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762876.970232:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762876.970249:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fe0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e8ec expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970299:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970310:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970318:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970332:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fe1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970337:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fe1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970342:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fe1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970418:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fe23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970424:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970430:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762876.970459:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00000004:00200000:3.0:1789762876.970461:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762876.970478:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970490:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970498:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970506:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970513:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747ff800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762876.970518:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970526:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970537:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04e00) 00010000:00010000:3.0:1789762876.970539:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762876.970543:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970547:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff800/0xd08452c77c56fe15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970555:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fe1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970569:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fe1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970574:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fe1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970578:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747ffa00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762876.970580:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fe1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970585:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fe1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970590:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055d600) 00010000:00010000:3.0:1789762876.970592:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762876.970594:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fe1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970598:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fe1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970621:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fe600/0xd08452c77c56fe0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8ec expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970632:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fe23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8ec expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.970638:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055df00) 00010000:00010000:3.0:1789762876.970640:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789762876.970648:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747ff000, rc 0) 00000100:00100000:3.0:1789762876.970694:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+12:12779:x1876702140746880:12345-192.168.203.31@tcp:101:dd.0 Request processed in 485us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762876.970700:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:1.0:1789762876.971626:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762876.971653:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140747136 00000100:00100000:1.0:1789762876.971658:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140747136 00000100:00100000:1.0:1789762876.971696:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:1.0:1789762876.971707:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+12:12779:x1876702140747136:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762876.971718:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762876.971729:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56fe2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e8f3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.971804:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56fe31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.971817:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56fe31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.971828:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56fe31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.971899:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56fe38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.971908:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56fe38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.971916:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56fe38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789762876.972505:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc:0x0], index 0: 0 00000004:00080000:1.0:1789762876.972517:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8:0x0], index 1: 0 00010000:00010000:1.0:1789762876.972669:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c56fe3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.972677:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c56fe3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.972683:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c56fe3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.972705:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56fe31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.972710:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56fe31 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.972714:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56fe31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.972718:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fa00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762876.972720:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56fe31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.972731:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56fe31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.972738:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055df00) 00010000:00010000:1.0:1789762876.972741:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762876.972743:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56fe31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.972748:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c56fe31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762876.972755:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f4a4f33 reply state 000000006782f2d7 transno 4294967456 ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56fe38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762876.972761:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789762876.972780:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56fe2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8f3 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.972788:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c56fe3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8f3 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.972794:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:1.0:1789762876.972796:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762876.972798:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003e000, rc 0) 00000100:00100000:1.0:1789762876.972864:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+15:12779:x1876702140747136:12345-192.168.203.31@tcp:101:dd.0 Request processed in 1127us (1206us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789762876.972873:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 199 00010000:00010000:3.0:1789762876.973405:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56fe38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.973414:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56fe38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.973419:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56fe38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.973422:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ea00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762876.973425:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56fe38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.973430:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56fe38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.973437:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0xf4d4877e (ffff95d14abf2100) 00010000:00010000:3.0:1789762876.973439:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762876.973442:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56fe38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.973446:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ea00/0xd08452c77c56fe38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762876.975254:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762876.975318:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140747264 00000100:00100000:3.0:1789762876.975325:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140747264 00000100:00100000:3.0:1789762876.975369:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:3.0:1789762876.975377:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:12779:x1876702140747264:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762876.975397:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762876.975414:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c56fe4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e8fa expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762876.975439:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789762876.975458:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789762876.975463:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762876.975474:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c56fe4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8fa expref: 6 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.975493:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c56fe4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8fa expref: 6 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762876.975502:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747fee00, rc 0) 00000100:00100000:3.0:1789762876.975537:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+6:12779:x1876702140747264:12345-192.168.203.31@tcp:101:dd.0 Request processed in 162us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762876.975544:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:2.0:1789762876.982559:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762876.982593:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140747392 00000100:00100000:0.0:1789762876.982601:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140747392 00002000:00100000:0.0:1789762876.982648:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc:0x0] (0->1048575) req@ffff95d17412ea00 x1876702140747392/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:657/0 lens 488/0 e 0 to 0 dl 1789762887 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762876.982661:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412ea00 with x1876702140747392 ext(0->1048575) 00002000:00010000:0.0:1789762876.982667:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17412ea00 00000100:00100000:0.0:1789762876.982683:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246683024075 time 246685105421 state 0x0 ref 1 00000100:00100000:0.0:1789762876.982689:0:6661:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x2, head sequence 5: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246683024075 time 246685105421 state 0x0 ref 1 00000100:00100000:0.0:1789762876.982705:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 3 deadline 281505864727 time 281455864727 state 0x1 ref 1 00000100:00100000:0.0:1789762876.982726:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 2 deadline 281505864727 time 281455888709 state 0x0 ref 1 00000100:00100000:0.0:1789762876.982737:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140747392:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762876.988470:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140747392:12345-192.168.203.31@tcp:4:dd.0 Request processed in 5727us (5907us total) trans 4294967674 rc 0/0 00000100:00100000:0.0:1789762876.988481:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 232 00000100:00100000:0.0:1789762876.988491:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 2 deadline 281505864727 time 281455888709 state 0x2 ref 0 00002000:00100000:0.0:1789762876.988506:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc:0x0] (0->1048575) req@ffff95d17412ea00 x1876702140747392/t4294967674(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:657/0 lens 488/448 e 0 to 0 dl 1789762887 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762876.988516:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412ea00 with x1876702140747392 ext(0->1048575) 00002000:00010000:0.0:1789762876.988523:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17412ea00 00000100:00100000:2.0:1789762876.989040:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762876.989089:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140747520 00000100:00100000:1.0:1789762876.989102:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140747520 00002000:00100000:1.0:1789762876.989128:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc:0x0] (1048576->2097151) req@ffff95d17412c700 x1876702140747520/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:657/0 lens 488/0 e 0 to 0 dl 1789762887 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762876.989136:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412c700 with x1876702140747520 ext(1048576->2097151) 00002000:00010000:1.0:1789762876.989138:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17412c700 00000100:00100000:1.0:1789762876.989148:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 2 deadline 281505864727 time 281455888709 state 0x0 ref 1 00000100:00100000:1.0:1789762876.989157:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 2 deadline 281505888709 time 281455888709 state 0x1 ref 1 00000100:00100000:1.0:1789762876.989182:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 1 deadline 281505888709 time 281462343037 state 0x0 ref 1 00000100:00100000:1.0:1789762876.989195:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140747520:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762876.991491:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+10:2344:x1876702140747520:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2296us (2449us total) trans 4294967675 rc 0/0 00000100:00100000:3.0:1789762876.991498:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:3.0:1789762876.991504:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 1 deadline 281505888709 time 281462343037 state 0x2 ref 0 00002000:00100000:3.0:1789762876.991512:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc:0x0] (1048576->2097151) req@ffff95d17412c700 x1876702140747520/t4294967675(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:657/0 lens 488/448 e 0 to 0 dl 1789762887 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762876.991519:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412c700 with x1876702140747520 ext(1048576->2097151) 00002000:00010000:3.0:1789762876.991528:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17412c700 00000100:00100000:2.0:1789762876.997074:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762876.997112:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140747648 00000100:00100000:3.0:1789762876.997119:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140747648 00002000:00100000:3.0:1789762876.997148:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc:0x0] (2097152->3145727) req@ffff95d17412e300 x1876702140747648/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:657/0 lens 488/0 e 0 to 0 dl 1789762887 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762876.997156:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412e300 with x1876702140747648 ext(2097152->3145727) 00002000:00010000:3.0:1789762876.997159:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17412e300 00000100:00100000:3.0:1789762876.997169:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 1 deadline 281505888709 time 281462343037 state 0x0 ref 1 00000100:00100000:3.0:1789762876.997177:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 1 deadline 281512343037 time 281462343037 state 0x1 ref 1 00000100:00100000:3.0:1789762876.997197:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281512343037 time 281470359775 state 0x0 ref 1 00000100:00100000:3.0:1789762876.997206:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+10:2345:x1876702140747648:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762876.999587:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140747648:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2379us (2513us total) trans 4294967676 rc 0/0 00000100:00100000:3.0:1789762876.999596:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:3.0:1789762876.999603:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281512343037 time 281470359775 state 0x2 ref 0 00002000:00100000:3.0:1789762876.999612:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc:0x0] (2097152->3145727) req@ffff95d17412e300 x1876702140747648/t4294967676(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:657/0 lens 488/448 e 0 to 0 dl 1789762887 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762876.999619:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17412e300 with x1876702140747648 ext(2097152->3145727) 00002000:00010000:3.0:1789762876.999622:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17412e300 00000100:00100000:1.0:1789762877.003959:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762877.003997:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140747776 00000100:00100000:2.0:1789762877.004005:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140747776 00002000:00100000:2.0:1789762877.004042:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc:0x0] (3145728->4194303) req@ffff95d16ffe5c00 x1876702140747776/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762877.004052:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe5c00 with x1876702140747776 ext(3145728->4194303) 00002000:00010000:2.0:1789762877.004057:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffe5c00 00000100:00080000:3.0:1789762877.004061:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762877.004074:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281512343037 time 281470359775 state 0x0 ref 1 00000100:00100000:2.0:1789762877.004090:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281520359775 time 281470359775 state 0x1 ref 1 00000100:00100000:1.0:1789762877.004124:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762877.004153:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140747904 00000100:00100000:2.0:1789762877.004158:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140747904 00000100:00100000:2.0:1789762877.004185:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:2.0:1789762877.004191:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1876702140747904:12345-192.168.203.31@tcp:8:dd.0 00010000:00080000:2.0:1789762877.004213:0:6656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:2.0:1789762877.004235:0:6656:0:(genops.c:1385:class_connect()) connect: client 77777931-b235-4c03-82d2-4b1d12553008, cookie 0xd08452c77c56fe54 00002000:00100000:2.0:1789762877.004245:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 77777931-b235-4c03-82d2-4b1d12553008/ffff95d147228000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 30670848 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789762877.004260:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789762877.004417:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789762877.004438:0:6656:0:(import.c:65:import_set_state_nolock()) ffff95d14722e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789762877.004475:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2341:x1876702140747904:12345-192.168.203.31@tcp:8:dd.0 Request processed in 283us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762877.004484:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:1.0:1789762877.005150:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762877.005186:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140748032 00000100:00100000:2.0:1789762877.005190:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140748032 00000100:00080000:3.0:1789762877.005230:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762877.005231:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:2.0:1789762877.005244:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+6:12779:x1876702140748032:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762877.005255:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762877.005273:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000006b4858/0xd08452c77c56fe5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e901 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762877.005296:0:10283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789762877.005309:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=281s v=(0 0) 00010000:00010000:2.0:1789762877.005313:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762877.005321:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000006b4858/0xd08452c77c56fe5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e901 expref: 7 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762877.005340:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000006b4858/0xd08452c77c56fe5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e901 expref: 7 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762877.005353:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9200, rc 0) 00000100:00100000:2.0:1789762877.005385:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+7:12779:x1876702140748032:12345-192.168.203.31@tcp:101:dd.0 Request processed in 143us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762877.005393:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:1.0:1789762877.012371:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762877.012426:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140748160 00000100:00100000:2.0:1789762877.012432:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140748160 00002000:00100000:2.0:1789762877.012454:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (0->1048575) req@ffff95d16ffe7480 x1876702140748160/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762877.012462:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe7480 with x1876702140748160 ext(0->1048575) 00002000:00010000:2.0:1789762877.012465:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe7480 00000100:00100000:2.0:1789762877.012476:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281520359775 time 281470359775 state 0x1 ref 2 00000100:00100000:1.0:1789762877.019381:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762877.019435:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140748288 00000100:00100000:2.0:1789762877.019441:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140748288 00002000:00100000:2.0:1789762877.019463:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (1048576->2097151) req@ffff95d16ffe6300 x1876702140748288/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762877.019471:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe6300 with x1876702140748288 ext(1048576->2097151) 00002000:00010000:2.0:1789762877.019475:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe6300 00000100:00100000:2.0:1789762877.019485:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281520359775 time 281470359775 state 0x1 ref 3 00000100:00100000:2.0:1789762877.047289:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281570439714 time 281520439714 state 0x1 ref 3 00000100:00100000:2.0:1789762877.047310:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+12:2344:x1876702140747776:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762877.050307:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+14:2344:x1876702140747776:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3000us (46345us total) trans 4294967677 rc 0/0 00000100:00100000:3.0:1789762877.050317:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 235 00002000:00100000:3.0:1789762877.050345:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc:0x0] (3145728->4194303) req@ffff95d16ffe5c00 x1876702140747776/t4294967677(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.050356:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe5c00 with x1876702140747776 ext(3145728->4194303) 00002000:00010000:3.0:1789762877.050364:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffe5c00 00000100:00100000:0.0:1789762877.097337:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281620492310 time 281570492310 state 0x1 ref 2 00000100:00100000:0.0:1789762877.097369:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140748160:12345-192.168.203.31@tcp:4:dd.0 00000001:00100000:1.0:1789762877.110373:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000001:00080000:1.0:1789762877.125618:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967363 is committed 00000100:00100000:2.0:1789762877.125758:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140748160:12345-192.168.203.31@tcp:4:dd.0 Request processed in 28382us (113377us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789762877.125795:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 236 00002000:00100000:2.0:1789762877.125815:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->1048575) req@ffff95d16ffe7480 x1876702140748160/t4294967363(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762877.125873:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe7480 with x1876702140748160 ext(0->1048575) 00002000:00010000:2.0:1789762877.125880:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe7480 00000100:00100000:2.0:1789762877.128711:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762877.128787:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140748416 00000100:00100000:1.0:1789762877.128815:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140748416 00002000:00100000:1.0:1789762877.128896:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2097152->3145727) req@ffff95d042630e00 x1876702140748416/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762877.128908:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042630e00 with x1876702140748416 ext(2097152->3145727) 00002000:00010000:1.0:1789762877.128913:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042630e00 00000100:00100000:1.0:1789762877.128945:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281620492310 time 281570492310 state 0x1 ref 2 00000100:00100000:1.0:1789762877.140388:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762877.140435:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140748544 00000100:00100000:2.0:1789762877.140441:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140748544 00002000:00100000:2.0:1789762877.140463:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3145728->4194303) req@ffff95d16ffe4380 x1876702140748544/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762877.140482:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe4380 with x1876702140748544 ext(3145728->4194303) 00002000:00010000:2.0:1789762877.140485:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe4380 00000100:00100000:2.0:1789762877.140495:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281620492310 time 281570492310 state 0x1 ref 3 00000100:00100000:3.0:1789762877.147433:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281670586081 time 281620586081 state 0x1 ref 3 00000100:00100000:3.0:1789762877.147453:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140748288:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762877.148086:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762877.148166:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140748672 00000100:00100000:0.0:1789762877.148175:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140748672 00002000:00100000:0.0:1789762877.148211:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc:0x0] (4194304->5242879) req@ffff95d173ce8e00 x1876702140748672/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762877.148226:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173ce8e00 with x1876702140748672 ext(4194304->5242879) 00002000:00010000:0.0:1789762877.148233:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d173ce8e00 00000100:00100000:0.0:1789762877.148252:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281670586081 time 281620586081 state 0x1 ref 4 00000100:00100000:3.0:1789762877.151617:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+10:2345:x1876702140748288:12345-192.168.203.31@tcp:4:dd.0 Request processed in 4165us (132234us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789762877.151630:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 237 00002000:00100000:3.0:1789762877.151641:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x8:0x0] (1048576->2097151) req@ffff95d16ffe6300 x1876702140748288/t4294967364(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.151671:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe6300 with x1876702140748288 ext(1048576->2097151) 00002000:00010000:3.0:1789762877.151678:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe6300 00000100:00100000:1.0:1789762877.159358:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.159397:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140748800 00000100:00100000:3.0:1789762877.159403:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140748800 00002000:00100000:3.0:1789762877.159428:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc:0x0] (5242880->6291455) req@ffff95d16ffe7100 x1876702140748800/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.159436:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe7100 with x1876702140748800 ext(5242880->6291455) 00002000:00010000:3.0:1789762877.159455:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffe7100 00000100:00100000:3.0:1789762877.159475:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281670586081 time 281620586081 state 0x1 ref 4 00000100:00100000:2.0:1789762877.167456:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.167551:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140748928 00000100:00100000:3.0:1789762877.167558:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140748928 00002000:00100000:3.0:1789762877.167586:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc:0x0] (6291456->7340031) req@ffff95d173ce9500 x1876702140748928/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.167597:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173ce9500 with x1876702140748928 ext(6291456->7340031) 00002000:00010000:3.0:1789762877.167602:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d173ce9500 00000100:00100000:3.0:1789762877.167616:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281670586081 time 281620586081 state 0x1 ref 5 00000100:00100000:2.0:1789762877.175373:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762877.175457:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140749056 00000100:00100000:1.0:1789762877.175463:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140749056 00002000:00100000:1.0:1789762877.175493:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc:0x0] (7340032->8388607) req@ffff95d173ce8000 x1876702140749056/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762877.175513:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173ce8000 with x1876702140749056 ext(7340032->8388607) 00002000:00010000:1.0:1789762877.175519:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d173ce8000 00000100:00100000:1.0:1789762877.175536:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281670586081 time 281620586081 state 0x1 ref 6 00000100:00100000:1.0:1789762877.183928:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.184029:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140749184 00000100:00100000:3.0:1789762877.184038:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140749184 00002000:00100000:3.0:1789762877.184075:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x8:0x0] (4194304->5242879) req@ffff95d16ffe6a00 x1876702140749184/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.184088:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe6a00 with x1876702140749184 ext(4194304->5242879) 00002000:00010000:3.0:1789762877.184093:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe6a00 00000100:00100000:3.0:1789762877.184111:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281670586081 time 281620586081 state 0x1 ref 7 00000100:00100000:2.0:1789762877.191134:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.191206:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140749312 00000100:00100000:3.0:1789762877.191212:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140749312 00002000:00100000:3.0:1789762877.191237:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (5242880->6291455) req@ffff95d173cea680 x1876702140749312/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.191265:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173cea680 with x1876702140749312 ext(5242880->6291455) 00002000:00010000:3.0:1789762877.191272:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d173cea680 00000100:00100000:3.0:1789762877.191293:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281670586081 time 281620586081 state 0x1 ref 8 00000100:00100000:1.0:1789762877.197527:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281720684660 time 281670684660 state 0x1 ref 8 00000100:00100000:1.0:1789762877.197541:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+11:2345:x1876702140748416:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762877.200740:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+13:2345:x1876702140748416:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3181us (72012us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789762877.200751:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 238 00002000:00100000:3.0:1789762877.200762:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2097152->3145727) req@ffff95d042630e00 x1876702140748416/t4294967365(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.200771:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042630e00 with x1876702140748416 ext(2097152->3145727) 00002000:00010000:3.0:1789762877.200776:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042630e00 00000100:00100000:1.0:1789762877.202961:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.203017:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140749440 00000100:00100000:3.0:1789762877.203024:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140749440 00002000:00100000:3.0:1789762877.203048:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x8:0x0] (6291456->7340031) req@ffff95d16ffe4e00 x1876702140749440/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.203056:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe4e00 with x1876702140749440 ext(6291456->7340031) 00002000:00010000:3.0:1789762877.203059:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe4e00 00000100:00100000:3.0:1789762877.203070:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281720684660 time 281670684660 state 0x1 ref 8 00000100:00100000:2.0:1789762877.210659:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762877.210698:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762877.210761:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140749568 00000100:00100000:0.0:1789762877.210768:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140749568 00002000:00100000:0.0:1789762877.210813:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (7340032->8388607) req@ffff95d173ce9880 x1876702140749568/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762877.210822:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173ce9880 with x1876702140749568 ext(7340032->8388607) 00000100:00100000:3.0:1789762877.210823:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140749824 00002000:00010000:0.0:1789762877.210826:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d173ce9880 00000100:00100000:3.0:1789762877.210868:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140749824 00000100:00100000:0.0:1789762877.210885:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281720684660 time 281670684660 state 0x1 ref 9 00000100:00080000:2.0:1789762877.210925:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762877.210931:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:3.0:1789762877.210942:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+14:12779:x1876702140749824:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:3.0:1789762877.211231:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+15:12779:x1876702140749824:12345-192.168.203.31@tcp:35:dd.0 Request processed in 289us (530us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789762877.211239:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:1.0:1789762877.241909:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762877.241968:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140750080 00000100:00100000:0.0:1789762877.241977:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140750080 00000100:00100000:0.0:1789762877.242026:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:0.0:1789762877.242036:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+15:12789:x1876702140750080:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762877.242056:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762877.242073:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fe62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e908 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.242208:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fe69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.242232:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fe69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.242259:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fe69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.242306:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b600/0xd08452c77c56fe70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.242311:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b600/0xd08452c77c56fe70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.242316:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b600/0xd08452c77c56fe70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789762877.242879:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x9:0x0], index 1: 0 00000004:00080000:0.0:1789762877.242892:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd:0x0], index 0: 0 00010000:00010000:0.0:1789762877.243017:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b200/0xd08452c77c56fe77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.243024:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b200/0xd08452c77c56fe77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.243030:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b200/0xd08452c77c56fe77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.243055:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fe69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.243065:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fe69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.243070:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fe69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.243074:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829bc00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762877.243078:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fe69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.243083:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fe69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.243092:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055df00) 00010000:00010000:0.0:1789762877.243095:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762877.243098:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fe69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.243103:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c56fe69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762877.243113:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050f72498 reply state 00000000234fd989 transno 4294967458 ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b600/0xd08452c77c56fe70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762877.243118:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789762877.243140:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c56fe62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e908 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.243149:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b200/0xd08452c77c56fe77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e908 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.243163:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff95d151e90800) 00010000:00010000:0.0:1789762877.243165:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762877.243166:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15829b200, rc 0) 00000100:00100000:0.0:1789762877.243216:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+18:12789:x1876702140750080:12345-192.168.203.31@tcp:101:dd.0 Request processed in 1182us (1318us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789762877.243222:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 200 00010000:00010000:3.0:1789762877.244004:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b600/0xd08452c77c56fe70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762877.244026:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b600/0xd08452c77c56fe70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762877.244032:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b600/0xd08452c77c56fe70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762877.244036:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829b600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762877.244040:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b600/0xd08452c77c56fe70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762877.244046:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b600/0xd08452c77c56fe70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762877.244055:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x636661f9 (ffff95d151e90b00) 00010000:00010000:3.0:1789762877.244057:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762877.244060:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b600/0xd08452c77c56fe70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762877.244065:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b600/0xd08452c77c56fe70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762877.247603:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281770756491 time 281720756491 state 0x1 ref 9 00000100:00100000:0.0:1789762877.247621:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+14:2345:x1876702140748544:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762877.249935:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762877.249969:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.249987:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140750208 00000100:00100000:3.0:1789762877.249997:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140750208 00000100:00100000:0.0:1789762877.250027:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140750336 00000100:00100000:0.0:1789762877.250037:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140750336 00000100:00100000:3.0:1789762877.250045:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:0.0:1789762877.250103:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:3.0:1789762877.250109:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+17:12789:x1876702140750208:12345-192.168.203.31@tcp:101:dd.0 00000100:00100000:0.0:1789762877.250121:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+17:12790:x1876702140750336:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762877.250129:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762877.250134:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762877.250150:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e90f expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.250161:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f68fbfa6/0xd08452c77c56fe8c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e916 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762877.250237:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789762877.250258:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789762877.250263:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762877.250272:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 19 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.250322:0:6655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 19 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.250335:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762877.250340:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789762877.250345:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f68fbfa6/0xd08452c77c56fe8c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e916 expref: 19 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762877.250377:0:8803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 19 pid: 8803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762877.250394:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 19 pid: 8803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762877.250406:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747fe600, rc 0) 00010000:00010000:0.0:1789762877.250424:0:6655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 19 pid: 8803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.250438:0:6655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 19 pid: 8803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762877.250459:0:6655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6655:1876702149030016:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789762877.250527:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+19:12789:x1876702140750208:12345-192.168.203.31@tcp:101:dd.0 Request processed in 403us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762877.250541:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:0.0:1789762877.250552:0:6655:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d15077ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789762877.250760:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+19:2345:x1876702140748544:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3140us (110370us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789762877.250773:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 239 00002000:00100000:1.0:1789762877.250786:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (3145728->4194303) req@ffff95d16ffe4380 x1876702140748544/t4294967366(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762877.250797:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe4380 with x1876702140748544 ext(3145728->4194303) 00002000:00010000:1.0:1789762877.250811:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe4380 00000100:00100000:0.0:1789762877.251891:0:6655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6655:1876702149030016:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762877.251912:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f68fbfa6/0xd08452c77c56fe8c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e916 expref: 18 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.251923:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15829ba00, rc 0) 00000100:00100000:0.0:1789762877.251954:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+18:12790:x1876702140750336:12345-192.168.203.31@tcp:101:dd.0 Request processed in 1842us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762877.251960:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:2.0:1789762877.252937:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762877.253004:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140750464 00000100:00100000:1.0:1789762877.253010:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140750464 00000100:00100000:1.0:1789762877.253050:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:1.0:1789762877.253062:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+18:12791:x1876702140750464:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762877.253072:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762877.253083:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fa1928d/0xd08452c77c56fe93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e91d expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.253102:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789762877.253107:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1789762877.253113:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa1928d/0xd08452c77c56fe93 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e91d expref: 19 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.253126:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fa1928d/0xd08452c77c56fe93 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e91d expref: 19 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.253137:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003f800, rc 0) 00000100:00100000:1.0:1789762877.253176:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+19:12791:x1876702140750464:12345-192.168.203.31@tcp:101:dd.0 Request processed in 116us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762877.253185:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:2.0:1789762877.253914:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762877.253975:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140750592 00000100:00100000:1.0:1789762877.253980:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140750592 00000100:00100000:1.0:1789762877.254016:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:1.0:1789762877.254025:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+18:12793:x1876702140750592:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762877.254036:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762877.254060:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c56fe9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e924 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762877.254080:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789762877.254092:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=281s v=(0 0) 00010000:00010000:1.0:1789762877.254096:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762877.254104:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c56fe9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e924 expref: 19 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.254118:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c56fe9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e924 expref: 19 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.254129:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003f000, rc 0) 00000100:00100000:1.0:1789762877.254167:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+19:12793:x1876702140750592:12345-192.168.203.31@tcp:101:dd.0 Request processed in 143us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762877.254175:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:2.0:1789762877.260880:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762877.260928:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140750720 00000100:00100000:0.0:1789762877.260934:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140750720 00000100:00100000:0.0:1789762877.260963:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:0.0:1789762877.260971:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+19:12799:x1876702140750720:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762877.260980:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762877.260989:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cda27f45/0xd08452c77c56fea1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e92b expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.261014:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x9:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789762877.261018:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1789762877.261022:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cda27f45/0xd08452c77c56fea1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e92b expref: 20 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.261029:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cda27f45/0xd08452c77c56fea1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e92b expref: 20 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.261037:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15829a800, rc 0) 00000100:00100000:0.0:1789762877.261066:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+20:12799:x1876702140750720:12345-192.168.203.31@tcp:101:dd.0 Request processed in 97us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762877.261072:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:2.0:1789762877.262654:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762877.262705:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140750848 00000100:00100000:1.0:1789762877.262711:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140750848 00000100:00100000:1.0:1789762877.262744:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:1.0:1789762877.262754:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+20:12792:x1876702140750848:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762877.262762:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762877.262771:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56fea8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e932 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.262789:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x9:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1789762877.262793:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(4 0) 00010000:00010000:1.0:1789762877.262799:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56fea8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e932 expref: 21 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.262820:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56fea8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e932 expref: 21 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.262861:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003fc00, rc 0) 00000100:00100000:1.0:1789762877.262896:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+21:12792:x1876702140750848:12345-192.168.203.31@tcp:101:dd.0 Request processed in 143us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762877.262905:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:2.0:1789762877.269120:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.269160:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140750976 00000100:00100000:3.0:1789762877.269166:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140750976 00002000:00100000:3.0:1789762877.269193:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x9:0x0] (0->1048575) req@ffff95d14552ad80 x1876702140750976/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.269202:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d14552ad80 with x1876702140750976 ext(0->1048575) 00010000:00010000:3.0:1789762877.269207:0:11722:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 21 pid: 8803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762877.269228:0:11722:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 21 pid: 8803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762877.269233:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d14552ad80 00000100:00100000:3.0:1789762877.269246:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75b00 gen 0 rate 10000 depth 3 token 2 deadline 246544289377 time 246544223547 state 0x0 ref 1 00000100:00100000:3.0:1789762877.269253:0:11722:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x2, head sequence 5: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75b00 gen 0 rate 10000 depth 3 token 2 deadline 246544289377 time 246544223547 state 0x0 ref 1 00000100:00100000:3.0:1789762877.269267:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015d00 gen 0 rate 20 depth 3 token 3 deadline 281792428086 time 281742428086 state 0x1 ref 1 00000100:00100000:3.0:1789762877.269288:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015d00 gen 0 rate 20 depth 3 token 2 deadline 281792428086 time 281742451183 state 0x0 ref 1 00000100:00100000:3.0:1789762877.269297:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+21:2343:x1876702140750976:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762877.273514:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+23:2343:x1876702140750976:12345-192.168.203.31@tcp:4:dd.0 Request processed in 4213us (4392us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789762877.273526:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:3.0:1789762877.273537:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015d00 gen 0 rate 20 depth 3 token 2 deadline 281792428086 time 281742451183 state 0x2 ref 0 00002000:00100000:3.0:1789762877.273551:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x9:0x0] (0->1048575) req@ffff95d14552ad80 x1876702140750976/t4294967367(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.273562:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d14552ad80 with x1876702140750976 ext(0->1048575) 00010000:00010000:3.0:1789762877.273570:0:11722:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 23 pid: 8803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762877.273591:0:11722:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 23 pid: 8803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762877.273597:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d14552ad80 00000100:00100000:2.0:1789762877.275103:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762877.275158:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140751104 00000100:00100000:1.0:1789762877.275164:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140751104 00000100:00100000:1.0:1789762877.275203:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:1.0:1789762877.275213:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+23:12797:x1876702140751104:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762877.275225:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762877.275239:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094764945/0xd08452c77c56feaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e939 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.275260:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x9:0x0].0x0 since=0s v=(4 0) 00010000:00010000:1.0:1789762877.275264:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(5 0) 00010000:00010000:1.0:1789762877.275270:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094764945/0xd08452c77c56feaf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e939 expref: 24 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.275283:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000094764945/0xd08452c77c56feaf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e939 expref: 24 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.275294:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003e600, rc 0) 00000100:00100000:1.0:1789762877.275329:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+24:12797:x1876702140751104:12345-192.168.203.31@tcp:101:dd.0 Request processed in 119us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762877.275344:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:2.0:1789762877.277109:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762877.277158:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140751232 00000100:00100000:0.0:1789762877.277163:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140751232 00000100:00100000:0.0:1789762877.277192:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:0.0:1789762877.277198:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+24:12798:x1876702140751232:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762877.277206:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762877.277213:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8bec777/0xd08452c77c56feb6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e940 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.277227:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x9:0x0].0x0 since=0s v=(5 0) 00010000:00010000:0.0:1789762877.277230:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(6 0) 00010000:00010000:0.0:1789762877.277234:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8bec777/0xd08452c77c56feb6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e940 expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.277257:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8bec777/0xd08452c77c56feb6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e940 expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.277269:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15829bc00, rc 0) 00000100:00100000:0.0:1789762877.277303:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+25:12798:x1876702140751232:12345-192.168.203.31@tcp:101:dd.0 Request processed in 105us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762877.277308:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:2.0:1789762877.280950:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762877.281004:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140751360 00000100:00100000:1.0:1789762877.281010:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140751360 00000100:00100000:1.0:1789762877.281043:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:1.0:1789762877.281051:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+25:12800:x1876702140751360:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762877.281061:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762877.281070:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016075eb4/0xd08452c77c56febd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e947 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.281086:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x9:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762877.281090:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:1.0:1789762877.281096:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016075eb4/0xd08452c77c56febd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e947 expref: 26 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.281107:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016075eb4/0xd08452c77c56febd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e947 expref: 26 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.281117:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003ec00, rc 0) 00000100:00100000:1.0:1789762877.281149:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+26:12800:x1876702140751360:12345-192.168.203.31@tcp:101:dd.0 Request processed in 98us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762877.281157:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:2.0:1789762877.281771:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762877.281819:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140751488 00000100:00100000:0.0:1789762877.281825:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140751488 00010000:00010000:0.0:1789762877.281871:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 26 pid: 8803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762877.281896:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:0.0:1789762877.281902:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+26:2343:x1876702140751488:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762877.281911:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789762877.281922:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1789762877.281925:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1789762876 00002000:00010000:0.0:1789762877.281927:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1789762876 00010000:00010000:0.0:1789762877.281932:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 26 pid: 8803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.281942:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 26 pid: 8803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.281968:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fd58930/0xd08452c77c56fe85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e90f expref: 26 pid: 8803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.281978:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.281981:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.281986:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f68fbfa6/0xd08452c77c56fe8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e916 expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.281992:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f68fbfa6/0xd08452c77c56fe8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e916 expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.281997:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.281999:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.282003:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa1928d/0xd08452c77c56fe93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e91d expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.282009:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa1928d/0xd08452c77c56fe93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e91d expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.282013:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.282014:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.282017:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cda27f45/0xd08452c77c56fea1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e92b expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.282023:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cda27f45/0xd08452c77c56fea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e92b expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.282032:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.282034:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.282038:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56fea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e932 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.282043:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56fea8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e932 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.282048:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.282050:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.282052:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000094764945/0xd08452c77c56feaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e939 expref: 25 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.282057:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094764945/0xd08452c77c56feaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e939 expref: 25 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.282061:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.282063:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.282066:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8bec777/0xd08452c77c56feb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e940 expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.282071:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8bec777/0xd08452c77c56feb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e940 expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.282075:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.282079:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762877.282083:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016075eb4/0xd08452c77c56febd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e947 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.282088:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016075eb4/0xd08452c77c56febd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e947 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.282112:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000016075eb4/0xd08452c77c56febd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e947 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762877.282121:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030144:192.168.203.31@tcp:105: 00010000:00010000:0.0:1789762877.282186:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a8bec777/0xd08452c77c56feb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e940 expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762877.282195:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030272:192.168.203.31@tcp:105: 00010000:00010000:0.0:1789762877.282220:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000094764945/0xd08452c77c56feaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e939 expref: 25 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762877.282228:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030400:192.168.203.31@tcp:105: 00010000:00010000:0.0:1789762877.282264:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56fea8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e932 expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762877.282276:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030528:192.168.203.31@tcp:105: 00010000:00010000:0.0:1789762877.282323:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cda27f45/0xd08452c77c56fea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e92b expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762877.282342:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030656:192.168.203.31@tcp:105: 00010000:00010000:0.0:1789762877.282380:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fa1928d/0xd08452c77c56fe93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e91d expref: 25 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762877.282402:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030784:192.168.203.31@tcp:105: 00010000:00010000:0.0:1789762877.282451:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f68fbfa6/0xd08452c77c56fe8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e916 expref: 25 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762877.282471:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030912:192.168.203.31@tcp:105: 00000100:00100000:0.0:1789762877.282507:0:5799:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d15077ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789762877.283299:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030144:192.168.203.31@tcp:105: 00000100:00100000:0.0:1789762877.283309:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030272:192.168.203.31@tcp:105: 00000100:00100000:0.0:1789762877.283404:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030400:192.168.203.31@tcp:105: 00000100:00100000:0.0:1789762877.287925:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030528:192.168.203.31@tcp:105: 00000100:00100000:0.0:1789762877.287937:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030656:192.168.203.31@tcp:105: 00000100:00100000:0.0:1789762877.287949:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030784:192.168.203.31@tcp:105: 00000100:00100000:0.0:1789762877.287990:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876702149030912:192.168.203.31@tcp:105: 00010000:00010000:0.0:1789762877.288010:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762877.288036:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+25:2343:x1876702140751488:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 6135us (6266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762877.288052:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:2.0:1789762877.297420:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762877.297469:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140751616 00000100:00100000:1.0:1789762877.297475:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140751616 00002000:00100000:1.0:1789762877.297510:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xd:0x0] (0->1048575) req@ffff95d145529880 x1876702140751616/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762877.297521:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145529880 with x1876702140751616 ext(0->1048575) 00002000:00010000:1.0:1789762877.297532:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145529880 00000100:00100000:1.0:1789762877.297553:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281770756491 time 281720756491 state 0x1 ref 9 00000100:00100000:1.0:1789762877.297638:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281820796317 time 281770796317 state 0x1 ref 9 00000100:00100000:1.0:1789762877.297651:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+19:2345:x1876702140748672:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762877.300180:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+21:2345:x1876702140748672:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2530us (152093us total) trans 4294967678 rc 0/0 00000100:00100000:3.0:1789762877.300189:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 240 00002000:00100000:3.0:1789762877.300196:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc:0x0] (4194304->5242879) req@ffff95d173ce8e00 x1876702140748672/t4294967678(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.300204:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173ce8e00 with x1876702140748672 ext(4194304->5242879) 00002000:00010000:3.0:1789762877.300208:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d173ce8e00 00000100:00100000:2.0:1789762877.328633:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762877.328699:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140751744 00000100:00100000:1.0:1789762877.328709:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140751744 00002000:00100000:1.0:1789762877.328755:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x9:0x0] (3145728->4194303) req@ffff95d145528a80 x1876702140751744/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762877.328767:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145528a80 with x1876702140751744 ext(3145728->4194303) 00002000:00010000:1.0:1789762877.328773:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d145528a80 00000100:00100000:1.0:1789762877.328793:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281820796317 time 281770796317 state 0x1 ref 9 00000100:00100000:1.0:1789762877.331518:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.331590:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140751872 00000100:00100000:3.0:1789762877.331596:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140751872 00002000:00100000:3.0:1789762877.331615:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x9:0x0] (1048576->2097151) req@ffff95d16ffe7b80 x1876702140751872/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.331623:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe7b80 with x1876702140751872 ext(1048576->2097151) 00002000:00010000:3.0:1789762877.331626:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe7b80 00000100:00100000:3.0:1789762877.331635:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281820796317 time 281770796317 state 0x1 ref 10 00000100:00100000:2.0:1789762877.342727:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762877.342777:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140752000 00000100:00100000:0.0:1789762877.342783:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140752000 00002000:00100000:0.0:1789762877.342808:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xd:0x0] (1048576->2097151) req@ffff95d145528000 x1876702140752000/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762877.342816:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145528000 with x1876702140752000 ext(1048576->2097151) 00002000:00010000:0.0:1789762877.342820:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145528000 00000100:00100000:0.0:1789762877.342861:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281820796317 time 281770796317 state 0x1 ref 11 00000100:00100000:2.0:1789762877.343579:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762877.343679:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140752128 00000100:00100000:1.0:1789762877.343685:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140752128 00002000:00100000:1.0:1789762877.343708:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xd:0x0] (3145728->4194303) req@ffff95d145528380 x1876702140752128/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762877.343719:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145528380 with x1876702140752128 ext(3145728->4194303) 00002000:00010000:1.0:1789762877.343722:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145528380 00000100:00100000:1.0:1789762877.343734:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281820796317 time 281770796317 state 0x1 ref 12 00000100:00100000:1.0:1789762877.344464:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.344503:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140752256 00000100:00100000:3.0:1789762877.344508:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140752256 00002000:00100000:3.0:1789762877.344528:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x9:0x0] (6291456->7340031) req@ffff95d148880380 x1876702140752256/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.344546:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148880380 with x1876702140752256 ext(6291456->7340031) 00002000:00010000:3.0:1789762877.344550:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148880380 00000100:00100000:3.0:1789762877.344563:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281820796317 time 281770796317 state 0x1 ref 13 00000100:00100000:0.0:1789762877.347702:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281870860799 time 281820860799 state 0x1 ref 13 00000100:00100000:0.0:1789762877.347715:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+22:2345:x1876702140748800:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762877.349384:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.349433:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140752384 00000100:00100000:3.0:1789762877.349440:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140752384 00002000:00100000:3.0:1789762877.349468:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xd:0x0] (7340032->8388607) req@ffff95d148881880 x1876702140752384/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.349480:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148881880 with x1876702140752384 ext(7340032->8388607) 00002000:00010000:3.0:1789762877.349485:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148881880 00000100:00100000:3.0:1789762877.349499:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281870860799 time 281820860799 state 0x1 ref 14 00000100:00100000:0.0:1789762877.350127:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+25:2345:x1876702140748800:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2414us (190771us total) trans 4294967679 rc 0/0 00000100:00100000:0.0:1789762877.350135:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 241 00002000:00100000:0.0:1789762877.350141:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc:0x0] (5242880->6291455) req@ffff95d16ffe7100 x1876702140748800/t4294967679(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762877.350148:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe7100 with x1876702140748800 ext(5242880->6291455) 00002000:00010000:0.0:1789762877.350152:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffe7100 00000100:00100000:2.0:1789762877.354665:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.354704:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140752512 00000100:00100000:3.0:1789762877.354710:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140752512 00002000:00100000:3.0:1789762877.354731:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xd:0x0] (5242880->6291455) req@ffff95d145529c00 x1876702140752512/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.354738:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145529c00 with x1876702140752512 ext(5242880->6291455) 00002000:00010000:3.0:1789762877.354741:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145529c00 00000100:00100000:3.0:1789762877.354750:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281870860799 time 281820860799 state 0x1 ref 14 00000100:00100000:1.0:1789762877.356508:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.356580:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140752640 00000100:00100000:3.0:1789762877.356585:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140752640 00002000:00100000:3.0:1789762877.356603:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xd:0x0] (4194304->5242879) req@ffff95d148882d80 x1876702140752640/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.356621:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148882d80 with x1876702140752640 ext(4194304->5242879) 00002000:00010000:3.0:1789762877.356624:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148882d80 00000100:00100000:3.0:1789762877.356633:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281870860799 time 281820860799 state 0x1 ref 15 00000100:00100000:1.0:1789762877.358103:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762877.358152:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140752768 00000100:00100000:0.0:1789762877.358158:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140752768 00002000:00100000:0.0:1789762877.358177:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xd:0x0] (6291456->7340031) req@ffff95d148883b80 x1876702140752768/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762877.358195:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148883b80 with x1876702140752768 ext(6291456->7340031) 00002000:00010000:0.0:1789762877.358199:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148883b80 00000100:00100000:0.0:1789762877.358208:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281870860799 time 281820860799 state 0x1 ref 16 00000100:00100000:3.0:1789762877.397782:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281920929003 time 281870929003 state 0x1 ref 16 00000100:00100000:3.0:1789762877.397810:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+27:2344:x1876702140748928:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762877.400827:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+29:2344:x1876702140748928:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3027us (233372us total) trans 4294967680 rc 0/0 00000100:00100000:3.0:1789762877.400869:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 242 00002000:00100000:3.0:1789762877.400879:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc:0x0] (6291456->7340031) req@ffff95d173ce9500 x1876702140748928/t4294967680(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.400887:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173ce9500 with x1876702140748928 ext(6291456->7340031) 00002000:00010000:3.0:1789762877.400892:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d173ce9500 00000100:00100000:1.0:1789762877.402773:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.402823:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140752896 00000100:00100000:3.0:1789762877.402861:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140752896 00002000:00100000:3.0:1789762877.402904:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xd:0x0] (2097152->3145727) req@ffff95d148881f80 x1876702140752896/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.402912:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148881f80 with x1876702140752896 ext(2097152->3145727) 00002000:00010000:3.0:1789762877.402915:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148881f80 00000100:00100000:3.0:1789762877.402928:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281920929003 time 281870929003 state 0x1 ref 16 00000100:00100000:1.0:1789762877.447983:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 281971126703 time 281921126703 state 0x1 ref 16 00000100:00100000:1.0:1789762877.448014:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+29:2345:x1876702140749056:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762877.453109:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+31:2345:x1876702140749056:12345-192.168.203.31@tcp:4:dd.0 Request processed in 5098us (277731us total) trans 4294967681 rc 0/0 00000100:00100000:3.0:1789762877.453136:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 243 00002000:00100000:3.0:1789762877.453153:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc:0x0] (7340032->8388607) req@ffff95d173ce8000 x1876702140749056/t4294967681(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.453168:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173ce8000 with x1876702140749056 ext(7340032->8388607) 00002000:00010000:3.0:1789762877.453177:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d173ce8000 00010000:00010000:0.0:1789762877.479001:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762877.498071:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282021220682 time 281971220682 state 0x1 ref 15 00000100:00100000:0.0:1789762877.498095:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+27:2344:x1876702140749184:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762877.500807:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+29:2344:x1876702140749184:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2720us (316880us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1789762877.500814:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 244 00002000:00100000:0.0:1789762877.500824:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (4194304->5242879) req@ffff95d16ffe6a00 x1876702140749184/t4294967368(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762877.500872:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe6a00 with x1876702140749184 ext(4194304->5242879) 00002000:00010000:0.0:1789762877.500877:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe6a00 00000100:00100000:1.0:1789762877.505920:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762877.505966:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140753024 00000100:00100000:2.0:1789762877.505974:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140753024 00002000:00100000:2.0:1789762877.506005:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x9:0x0] (2097152->3145727) req@ffff95d148881180 x1876702140753024/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762877.506013:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148881180 with x1876702140753024 ext(2097152->3145727) 00002000:00010000:2.0:1789762877.506017:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148881180 00000100:00100000:2.0:1789762877.506032:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282021220682 time 281971220682 state 0x1 ref 15 00000100:00100000:2.0:1789762877.506325:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762877.506380:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140753152 00000100:00100000:3.0:1789762877.506385:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140753152 00002000:00100000:3.0:1789762877.506403:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x9:0x0] (4194304->5242879) req@ffff95d14552a680 x1876702140753152/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.506410:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d14552a680 with x1876702140753152 ext(4194304->5242879) 00002000:00010000:3.0:1789762877.506413:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d14552a680 00000100:00100000:3.0:1789762877.506422:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282021220682 time 281971220682 state 0x1 ref 16 00000100:00100000:3.0:1789762877.548141:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282071291074 time 282021291074 state 0x1 ref 16 00000100:00100000:3.0:1789762877.548164:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+30:2345:x1876702140749312:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762877.554480:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+32:2345:x1876702140749312:12345-192.168.203.31@tcp:4:dd.0 Request processed in 6322us (363347us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789762877.554489:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 245 00002000:00100000:3.0:1789762877.554499:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (5242880->6291455) req@ffff95d173cea680 x1876702140749312/t4294967369(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.554507:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173cea680 with x1876702140749312 ext(5242880->6291455) 00002000:00010000:3.0:1789762877.554513:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d173cea680 00000100:00100000:2.0:1789762877.557421:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762877.557482:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140753536 00000100:00100000:0.0:1789762877.557496:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140753536 00000100:00100000:0.0:1789762877.557555:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:0.0:1789762877.557567:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15177e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+17:12798:x1876702140753536:12345-192.168.203.31@tcp:35:dd.0 00000001:00080000:0.0:1789762877.557787:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967459 00000100:00100000:0.0:1789762877.557900:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15177e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+19:12798:x1876702140753536:12345-192.168.203.31@tcp:35:dd.0 Request processed in 335us (479us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789762877.557910:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000020:00080000:0.0:1789762877.557923:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789762877.558004:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762877.558040:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762877.558050:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140753280 00000100:00100000:0.0:1789762877.558056:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140753280 00000100:00100000:2.0:1789762877.558075:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140753664 00002000:00100000:0.0:1789762877.558081:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x9:0x0] (5242880->6291455) req@ffff95d148881500 x1876702140753280/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789762877.558081:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140753664 00002000:00100000:0.0:1789762877.558091:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148881500 with x1876702140753280 ext(5242880->6291455) 00002000:00010000:0.0:1789762877.558095:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148881500 00002000:00100000:2.0:1789762877.558105:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x9:0x0] (7340032->8388607) req@ffff95d148880700 x1876702140753664/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/0 e 0 to 0 dl 1789762888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1789762877.558114:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282071291074 time 282021291074 state 0x1 ref 16 00002000:00100000:2.0:1789762877.558128:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148880700 with x1876702140753664 ext(7340032->8388607) 00002000:00010000:2.0:1789762877.558133:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148880700 00000100:00100000:2.0:1789762877.558144:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282071291074 time 282021291074 state 0x1 ref 17 00000100:00100000:1.0:1789762877.598209:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282121359327 time 282071359327 state 0x1 ref 17 00000100:00100000:1.0:1789762877.598231:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+33:2344:x1876702140749440:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762877.601077:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+35:2344:x1876702140749440:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2852us (398116us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789762877.601085:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 246 00002000:00100000:3.0:1789762877.601095:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x8:0x0] (6291456->7340031) req@ffff95d16ffe4e00 x1876702140749440/t4294967370(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.601102:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe4e00 with x1876702140749440 ext(6291456->7340031) 00002000:00010000:3.0:1789762877.601108:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe4e00 00000100:00100000:3.0:1789762877.648273:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282171423793 time 282121423793 state 0x1 ref 16 00000100:00100000:3.0:1789762877.648296:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+34:2344:x1876702140749568:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762877.651167:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+36:2344:x1876702140749568:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2878us (440509us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789762877.651176:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 247 00002000:00100000:3.0:1789762877.651186:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (7340032->8388607) req@ffff95d173ce9880 x1876702140749568/t4294967371(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.651194:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173ce9880 with x1876702140749568 ext(7340032->8388607) 00002000:00010000:3.0:1789762877.651200:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d173ce9880 00000100:00100000:0.0:1789762877.698351:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282221500457 time 282171500457 state 0x1 ref 15 00000100:00100000:0.0:1789762877.698372:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+30:2343:x1876702140751616:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762877.702920:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+32:2343:x1876702140751616:12345-192.168.203.31@tcp:4:dd.0 Request processed in 4553us (405500us total) trans 4294967682 rc 0/0 00000100:00100000:0.0:1789762877.702928:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 248 00002000:00100000:0.0:1789762877.702938:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xd:0x0] (0->1048575) req@ffff95d145529880 x1876702140751616/t4294967682(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762877.702945:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145529880 with x1876702140751616 ext(0->1048575) 00002000:00010000:0.0:1789762877.702951:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145529880 00000100:00100000:3.0:1789762877.748452:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282271604886 time 282221604886 state 0x1 ref 14 00000100:00100000:3.0:1789762877.748472:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+35:2343:x1876702140751744:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762877.751155:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+37:2343:x1876702140751744:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2689us (422528us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789762877.751163:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 249 00002000:00100000:3.0:1789762877.751178:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x9:0x0] (3145728->4194303) req@ffff95d145528a80 x1876702140751744/t4294967372(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.751186:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145528a80 with x1876702140751744 ext(3145728->4194303) 00002000:00010000:3.0:1789762877.751191:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d145528a80 00000100:00100000:2.0:1789762877.798571:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282321720925 time 282271720925 state 0x1 ref 13 00000100:00100000:2.0:1789762877.798596:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+36:2342:x1876702140751872:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762877.801167:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+38:2342:x1876702140751872:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2579us (469648us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789762877.801175:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 250 00002000:00100000:0.0:1789762877.801184:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x9:0x0] (1048576->2097151) req@ffff95d16ffe7b80 x1876702140751872/t4294967373(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762877.801205:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe7b80 with x1876702140751872 ext(1048576->2097151) 00002000:00010000:0.0:1789762877.801210:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe7b80 00000100:00100000:1.0:1789762877.848645:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282371797901 time 282321797901 state 0x1 ref 12 00000100:00100000:1.0:1789762877.848664:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+31:2345:x1876702140752000:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762877.851488:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+33:2345:x1876702140752000:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2828us (508764us total) trans 4294967683 rc 0/0 00000100:00100000:3.0:1789762877.851497:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 251 00002000:00100000:3.0:1789762877.851504:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xd:0x0] (1048576->2097151) req@ffff95d145528000 x1876702140752000/t4294967683(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.851512:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145528000 with x1876702140752000 ext(1048576->2097151) 00002000:00010000:3.0:1789762877.851516:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145528000 00000100:00100000:3.0:1789762877.898695:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282421845639 time 282371845639 state 0x1 ref 11 00000100:00100000:3.0:1789762877.898718:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+32:2343:x1876702140752128:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762877.901542:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+34:2343:x1876702140752128:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2830us (557961us total) trans 4294967684 rc 0/0 00000100:00100000:3.0:1789762877.901550:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 252 00002000:00100000:3.0:1789762877.901561:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xd:0x0] (3145728->4194303) req@ffff95d145528380 x1876702140752128/t4294967684(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.901569:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145528380 with x1876702140752128 ext(3145728->4194303) 00002000:00010000:3.0:1789762877.901574:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145528380 00000100:00100000:3.0:1789762877.948759:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282471909886 time 282421909886 state 0x1 ref 10 00000100:00100000:3.0:1789762877.948795:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+37:2344:x1876702140752256:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762877.951477:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140752256:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2685us (607011us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789762877.951488:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 253 00002000:00100000:3.0:1789762877.951500:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x9:0x0] (6291456->7340031) req@ffff95d148880380 x1876702140752256/t4294967374(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762877.951512:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148880380 with x1876702140752256 ext(6291456->7340031) 00002000:00010000:3.0:1789762877.951520:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148880380 00000100:00100000:0.0:1789762877.998871:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282522022609 time 282472022609 state 0x1 ref 9 00000100:00100000:0.0:1789762877.998893:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+33:2342:x1876702140752384:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762878.004747:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+35:2342:x1876702140752384:12345-192.168.203.31@tcp:4:dd.0 Request processed in 5859us (655362us total) trans 4294967685 rc 0/0 00000100:00100000:0.0:1789762878.004756:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 254 00002000:00100000:0.0:1789762878.004766:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xd:0x0] (7340032->8388607) req@ffff95d148881880 x1876702140752384/t4294967685(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762878.004774:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148881880 with x1876702140752384 ext(7340032->8388607) 00002000:00010000:0.0:1789762878.004779:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148881880 00000100:00100000:3.0:1789762878.048947:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282572101985 time 282522101985 state 0x1 ref 8 00000100:00100000:3.0:1789762878.048963:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+34:2343:x1876702140752512:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762878.051313:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+36:2343:x1876702140752512:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2353us (696648us total) trans 4294967686 rc 0/0 00000100:00100000:3.0:1789762878.051321:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 255 00002000:00100000:3.0:1789762878.051330:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xd:0x0] (5242880->6291455) req@ffff95d145529c00 x1876702140752512/t4294967686(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762878.051338:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145529c00 with x1876702140752512 ext(5242880->6291455) 00002000:00010000:3.0:1789762878.051343:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145529c00 00000100:00100000:0.0:1789762878.099017:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282622169905 time 282572169905 state 0x1 ref 7 00000100:00100000:0.0:1789762878.099038:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+35:2345:x1876702140752640:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762878.101587:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+37:2345:x1876702140752640:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2554us (745079us total) trans 4294967687 rc 0/0 00000100:00100000:0.0:1789762878.101595:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 256 00002000:00100000:0.0:1789762878.101604:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xd:0x0] (4194304->5242879) req@ffff95d148882d80 x1876702140752640/t4294967687(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762878.101612:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148882d80 with x1876702140752640 ext(4194304->5242879) 00002000:00010000:0.0:1789762878.101624:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148882d80 00000100:00100000:3.0:1789762878.149090:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282672241413 time 282622241413 state 0x1 ref 6 00000100:00100000:3.0:1789762878.149114:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+36:2342:x1876702140752768:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762878.151623:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+38:2342:x1876702140752768:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2517us (793520us total) trans 4294967688 rc 0/0 00000100:00100000:3.0:1789762878.151631:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 257 00002000:00100000:3.0:1789762878.151641:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xd:0x0] (6291456->7340031) req@ffff95d148883b80 x1876702140752768/t4294967688(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762878.151649:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148883b80 with x1876702140752768 ext(6291456->7340031) 00002000:00010000:3.0:1789762878.151654:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148883b80 00000100:00100000:3.0:1789762878.199135:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282722286269 time 282672286269 state 0x1 ref 5 00000100:00100000:3.0:1789762878.199156:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+37:2344:x1876702140752896:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762878.201789:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140752896:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2639us (799017us total) trans 4294967689 rc 0/0 00000100:00100000:3.0:1789762878.201798:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 258 00002000:00100000:3.0:1789762878.201808:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xd:0x0] (2097152->3145727) req@ffff95d148881f80 x1876702140752896/t4294967689(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762878.201816:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148881f80 with x1876702140752896 ext(2097152->3145727) 00002000:00010000:3.0:1789762878.201822:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148881f80 00000100:00100000:1.0:1789762878.205514:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.205553:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140753792 00000100:00100000:3.0:1789762878.205560:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140753792 00000100:00100000:3.0:1789762878.205597:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:3.0:1789762878.205602:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77777931-b235-4c03-82d2-4b1d12553008+39:10500:x1876702140753792:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762878.205612:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:3.0:1789762878.205623:0:5798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:3.0:1789762878.205631:0:5798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb mtime from disk: 0 -> 1789762876 00002000:00010000:3.0:1789762878.205633:0:5798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb ctime from disk: 0 -> 1789762876 00010000:00010000:3.0:1789762878.205654:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c56fe4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8fa expref: 39 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762878.205677:0:5798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:3.0:1789762878.205679:0:5798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb mtime from disk: 0 -> 1789762876 00002000:00010000:3.0:1789762878.205681:0:5798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb ctime from disk: 0 -> 1789762876 00010000:00010000:3.0:1789762878.205685:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c56fe9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e924 expref: 38 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.205695:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762878.205719:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77777931-b235-4c03-82d2-4b1d12553008+37:10500:x1876702140753792:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 117us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762878.205725:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:3.0:1789762878.249183:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282772336575 time 282722336575 state 0x1 ref 4 00000100:00100000:3.0:1789762878.249200:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+38:2342:x1876702140753024:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762878.251704:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+40:2342:x1876702140753024:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2508us (745786us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789762878.251712:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 259 00002000:00100000:3.0:1789762878.251722:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x9:0x0] (2097152->3145727) req@ffff95d148881180 x1876702140753024/t4294967375(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762878.251730:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148881180 with x1876702140753024 ext(2097152->3145727) 00002000:00010000:3.0:1789762878.251735:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148881180 00000100:00100000:0.0:1789762878.299292:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282822441742 time 282772441742 state 0x1 ref 3 00000100:00100000:0.0:1789762878.299314:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+39:2343:x1876702140753152:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762878.302189:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+41:2343:x1876702140753152:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2881us (795863us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789762878.302197:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 260 00002000:00100000:0.0:1789762878.302207:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x9:0x0] (4194304->5242879) req@ffff95d14552a680 x1876702140753152/t4294967376(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762878.302215:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d14552a680 with x1876702140753152 ext(4194304->5242879) 00002000:00010000:0.0:1789762878.302220:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d14552a680 00000100:00100000:3.0:1789762878.349358:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282872511438 time 282822511438 state 0x1 ref 2 00000100:00100000:3.0:1789762878.349378:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+40:2343:x1876702140753280:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762878.352097:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+42:2343:x1876702140753280:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2725us (794093us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789762878.352105:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 261 00002000:00100000:3.0:1789762878.352113:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x9:0x0] (5242880->6291455) req@ffff95d148881500 x1876702140753280/t4294967377(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762878.352121:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148881500 with x1876702140753280 ext(5242880->6291455) 00002000:00010000:3.0:1789762878.352126:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148881500 00000100:00100000:0.0:1789762878.399443:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282872511438 time 282872594181 state 0x0 ref 1 00000100:00100000:0.0:1789762878.399466:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+41:2343:x1876702140753664:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762878.402129:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+43:2343:x1876702140753664:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2671us (844087us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789762878.402138:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 262 00000100:00100000:0.0:1789762878.402146:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282872511438 time 282872594181 state 0x2 ref 0 00002000:00100000:0.0:1789762878.402157:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x9:0x0] (7340032->8388607) req@ffff95d148880700 x1876702140753664/t4294967378(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:658/0 lens 488/448 e 0 to 0 dl 1789762888 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762878.402165:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148880700 with x1876702140753664 ext(7340032->8388607) 00002000:00010000:0.0:1789762878.402170:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148880700 00000100:00100000:2.0:1789762878.406229:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762878.406304:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140753920 00000100:00100000:1.0:1789762878.406312:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140753920 00000100:00100000:1.0:1789762878.406359:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:1.0:1789762878.406367:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+43:5571:x1876702140753920:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762878.406376:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 8 locks, starting at 0 00002000:00010000:1.0:1789762878.406388:0:5797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1789762878.406391:0:5797:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1789762876 00002000:00010000:1.0:1789762878.406393:0:5797:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1789762876 00002000:00010000:1.0:1789762878.406400:0:5797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1789762878.406431:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000006b4858/0xd08452c77c56fe5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e901 expref: 43 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762878.406455:0:5797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb size from disk: 1048576 -> 8388608 00002000:00010000:1.0:1789762878.406457:0:5797:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb mtime from disk: 1789762876 -> 1789762877 00002000:00010000:1.0:1789762878.406458:0:5797:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb ctime from disk: 1789762876 -> 1789762877 00010000:00010000:1.0:1789762878.406464:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016075eb4/0xd08452c77c56febd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e947 expref: 42 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.406473:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8bec777/0xd08452c77c56feb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e940 expref: 41 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.406483:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094764945/0xd08452c77c56feaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e939 expref: 40 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.406495:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa1928d/0xd08452c77c56fe93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e91d expref: 39 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.406507:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cda27f45/0xd08452c77c56fea1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e92b expref: 38 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.406520:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f68fbfa6/0xd08452c77c56fe8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e916 expref: 37 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.406533:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000015a9225/0xd08452c77c56fea8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e932 expref: 36 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.406554:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762878.406582:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+35:5571:x1876702140753920:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 217us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762878.406588:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:1.0:1789762878.432040:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762878.432103:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140754176 00000100:00100000:0.0:1789762878.432112:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140754176 00000100:00100000:0.0:1789762878.432153:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:0.0:1789762878.432162:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+19:12824:x1876702140754176:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762878.432182:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762878.432198:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ac00/0xd08452c77c56fec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e94e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.432290:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a000/0xd08452c77c56fecb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.432305:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a000/0xd08452c77c56fecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.432319:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a000/0xd08452c77c56fecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762878.432328:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 16777216 00010000:00010000:0.0:1789762878.432417:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ac00/0xd08452c77c56fec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e94e expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.432431:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a000/0xd08452c77c56fecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e94e expref: 21 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.432437:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:0.0:1789762878.432440:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762878.432442:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15829a000, rc 0) 00000100:00100000:0.0:1789762878.432502:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+21:12824:x1876702140754176:12345-192.168.203.31@tcp:101:dd.0 Request processed in 339us (466us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789762878.432525:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:2.0:1789762878.432578:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.432687:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140754432 00000100:00100000:3.0:1789762878.432692:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140754432 00000100:00100000:3.0:1789762878.432720:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 202 00000100:00100000:3.0:1789762878.432727:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+21:12825:x1876702140754432:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762878.432736:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762878.432744:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fed9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e955 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.432781:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fee0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.432788:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.432794:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762878.432811:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 16777216 00010000:00010000:3.0:1789762878.432904:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747fee00/0xd08452c77c56fed9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e955 expref: 24 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.432915:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e955 expref: 23 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.432920:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:3.0:1789762878.432922:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762878.432924:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1747ffa00, rc 0) 00000100:00100000:3.0:1789762878.432951:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+23:12825:x1876702140754432:12345-192.168.203.31@tcp:101:dd.0 Request processed in 225us (377us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789762878.432956:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 202 00000100:00100000:1.0:1789762878.434367:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762878.434404:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762878.434424:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140754560 00000100:00100000:1.0:1789762878.434429:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762878.434436:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140754560 00000100:00100000:0.0:1789762878.434439:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140754816 00000100:00100000:0.0:1789762878.434445:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140754816 00000100:00100000:1.0:1789762878.434460:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.434461:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140755072 00000100:00100000:3.0:1789762878.434467:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140755072 00000100:00100000:2.0:1789762878.434484:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:0.0:1789762878.434490:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140754688 00000100:00100000:2.0:1789762878.434496:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+37:12824:x1876702140754560:12345-192.168.203.31@tcp:101:dd.0 00000100:00100000:0.0:1789762878.434497:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140754688 00010000:00010000:2.0:1789762878.434507:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789762878.434512:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1789762878.434512:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00010000:00010000:2.0:1789762878.434522:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf7b0c25/0xd08452c77c56feee lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e95c expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762878.434535:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+25:12825:x1876702140755072:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:1.0:1789762878.434536:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+25:2345:x1876702140754816:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789762878.434540:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00002000:00010000:2.0:1789762878.434544:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 8388608, mtime: 0x6aad9d3c, atime: 0x0, ctime: 0x6aad9d3c, blocks: 0x1 00010000:00010000:1.0:1789762878.434554:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789762878.434556:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+25:2343:x1876702140754688:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762878.434560:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=282s v=(0 0) 00010000:00010000:2.0:1789762878.434565:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762878.434567:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762878.434573:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ffa00/0xd08452c77c56fee0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e955 expref: 25 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.434574:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7b0c25/0xd08452c77c56feee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e95c expref: 38 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.434581:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a000/0xd08452c77c56fecb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e94e expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.434600:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:1.0:1789762878.434605:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762878.434606:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf7b0c25/0xd08452c77c56feee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e95c expref: 38 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.434608:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:0.0:1789762878.434616:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762878.434622:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9e00, rc 0) 00000100:00100000:1.0:1789762878.434634:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+24:2345:x1876702140754816:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 109us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762878.434640:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1789762878.434645:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+24:2343:x1876702140754688:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 93us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762878.434655:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+23:12825:x1876702140755072:12345-192.168.203.31@tcp:35:dd.0 Request processed in 129us (224us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1789762878.434657:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1789762878.434664:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+38:12824:x1876702140754560:12345-192.168.203.31@tcp:101:dd.0 Request processed in 168us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762878.434671:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:2.0:1789762878.434677:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:1.0:1789762878.438285:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.438318:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140755200 00000100:00100000:3.0:1789762878.438324:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140755200 00002000:00100000:3.0:1789762878.438348:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc:0x0] (0->1048575) req@ffff95d148df3100 x1876702140755200/t0(0) o3->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:659/0 lens 488/0 e 0 to 0 dl 1789762889 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762878.438356:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148df3100 with x1876702140755200 ext(0->1048575) 00002000:00010000:3.0:1789762878.438365:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148df3100 00000100:00100000:3.0:1789762878.438378:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246990240348 time 246990177721 state 0x0 ref 1 00000100:00100000:3.0:1789762878.438385:0:11722:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x2, head sequence 5: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 246990240348 time 246990177721 state 0x0 ref 1 00000100:00100000:3.0:1789762878.438399:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 3 deadline 283011559888 time 282911559888 state 0x1 ref 1 00000100:00100000:3.0:1789762878.438420:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 2 deadline 283011559888 time 282911582432 state 0x0 ref 1 00000100:00100000:3.0:1789762878.438428:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+38:2342:x1876702140755200:12345-192.168.203.31@tcp:3:dd.0 00000100:00100000:3.0:1789762878.442406:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+38:2342:x1876702140755200:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3974us (4118us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762878.442417:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 263 00000100:00100000:3.0:1789762878.442428:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 2 deadline 283011559888 time 282911582432 state 0x2 ref 0 00002000:00100000:3.0:1789762878.442441:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc:0x0] (0->1048575) req@ffff95d148df3100 x1876702140755200/t0(0) o3->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:659/0 lens 488/440 e 0 to 0 dl 1789762889 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762878.442451:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148df3100 with x1876702140755200 ext(0->1048575) 00002000:00010000:3.0:1789762878.442456:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d148df3100 00000100:00100000:1.0:1789762878.471920:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762878.471982:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140755456 00000100:00100000:0.0:1789762878.471992:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140755456 00000100:00100000:0.0:1789762878.472038:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1789762878.472047:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+22:12837:x1876702140755456:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:0.0:1789762878.472232:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+23:12837:x1876702140755456:12345-192.168.203.31@tcp:35:dd.0 Request processed in 187us (320us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1789762878.472241:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:1.0:1789762878.481072:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.481117:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140755584 00000100:00100000:3.0:1789762878.481123:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140755584 00000100:00100000:3.0:1789762878.481153:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:3.0:1789762878.481159:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+23:12840:x1876702140755584:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1789762878.481184:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762878.481200:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c56fef5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e963 expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.481254:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e800/0xd08452c77c56fefc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.481268:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e800/0xd08452c77c56fefc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.481278:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e800/0xd08452c77c56fefc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762878.481299:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00000004:00200000:3.0:1789762878.481301:0:13232:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762878.481311:0:13232:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e800/0xd08452c77c56fefc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.481328:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c56fef5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e963 expref: 25 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.481340:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e800/0xd08452c77c56fefc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e963 expref: 24 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.481347:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055df00) 00010000:00010000:3.0:1789762878.481349:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762878.481351:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003e800, rc 0) 00000100:00100000:3.0:1789762878.481379:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+24:12840:x1876702140755584:12345-192.168.203.31@tcp:101:rm.0 Request processed in 221us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762878.481392:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:2.0:1789762878.482345:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.482375:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140755840 00000100:00100000:3.0:1789762878.482379:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140755840 00000100:00100000:3.0:1789762878.482403:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:3.0:1789762878.482408:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+24:12840:x1876702140755840:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1789762878.482415:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762878.482421:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c56ff03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e96a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762878.482470:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00010000:00010000:3.0:1789762878.482518:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c56ff03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e96a expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.482527:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04e00) 00010000:00010000:3.0:1789762878.482529:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762878.482532:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c56ff03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e96a expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.482539:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003fc00, rc 0) 00000100:00100000:3.0:1789762878.482563:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+25:12840:x1876702140755840:12345-192.168.203.31@tcp:101:rm.0 Request processed in 156us (221us total) trans 4294967465 rc 301/301 00000100:00100000:3.0:1789762878.482568:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:1.0:1789762878.484012:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.484037:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140755968 00000100:00100000:3.0:1789762878.484042:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140755968 00000100:00100000:3.0:1789762878.484064:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:3.0:1789762878.484070:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+25:12840:x1876702140755968:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:3.0:1789762878.486077:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+25:12840:x1876702140755968:12345-192.168.203.31@tcp:37:rm.0 Request processed in 2001us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762878.486087:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:2.0:1789762878.488085:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762878.488136:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140756224 00000100:00100000:0.0:1789762878.488144:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140756224 00000100:00100000:0.0:1789762878.488175:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:0.0:1789762878.488191:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+25:12840:x1876702140756224:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:0.0:1789762878.488321:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+26:12840:x1876702140756224:12345-192.168.203.31@tcp:35:rm.0 Request processed in 132us (240us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1789762878.488328:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:1.0:1789762878.489135:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762878.489195:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140756480 00000100:00100000:2.0:1789762878.489201:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140756480 00000100:00100000:2.0:1789762878.489237:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:2.0:1789762878.489246:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+26:12840:x1876702140756480:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789762878.489269:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762878.489297:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56ff11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e971 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.489357:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56ff18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.489371:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56ff18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.489382:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56ff18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762878.489392:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00010000:00010000:2.0:1789762878.489457:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9400/0xd08452c77c56ff11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e971 expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.489474:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56ff18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e971 expref: 28 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.489483:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055df00) 00010000:00010000:2.0:1789762878.489486:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789762878.489489:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d1583a9c00, rc 0) 00000100:00100000:2.0:1789762878.489523:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+28:12840:x1876702140756480:12345-192.168.203.31@tcp:101:rm.0 Request processed in 278us (389us total) trans 4294967467 rc 0/0 00000100:00100000:2.0:1789762878.489531:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:1.0:1789762878.490369:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762878.490406:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140756608 00000100:00100000:0.0:1789762878.490411:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140756608 00000100:00100000:0.0:1789762878.490439:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:0.0:1789762878.490445:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+28:12840:x1876702140756608:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:0.0:1789762878.490477:0:5814:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789762878.490509:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+28:12840:x1876702140756608:12345-192.168.203.31@tcp:41:rm.0 Request processed in 64us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762878.490514:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:0.0:1789762878.491239:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762878.491292:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140756864 00000100:00100000:1.0:1789762878.491298:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140756864 00000100:00100000:1.0:1789762878.491336:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:1.0:1789762878.491346:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+28:12840:x1876702140756864:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:1.0:1789762878.491370:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789762878.491384:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b200/0xd08452c77c56fe77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e908 expref: 28 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.491395:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff95d151e90800) 00010000:00010000:1.0:1789762878.491405:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e800/0xd08452c77c56fefc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e963 expref: 27 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.491411:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055df00) 00010000:00010000:1.0:1789762878.491414:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762878.491423:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043aa00/0xd08452c77c56ff26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.491429:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043aa00/0xd08452c77c56ff26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.491435:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043aa00/0xd08452c77c56ff26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.491444:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043bc00/0xd08452c77c56ff2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.491449:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043bc00/0xd08452c77c56ff2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.491468:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043bc00/0xd08452c77c56ff2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.491543:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043be00/0xd08452c77c56ff34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.491549:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043be00/0xd08452c77c56ff34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.491555:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043be00/0xd08452c77c56ff34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789762878.492074:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 64 off8704 00000004:00080000:1.0:1789762878.492082:0:6681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 282965247902ns, next at 283965246494ns, rc = 0 00000040:00080000:1.0:1789762878.492122:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 64 off8960 00000004:00080000:1.0:1789762878.492127:0:6681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 282965293234ns, next at 283965292497ns, rc = 0 00010000:00010000:1.0:1789762878.492166:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b400/0xd08452c77c56ff3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492173:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b400/0xd08452c77c56ff3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492179:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b400/0xd08452c77c56ff3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492183:0:6681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b400/0xd08452c77c56ff3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492188:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b400/0xd08452c77c56ff3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492200:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b400/0xd08452c77c56ff3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492215:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762878.492225:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043be00/0xd08452c77c56ff34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492229:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043be00/0xd08452c77c56ff34 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492235:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043be00/0xd08452c77c56ff34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.492240:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762878.492242:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043be00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762878.492248:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b400/0xd08452c77c56ff3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492250:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043be00/0xd08452c77c56ff34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492269:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043be00/0xd08452c77c56ff34 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.492290:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762878.492296:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff95d14abf2500) 00010000:00010000:1.0:1789762878.492300:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762878.492305:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043be00/0xd08452c77c56ff34 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.492306:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b400/0xd08452c77c56ff3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492324:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043be00/0xd08452c77c56ff34 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.492326:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b400/0xd08452c77c56ff3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.492350:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff95d14abf2500) 00010000:00010000:1.0:1789762878.492352:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043aa00/0xd08452c77c56ff26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.492353:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762878.492360:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b400/0xd08452c77c56ff3b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492362:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043aa00/0xd08452c77c56ff26 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.492369:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b400/0xd08452c77c56ff3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492375:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043aa00/0xd08452c77c56ff26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492383:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043aa00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762878.492386:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043aa00/0xd08452c77c56ff26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492392:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043aa00/0xd08452c77c56ff26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.492392:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762878.492397:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762878.492401:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762878.492404:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055df00) 00010000:00010000:1.0:1789762878.492407:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762878.492410:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043aa00/0xd08452c77c56ff26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.492414:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043aa00/0xd08452c77c56ff26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762878.492422:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053fd8106 reply state 00000000951d318e transno 4294967468 ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043bc00/0xd08452c77c56ff2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762878.492428:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762878.492469:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+28:12840:x1876702140756864:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1124us (1228us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789762878.492476:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 207 00010000:00010000:3.0:1789762878.492966:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043bc00/0xd08452c77c56ff2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.492975:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043bc00/0xd08452c77c56ff2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.492979:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043bc00/0xd08452c77c56ff2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.492984:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043bc00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762878.492986:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043bc00/0xd08452c77c56ff2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.492990:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043bc00/0xd08452c77c56ff2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.492997:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x636661f9 (ffff95d14abf2200) 00010000:00010000:3.0:1789762878.492999:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762878.493001:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043bc00/0xd08452c77c56ff2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.493005:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043bc00/0xd08452c77c56ff2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762878.493477:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.493503:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140757120 00000100:00100000:3.0:1789762878.493508:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140757120 00000100:00100000:3.0:1789762878.493562:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 208 00000100:00100000:3.0:1789762878.493568:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+27:12840:x1876702140757120:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:3.0:1789762878.493596:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762878.493606:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c56fe3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8f3 expref: 27 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.493614:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:3.0:1789762878.493619:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762878.493626:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c56ff42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.493633:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c56ff42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.493638:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c56ff42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.493645:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c56ff49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.493650:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c56ff49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.493654:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c56ff49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.493688:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56ff50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.493693:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56ff50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.493698:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56ff50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789762878.494013:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 64 off9024 00000040:00080000:3.0:1789762878.494024:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].9, 64 off8768 00010000:00010000:3.0:1789762878.494053:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c56ff57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494060:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c56ff57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494065:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c56ff57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494070:0:7603:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c56ff57 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494074:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c56ff57 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494077:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c56ff57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494090:0:7603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762878.494097:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56ff50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494101:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56ff50 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494105:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56ff50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494109:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762878.494112:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56ff50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.494113:0:6671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762878.494120:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c56ff57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494124:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56ff50 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.494137:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762878.494141:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff95d15055d400) 00010000:00010000:3.0:1789762878.494144:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789762878.494146:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56ff50 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.494149:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c56ff57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494151:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c56ff50 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.494171:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c56ff57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494174:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c56ff42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494189:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c56ff42 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.494193:0:6671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff95d15055d400) 00010000:00010000:3.0:1789762878.494194:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c56ff42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494198:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fc00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762878.494200:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c56ff42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.494207:0:6671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789762878.494210:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c56ff42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.494214:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c56ff57 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494217:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055df00) 00010000:00010000:3.0:1789762878.494224:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762878.494227:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c56ff42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.494230:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c56ff57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494243:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c56ff42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.494247:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762878.494251:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1789762878.494251:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cf53594 reply state 000000008090f42c transno 4294967469 ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c56ff49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.494254:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762878.494260:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762878.494293:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+28:12840:x1876702140757120:12345-192.168.203.31@tcp:36:rm.0 Request processed in 725us (817us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789762878.494298:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 208 00010000:00010000:3.0:1789762878.494792:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c56ff49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494798:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c56ff49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494803:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c56ff49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494806:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fe00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762878.494808:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c56ff49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494812:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c56ff49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494819:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0xf4d4877e (ffff95d15055d600) 00010000:00010000:3.0:1789762878.494820:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762878.494854:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c56ff49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.494868:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c56ff49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762878.496104:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.496133:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140757376 00000100:00100000:3.0:1789762878.496168:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140757376 00000100:00100000:3.0:1789762878.496194:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:3.0:1789762878.496200:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+27:12840:x1876702140757376:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:3.0:1789762878.496285:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+28:12840:x1876702140757376:12345-192.168.203.31@tcp:35:rm.0 Request processed in 85us (182us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789762878.496291:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:1.0:1789762878.496907:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.496930:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140757632 00000100:00100000:3.0:1789762878.496934:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140757632 00000100:00100000:3.0:1789762878.496957:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:3.0:1789762878.496962:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+28:12840:x1876702140757632:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:3.0:1789762878.496980:0:13232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789762878.496990:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9c00/0xd08452c77c56ff18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e971 expref: 28 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497002:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1747ff000/0xd08452c77c56fe23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8ec expref: 27 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497009:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055df00) 00010000:00010000:3.0:1789762878.497016:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8e00/0xd08452c77c56fdc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e8d7 expref: 26 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497021:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04e00) 00010000:00010000:3.0:1789762878.497032:0:13232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762878.497042:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ff5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497048:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ff5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497053:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ff5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497060:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56ff65 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497065:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56ff65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497069:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56ff65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497104:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56ff6c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497109:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56ff6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497114:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56ff6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762878.497319:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00010000:00010000:3.0:1789762878.497326:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56ff6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497331:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56ff6c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497340:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56ff6c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497344:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762878.497346:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56ff6c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497350:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56ff6c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497356:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff95d15055de00) 00010000:00010000:3.0:1789762878.497358:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789762878.497360:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56ff6c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497365:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c56ff6c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497375:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ff5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497379:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ff5e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497383:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ff5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497386:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762878.497388:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ff5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497399:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ff5e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497404:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d900) 00010000:00010000:3.0:1789762878.497405:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762878.497407:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ff5e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497410:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ff5e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762878.497417:0:13232:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090665b07 reply state 00000000cd0423f6 transno 4294967471 ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56ff65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762878.497421:0:13232:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762878.497451:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+27:12840:x1876702140757632:12345-192.168.203.31@tcp:36:rm.0 Request processed in 489us (544us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789762878.497456:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 209 00010000:00010000:3.0:1789762878.497966:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56ff65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497974:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56ff65 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497980:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56ff65 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.497985:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762878.497988:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56ff65 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.498007:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56ff65 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.498017:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055dc00) 00010000:00010000:3.0:1789762878.498020:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762878.498024:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56ff65 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.498030:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c56ff65 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.502935:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762878.766865:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762878.766902:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140757760 00000100:00100000:0.0:1789762878.766912:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140757760 00000100:00100000:0.0:1789762878.766963:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:0.0:1789762878.766974:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+26:12851:x1876702140757760:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:0.0:1789762878.766994:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762878.767012:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a600/0xd08452c77c56ff73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e978 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.767065:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ac00/0xd08452c77c56ff7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.767076:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ac00/0xd08452c77c56ff7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.767093:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ac00/0xd08452c77c56ff7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762878.767121:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789762878.767124:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762878.767148:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ac00/0xd08452c77c56ff7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.767166:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a600/0xd08452c77c56ff73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e978 expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.767179:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ac00/0xd08452c77c56ff7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e978 expref: 27 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.767185:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90300) 00010000:00010000:0.0:1789762878.767187:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762878.767189:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15829ac00, rc 0) 00000100:00100000:0.0:1789762878.767253:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+27:12851:x1876702140757760:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 281us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762878.767258:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:1.0:1789762878.768357:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762878.768396:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140758016 00000100:00100000:2.0:1789762878.768402:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140758016 00000100:00100000:2.0:1789762878.768435:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:2.0:1789762878.768443:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+27:12851:x1876702140758016:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:2.0:1789762878.768471:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762878.768497:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ac00/0xd08452c77c56ff7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e978 expref: 27 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.768508:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90300) 00010000:00010000:2.0:1789762878.768517:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762878.768588:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56ff81 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.768599:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56ff81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.768609:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56ff81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.768625:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56ff88 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.768648:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56ff88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.768653:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56ff88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762878.769235:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 16384 00010000:00010000:2.0:1789762878.769243:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56ff81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.769248:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56ff81 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.769253:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56ff81 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.769258:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762878.769261:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56ff81 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.769266:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56ff81 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.769274:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04500) 00010000:00010000:2.0:1789762878.769276:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762878.769279:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56ff81 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.769283:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a8400/0xd08452c77c56ff81 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762878.769303:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f6f7116 reply state 00000000c8623e02 transno 4294967472 ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56ff88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762878.769309:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762878.769351:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+28:12851:x1876702140758016:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 909us (995us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789762878.769357:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 211 00010000:00010000:3.0:1789762878.769889:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56ff88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.769898:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56ff88 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.769903:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56ff88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.769907:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762878.769910:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56ff88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.769914:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56ff88 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.769921:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d142a04600) 00010000:00010000:3.0:1789762878.769923:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762878.769926:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56ff88 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.769937:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d1583a9600/0xd08452c77c56ff88 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762878.774308:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762878.774371:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140758144 00000100:00100000:0.0:1789762878.774378:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140758144 00000100:00100000:0.0:1789762878.774422:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:0.0:1789762878.774432:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+27:12852:x1876702140758144:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789762878.774445:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762878.774458:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a600/0xd08452c77c56ff8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e97f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.774500:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b200/0xd08452c77c56ff96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.774508:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b200/0xd08452c77c56ff96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.774515:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b200/0xd08452c77c56ff96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762878.774530:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789762878.774532:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762878.774542:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b200/0xd08452c77c56ff96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.774556:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a600/0xd08452c77c56ff8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e97f expref: 29 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.774567:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b200/0xd08452c77c56ff96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e97f expref: 28 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.774572:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:0.0:1789762878.774574:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762878.774576:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15829b200, rc 0) 00000100:00100000:0.0:1789762878.774606:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+28:12852:x1876702140758144:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 178us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762878.774611:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:2.0:1789762878.775645:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762878.775681:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140758400 00000100:00100000:1.0:1789762878.775686:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140758400 00000100:00100000:1.0:1789762878.775721:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:1.0:1789762878.775730:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+28:12852:x1876702140758400:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789762878.775739:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762878.775740:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789762878.775753:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b200/0xd08452c77c56ff96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e97f expref: 28 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.775765:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:1.0:1789762878.775775:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762878.775784:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c56ff9d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e986 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.775934:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56ffa4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.775942:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56ffa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.775949:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56ffa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.775962:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56ffab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.775967:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56ffab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.775973:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56ffab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776055:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776066:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776075:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762878.776084:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 16384 00010000:00010000:1.0:1789762878.776097:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776101:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776106:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776110:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043ac00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762878.776113:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776117:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776123:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:1.0:1789762878.776125:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762878.776127:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776141:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776156:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56ffa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776160:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56ffa4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776164:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56ffa4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776168:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762878.776170:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56ffa4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776174:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56ffa4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776179:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:1.0:1789762878.776181:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762878.776183:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56ffa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776187:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56ffa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776192:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56ffab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776197:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56ffab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776207:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56ffab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776211:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043ba00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762878.776213:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56ffab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776217:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56ffab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776222:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d14abf2600) 00010000:00010000:1.0:1789762878.776224:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762878.776226:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56ffab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776229:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56ffab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776247:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c56ff9d lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e986 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776252:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:1.0:1789762878.776254:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762878.776256:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c56ff9d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e986 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.776262:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15043b600, rc 0) 00000100:00100000:1.0:1789762878.776295:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+27:12852:x1876702140758400:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 567us (653us total) trans 0 rc 301/301 00000100:00100000:1.0:1789762878.776313:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:1.0:1789762878.777065:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762878.777100:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140758528 00000100:00100000:0.0:1789762878.777106:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140758528 00000100:00100000:0.0:1789762878.777141:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:0.0:1789762878.777148:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+27:12852:x1876702140758528:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789762878.777157:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762878.777169:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a000/0xd08452c77c56ffb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e98d expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.777195:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b800/0xd08452c77c56ffc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.777202:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b800/0xd08452c77c56ffc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.777208:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b800/0xd08452c77c56ffc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762878.777220:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789762878.777223:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762878.777231:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b800/0xd08452c77c56ffc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.777243:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a000/0xd08452c77c56ffb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e98d expref: 29 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.777253:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b800/0xd08452c77c56ffc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e98d expref: 28 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.777258:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90d00) 00010000:00010000:0.0:1789762878.777260:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762878.777261:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15829b800, rc 0) 00000100:00100000:0.0:1789762878.777291:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+28:12852:x1876702140758528:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 144us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762878.777302:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:2.0:1789762878.778283:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762878.778323:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140758784 00000100:00100000:1.0:1789762878.778330:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140758784 00000100:00100000:1.0:1789762878.778363:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:1.0:1789762878.778370:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+28:12852:x1876702140758784:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789762878.778379:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762878.778387:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a000/0xd08452c77c56ffc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e994 expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778425:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b800/0xd08452c77c56ffce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778437:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b800/0xd08452c77c56ffce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778446:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b800/0xd08452c77c56ffce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778460:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c56ffd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778469:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c56ffd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778487:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c56ffd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762878.778536:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 16384 00010000:00010000:1.0:1789762878.778593:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b800/0xd08452c77c56ffce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778604:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b800/0xd08452c77c56ffce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778609:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b800/0xd08452c77c56ffce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778613:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762878.778615:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b800/0xd08452c77c56ffce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778619:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b800/0xd08452c77c56ffce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778628:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90d00) 00010000:00010000:1.0:1789762878.778630:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762878.778632:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b800/0xd08452c77c56ffce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778636:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b800/0xd08452c77c56ffce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778643:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c56ffd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778647:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c56ffd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778651:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c56ffd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778655:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762878.778663:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c56ffd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778667:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c56ffd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778672:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d14abf2b00) 00010000:00010000:1.0:1789762878.778673:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762878.778675:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c56ffd5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778679:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c56ffd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778700:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a000/0xd08452c77c56ffc7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e994 expref: 30 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778707:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90d00) 00010000:00010000:1.0:1789762878.778708:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789762878.778711:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a000/0xd08452c77c56ffc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e994 expref: 30 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.778719:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15043a000, rc 0) 00000100:00100000:1.0:1789762878.778751:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+29:12852:x1876702140758784:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 382us (469us total) trans 4294967473 rc 301/301 00000100:00100000:1.0:1789762878.778756:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:2.0:1789762878.779524:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.779557:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140759040 00000100:00100000:3.0:1789762878.779562:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140759040 00000100:00100000:3.0:1789762878.779591:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:3.0:1789762878.779599:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+29:12852:x1876702140759040:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:3.0:1789762878.779636:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ffe3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.779645:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ffe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.779651:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ffe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762878.779764:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4377f33 reply state 000000007ce5bb2e transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ffe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762878.779772:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762878.779776:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 16384 00000100:00100000:3.0:1789762878.779817:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+31:12852:x1876702140759040:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 220us (295us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1789762878.780078:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 216 00010000:00010000:3.0:1789762878.780417:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ffe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.780427:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ffe3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.780447:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ffe3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.780506:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762878.780510:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ffe3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.780516:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ffe3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.780524:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff95d15055d900) 00010000:00010000:3.0:1789762878.780526:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789762878.780529:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ffe3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.780534:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c56ffe3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762878.780588:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762878.780623:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140759296 00000100:00100000:1.0:1789762878.780628:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140759296 00000100:00100000:1.0:1789762878.780657:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:1.0:1789762878.780665:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15177f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+30:12852:x1876702140759296:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1789762878.780763:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15177f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+31:12852:x1876702140759296:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 98us (176us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789762878.780769:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1789762878.784399:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762878.784438:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140759424 00000100:00100000:1.0:1789762878.784444:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140759424 00000100:00100000:1.0:1789762878.784484:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:1.0:1789762878.784495:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+31:12853:x1876702140759424:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:1.0:1789762878.784509:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762878.784521:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c56ffea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e99b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784551:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56fff1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784559:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56fff1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784566:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56fff1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784574:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56fff8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784579:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56fff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784585:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56fff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784626:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784639:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784644:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762878.784660:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 16384 00000004:00200000:1.0:1789762878.784662:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762878.784671:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784678:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56fff1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784683:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56fff1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784688:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56fff1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784692:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043ba00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762878.784694:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56fff1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784698:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56fff1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784705:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90d00) 00010000:00010000:1.0:1789762878.784708:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762878.784710:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56fff1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784723:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c56fff1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784732:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56fff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784736:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56fff8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784741:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56fff8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784745:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762878.784747:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56fff8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784751:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56fff8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784757:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d14abf2900) 00010000:00010000:1.0:1789762878.784759:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762878.784761:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56fff8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784765:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c56fff8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784790:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c56ffea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e99b expref: 33 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784804:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e99b expref: 32 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.784815:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff95d14abf2600) 00010000:00010000:1.0:1789762878.784817:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762878.784819:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15043ac00, rc 0) 00000100:00100000:1.0:1789762878.784918:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+32:12853:x1876702140759424:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 426us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762878.784925:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:2.0:1789762878.785916:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762878.785946:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140759680 00000100:00100000:1.0:1789762878.785951:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140759680 00000100:00100000:1.0:1789762878.785978:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:1.0:1789762878.785984:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+32:12853:x1876702140759680:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:1.0:1789762878.786003:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762878.786013:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c56ffff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e99b expref: 32 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.786022:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff95d14abf2600) 00010000:00010000:1.0:1789762878.786028:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762878.786041:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c570006 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.786050:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c570006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.786058:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c570006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762878.786166:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007685cdd5 reply state 0000000081df0883 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c570006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762878.786183:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789762878.786188:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 16384 00000100:00100000:1.0:1789762878.786225:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+33:12853:x1876702140759680:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 241us (312us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789762878.786230:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 218 00010000:00010000:3.0:1789762878.786729:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c570006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.786742:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c570006 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.786750:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c570006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.786757:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762878.786761:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c570006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.786782:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c570006 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.786794:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff95d14abf2b00) 00010000:00010000:3.0:1789762878.786797:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789762878.786802:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c570006 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.786808:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043a600/0xd08452c77c570006 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762878.802203:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762878.802241:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140759808 00000100:00100000:1.0:1789762878.802249:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140759808 00000100:00100000:1.0:1789762878.802294:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:1.0:1789762878.802307:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+32:12859:x1876702140759808:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762878.802327:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762878.802343:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c57000d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9a2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802387:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c570014 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802400:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c570014 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802411:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c570014 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802425:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57001b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802434:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57001b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802441:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57001b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802526:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c570022 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802533:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c570022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802538:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c570022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762878.802558:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 16384 00000004:00200000:1.0:1789762878.802561:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762878.802574:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c570022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802582:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c570014 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802587:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c570014 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802591:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c570014 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802595:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762878.802598:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c570014 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802602:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c570014 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802610:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90d00) 00010000:00010000:1.0:1789762878.802618:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762878.802621:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c570014 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802626:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b600/0xd08452c77c570014 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802634:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57001b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802638:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57001b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802642:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57001b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802645:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762878.802647:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57001b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802651:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57001b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802655:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d14abf2600) 00010000:00010000:1.0:1789762878.802656:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762878.802658:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57001b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802662:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57001b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802681:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ac00/0xd08452c77c57000d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9a2 expref: 34 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802699:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c570022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9a2 expref: 33 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.802705:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:1.0:1789762878.802706:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789762878.802708:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15043ba00, rc 0) 00000100:00100000:1.0:1789762878.802749:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+33:12859:x1876702140759808:12345-192.168.203.31@tcp:101:dd.0 Request processed in 447us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762878.802754:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:1.0:1789762878.803664:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762878.803702:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140760064 00000100:00100000:0.0:1789762878.803708:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140760064 00000100:00100000:0.0:1789762878.803740:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:0.0:1789762878.803748:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+33:12859:x1876702140760064:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762878.803756:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762878.803763:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a600/0xd08452c77c570029 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9a9 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.803818:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ba00/0xd08452c77c570030 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.803877:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ba00/0xd08452c77c570030 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.803884:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ba00/0xd08452c77c570030 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.803930:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c570037 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.803936:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c570037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.803941:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c570037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789762878.804258:0:7603:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe:0x0], index 0: 0 00010000:00010000:0.0:1789762878.804381:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c57003e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.804394:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c57003e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.804399:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c57003e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.804421:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ba00/0xd08452c77c570030 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.804426:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ba00/0xd08452c77c570030 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.804430:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ba00/0xd08452c77c570030 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.804433:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829ba00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762878.804436:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ba00/0xd08452c77c570030 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.804439:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ba00/0xd08452c77c570030 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.804445:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:0.0:1789762878.804447:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762878.804449:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ba00/0xd08452c77c570030 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.804452:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829ba00/0xd08452c77c570030 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762878.804459:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000083897ea reply state 000000006e3ce3d7 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c570037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762878.804470:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789762878.804487:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a600/0xd08452c77c570029 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9a9 expref: 36 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.804495:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c57003e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9a9 expref: 35 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.804500:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:0.0:1789762878.804502:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762878.804503:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15829bc00, rc 0) 00000100:00100000:0.0:1789762878.804534:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+36:12859:x1876702140760064:12345-192.168.203.31@tcp:101:dd.0 Request processed in 788us (871us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789762878.804539:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 220 00010000:00010000:0.0:1789762878.805166:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c570037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.805172:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c570037 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.805177:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c570037 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.805181:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762878.805183:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c570037 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.805187:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c570037 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.805204:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4009f790 (ffff95d151e90a00) 00010000:00010000:0.0:1789762878.805206:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762878.805208:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c570037 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.805212:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829a800/0xd08452c77c570037 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762878.807378:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762878.807423:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140760192 00000100:00100000:0.0:1789762878.807431:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140760192 00000100:00100000:0.0:1789762878.807477:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282872511438 time 282872594181 state 0x0 ref 1 00000100:00100000:0.0:1789762878.807491:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 282922594181 time 282872594181 state 0x1 ref 1 00000100:00100000:0.0:1789762878.807523:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 2 deadline 282922594181 time 283280685245 state 0x0 ref 1 00000100:00100000:0.0:1789762878.807534:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+38:2342:x1876702140760192:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762878.807569:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789762878.807576:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57004c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.807587:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1789762878.807591:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762878.807597:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57004c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.807622:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57004c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762878.839538:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967690 is committed 00002000:00010000:0.0:1789762878.839581:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1789762878.839588:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb mtime from disk: 0 -> 1789762878 00002000:00010000:0.0:1789762878.839591:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb ctime from disk: 0 -> 1789762878 00002000:00010000:0.0:1789762878.839593:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1789762878.839607:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57004c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.839619:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57004c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.839626:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57004c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.839632:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829b600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762878.839636:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57004c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.839643:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57004c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.839658:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57004c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.839675:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57004c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762878.839755:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140760192:12345-192.168.203.31@tcp:4:dd.0 Request processed in 32222us (32381us total) trans 4294967690 rc 0/0 00000100:00100000:0.0:1789762878.839764:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 264 00000100:00100000:0.0:1789762878.839773:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 2 deadline 282922594181 time 283280685245 state 0x2 ref 0 00000100:00100000:2.0:1789762878.851978:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.852032:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140760320 00000100:00100000:3.0:1789762878.852045:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140760320 00000100:00100000:3.0:1789762878.852107:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 2 deadline 282922594181 time 283280685245 state 0x0 ref 1 00000100:00100000:3.0:1789762878.852121:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 2 deadline 283330685245 time 283280685245 state 0x1 ref 1 00000100:00100000:3.0:1789762878.852145:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 1 deadline 283330685245 time 283325307859 state 0x0 ref 1 00000100:00100000:3.0:1789762878.852156:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140760320:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:3.0:1789762878.852204:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 1048576, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x803 00010000:00010000:3.0:1789762878.852213:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570053 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.852229:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:3.0:1789762878.852233:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762878.852247:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.852260:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762878.865576:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:3.0:1789762878.865583:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:3.0:1789762878.865595:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.865605:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570053 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762878.865609:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967691 is committed 00010000:00010000:3.0:1789762878.865613:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570053 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.865621:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762878.865625:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570053 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.865632:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.865650:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570053 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.865656:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570053 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762878.865733:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140760320:12345-192.168.203.31@tcp:4:dd.0 Request processed in 13576us (13759us total) trans 4294967691 rc 0/0 00000100:00100000:3.0:1789762878.865742:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 265 00000100:00100000:3.0:1789762878.865750:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 1 deadline 283330685245 time 283325307859 state 0x2 ref 0 00000100:00100000:1.0:1789762878.867643:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.867683:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140760448 00000100:00100000:3.0:1789762878.867690:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140760448 00000100:00100000:3.0:1789762878.867723:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 1 deadline 283330685245 time 283325307859 state 0x0 ref 1 00000100:00100000:3.0:1789762878.867734:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 1 deadline 283375307859 time 283325307859 state 0x1 ref 1 00000100:00100000:3.0:1789762878.867757:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283375307859 time 283340920012 state 0x0 ref 1 00000100:00100000:3.0:1789762878.867772:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140760448:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:3.0:1789762878.867796:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 2097152, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x1007 00010000:00010000:3.0:1789762878.867802:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c57005a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.867812:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:3.0:1789762878.867815:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762878.867854:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c57005a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.867867:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c57005a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762878.881611:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967692 is committed 00002000:00010000:0.0:1789762878.881667:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1789762878.881673:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1789762878.881686:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c57005a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.881696:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c57005a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.881703:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c57005a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.881708:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762878.881711:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c57005a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.881718:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c57005a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.881740:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c57005a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.881746:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c57005a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762878.881813:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140760448:12345-192.168.203.31@tcp:4:dd.0 Request processed in 14045us (14171us total) trans 4294967692 rc 0/0 00000100:00100000:0.0:1789762878.881881:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 266 00000100:00100000:0.0:1789762878.881895:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283375307859 time 283340920012 state 0x2 ref 0 00000100:00100000:2.0:1789762878.883704:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762878.883777:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140760576 00000100:00100000:0.0:1789762878.883786:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140760576 00000100:00100000:0.0:1789762878.883861:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283375307859 time 283340920012 state 0x0 ref 1 00000100:00100000:0.0:1789762878.883878:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283390920012 time 283340920012 state 0x1 ref 1 00000100:00100000:0.0:1789762878.917818:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283390920012 time 283390968758 state 0x0 ref 1 00000100:00100000:0.0:1789762878.917872:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140760576:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762878.917928:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 3145728, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x1807 00010000:00010000:0.0:1789762878.917936:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570061 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.917961:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1789762878.917964:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762878.917969:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.917979:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762878.931008:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967693 is committed 00002000:00010000:0.0:1789762878.931050:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1789762878.931055:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1789762878.931065:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.931074:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570061 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.931081:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570061 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.931086:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829b600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762878.931089:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570061 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.931096:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570061 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.931121:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570061 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.931127:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570061 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762878.931187:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140760576:12345-192.168.203.31@tcp:4:dd.0 Request processed in 13323us (47483us total) trans 4294967693 rc 0/0 00000100:00100000:0.0:1789762878.931194:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 267 00000100:00100000:0.0:1789762878.931203:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283390920012 time 283390968758 state 0x2 ref 0 00000100:00100000:2.0:1789762878.934014:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762878.934073:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140760704 00000100:00100000:3.0:1789762878.934094:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140760704 00000100:00100000:3.0:1789762878.934172:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283390920012 time 283390968758 state 0x0 ref 1 00000100:00100000:3.0:1789762878.934187:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283440968758 time 283390968758 state 0x1 ref 1 00000100:00100000:0.0:1789762878.967926:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283440968758 time 283441071072 state 0x0 ref 1 00000100:00100000:0.0:1789762878.967956:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140760704:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762878.968006:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 4194304, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x2007 00010000:00010000:0.0:1789762878.968013:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570068 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.968027:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1789762878.968031:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762878.968035:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.968046:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762878.981552:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967694 is committed 00002000:00010000:0.0:1789762878.981601:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1789762878.981608:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1789762878.981619:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.981629:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.981636:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.981641:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829b600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762878.981644:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.981651:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.981666:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570068 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.981671:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570068 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762878.981743:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140760704:12345-192.168.203.31@tcp:4:dd.0 Request processed in 13795us (47732us total) trans 4294967694 rc 0/0 00000100:00100000:0.0:1789762878.981758:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 268 00000100:00100000:0.0:1789762878.981767:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283440968758 time 283441071072 state 0x2 ref 0 00000100:00100000:2.0:1789762878.984027:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762878.984061:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140760832 00000100:00100000:0.0:1789762878.984070:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140760832 00000100:00100000:0.0:1789762878.984109:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283440968758 time 283441071072 state 0x0 ref 1 00000100:00100000:0.0:1789762878.984120:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283491071072 time 283441071072 state 0x1 ref 1 00000100:00100000:0.0:1789762879.017957:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283491071072 time 283491112793 state 0x0 ref 1 00000100:00100000:0.0:1789762879.017987:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140760832:12345-192.168.203.31@tcp:4:dd.0 00000100:00080000:2.0:1789762879.018023:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789762879.018027:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 5242880, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x2807 00010000:00010000:0.0:1789762879.018034:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57006f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.018047:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1789762879.018050:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.018054:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57006f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.018066:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57006f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.032244:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967695 is committed 00002000:00010000:0.0:1789762879.032254:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1789762879.032266:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1789762879.032275:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57006f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.032284:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57006f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.032291:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57006f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.032295:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829b600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.032298:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57006f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.032305:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57006f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.032318:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57006f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.032323:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57006f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.032379:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140760832:12345-192.168.203.31@tcp:4:dd.0 Request processed in 14408us (48352us total) trans 4294967695 rc 0/0 00000100:00100000:0.0:1789762879.032387:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 269 00000100:00100000:0.0:1789762879.032395:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283491071072 time 283491112793 state 0x2 ref 0 00000100:00100000:2.0:1789762879.034503:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762879.034551:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140760960 00000100:00100000:3.0:1789762879.034565:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140760960 00000100:00100000:3.0:1789762879.034619:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283491071072 time 283491112793 state 0x0 ref 1 00000100:00100000:3.0:1789762879.034632:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283541112793 time 283491112793 state 0x1 ref 1 00000100:00100000:0.0:1789762879.068050:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283541112793 time 283541202482 state 0x0 ref 1 00000100:00100000:0.0:1789762879.068072:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140760960:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.068114:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 6291456, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x3007 00010000:00010000:0.0:1789762879.068121:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570076 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.068133:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1789762879.068137:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.068142:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.068152:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.081288:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967696 is committed 00002000:00010000:0.0:1789762879.081294:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1789762879.081301:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1789762879.081314:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.081325:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.081332:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570076 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.081348:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829b600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.081352:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570076 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.081359:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.081372:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570076 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.081376:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c570076 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.081433:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140760960:12345-192.168.203.31@tcp:4:dd.0 Request processed in 13366us (46927us total) trans 4294967696 rc 0/0 00000100:00100000:0.0:1789762879.081445:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 270 00000100:00100000:0.0:1789762879.081457:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283541112793 time 283541202482 state 0x2 ref 0 00000100:00100000:1.0:1789762879.083474:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762879.083509:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140761088 00000100:00100000:0.0:1789762879.083516:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140761088 00000100:00100000:0.0:1789762879.083556:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283541112793 time 283541202482 state 0x0 ref 1 00000100:00100000:0.0:1789762879.083571:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283591202482 time 283541202482 state 0x1 ref 1 00000100:00100000:0.0:1789762879.118105:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283591202482 time 283591260153 state 0x0 ref 1 00000100:00100000:0.0:1789762879.118130:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140761088:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.118162:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 7340032, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x3807 00010000:00010000:0.0:1789762879.118169:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57007d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.118180:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1789762879.118183:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.118187:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57007d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.118197:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57007d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762879.132485:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967697 is committed 00002000:00010000:0.0:1789762879.132500:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:0.0:1789762879.132507:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1789762879.132518:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57007d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.132527:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57007d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.132534:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57007d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.132538:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829b600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.132549:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57007d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.132556:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57007d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.132570:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57007d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.132575:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e64e430c/0xd08452c77c57007d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.132635:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140761088:12345-192.168.203.31@tcp:4:dd.0 Request processed in 14507us (49161us total) trans 4294967697 rc 0/0 00000100:00100000:0.0:1789762879.132643:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 271 00000100:00100000:0.0:1789762879.132652:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283591202482 time 283591260153 state 0x2 ref 0 00000100:00100000:1.0:1789762879.134728:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762879.134779:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140761216 00000100:00100000:3.0:1789762879.134793:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140761216 00000100:00100000:3.0:1789762879.134895:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283591202482 time 283591260153 state 0x0 ref 1 00000100:00100000:3.0:1789762879.134912:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283641260153 time 283591260153 state 0x1 ref 1 00000001:00080000:2.0:1789762879.152972:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967477 is committed 00000004:00080000:2.0:1789762879.153009:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000004:00080000:2.0:1789762879.153022:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000100:00100000:3.0:1789762879.153155:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149031168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789762879.153161:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149031040:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789762879.153233:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762879.153275:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149031168 00000100:00100000:2.0:1789762879.153283:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762879.153284:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149031168 00000100:00100000:1.0:1789762879.153336:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149031040 00000100:00100000:1.0:1789762879.153341:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149031040 00000100:00080000:2.0:1789762879.153359:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762879.153361:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1789762879.153369:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762879.153382:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149031168:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789762879.153386:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789762879.153403:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149031040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789762879.153410:0:6655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:9 count 1 00002000:00010000:0.0:1789762879.153442:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 8388608, mtime: 0x6aad9d3d, atime: 0x0, ctime: 0x6aad9d3d, blocks: 0x1 00002000:00080000:3.0:1789762879.153444:0:10283:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:13 count 1 00010000:00010000:0.0:1789762879.153458:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e64e430c/0xd08452c77c570084 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.153475:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=283s v=(0 0) 00002000:00010000:3.0:1789762879.153476:0:10283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 8388608, mtime: 0x6aad9d3c, atime: 0x0, ctime: 0x6aad9d3c, blocks: 0x4007 00010000:00010000:3.0:1789762879.153483:0:10283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c57008b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.153488:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.153510:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e64e430c/0xd08452c77c570084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762879.153516:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=283s v=(0 0) 00010000:00010000:3.0:1789762879.153521:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.153526:0:6655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e64e430c/0xd08452c77c570084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762879.153527:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c57008b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.153571:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e64e430c/0xd08452c77c570084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762879.153575:0:10283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c57008b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.153579:0:6655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e64e430c/0xd08452c77c570084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762879.153604:0:10283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c57008b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762879.153612:0:10283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c57008b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.153616:0:6655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762879.153635:0:10283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789762879.153637:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789762879.153645:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e64e430c/0xd08452c77c570084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.153656:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829b600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762879.153661:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e64e430c/0xd08452c77c570084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.153670:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e64e430c/0xd08452c77c570084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.153673:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762879.153683:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c57008b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.153697:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e64e430c/0xd08452c77c570084 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.153697:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762879.153704:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c57008b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.153707:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e64e430c/0xd08452c77c570084 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.153733:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c57008b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.153752:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762879.153756:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c57008b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.153759:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762879.153763:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762879.153770:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c57008b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.153790:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762879.153793:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762879.153795:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762879.154467:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149031168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1092us (1229us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789762879.154479:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000004:00080000:2.0:1789762879.154520:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d148cd6300/2, rc 0, transno 4294967379 00000100:00100000:2.0:1789762879.154535:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149031168:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789762879.154564:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149031040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1163us (1283us total) trans 4294967698 rc 0/0 00000100:00100000:3.0:1789762879.154570:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000004:00080000:0.0:1789762879.154576:0:3276:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d148df0e00/2, rc 0, transno 4294967698 00000100:00100000:0.0:1789762879.154590:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149031040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789762879.168207:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283641260153 time 283641361404 state 0x0 ref 1 00000100:00100000:0.0:1789762879.168222:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140761216:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.168254:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 8388608, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x4007 00010000:00010000:0.0:1789762879.168260:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570092 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.168282:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1789762879.168284:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.168288:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.168297:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762879.182288:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 8388608 -> 9437184 00000001:00080000:2.0:1789762879.182292:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967699 is committed 00002000:00010000:0.0:1789762879.182294:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:0.0:1789762879.182305:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.182315:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570092 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.182316:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967698 is committed 00010000:00010000:0.0:1789762879.182326:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.182332:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.182336:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.182342:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570092 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.182366:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570092 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.182372:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570092 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.182433:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140761216:12345-192.168.203.31@tcp:4:dd.0 Request processed in 14212us (47703us total) trans 4294967699 rc 0/0 00000100:00100000:0.0:1789762879.182441:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 272 00000100:00100000:0.0:1789762879.182450:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283641260153 time 283641361404 state 0x2 ref 0 00000100:00100000:2.0:1789762879.184550:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762879.184591:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140761344 00000100:00100000:0.0:1789762879.184599:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140761344 00000100:00100000:0.0:1789762879.184636:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283641260153 time 283641361404 state 0x0 ref 1 00000100:00100000:0.0:1789762879.184647:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283691361404 time 283641361404 state 0x1 ref 1 00000100:00100000:0.0:1789762879.218246:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283691361404 time 283691403018 state 0x0 ref 1 00000100:00100000:0.0:1789762879.218263:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140761344:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.218297:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 9437184, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x4807 00010000:00010000:0.0:1789762879.218304:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570099 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.218326:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1789762879.218329:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.218334:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570099 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.218343:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570099 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762879.230530:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:2.0:1789762879.230537:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:2.0:1789762879.230548:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570099 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.230560:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570099 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.230569:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570099 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.230578:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762879.230583:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570099 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.230593:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570099 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.230610:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570099 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.230618:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda27f45/0xd08452c77c570099 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762879.230687:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140761344:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12425us (46135us total) trans 4294967700 rc 0/0 00000100:00100000:2.0:1789762879.230708:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 273 00000100:00100000:2.0:1789762879.230719:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283691361404 time 283691403018 state 0x2 ref 0 00000001:00080000:2.0:1789762879.230758:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967700 is committed 00000100:00100000:1.0:1789762879.232758:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762879.232813:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140761472 00000100:00100000:3.0:1789762879.232857:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140761472 00000100:00100000:3.0:1789762879.232916:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283691361404 time 283691403018 state 0x0 ref 1 00000100:00100000:3.0:1789762879.232941:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283741403018 time 283691403018 state 0x1 ref 1 00000100:00100000:0.0:1789762879.268336:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283741403018 time 283741489541 state 0x0 ref 1 00000100:00100000:0.0:1789762879.268355:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140761472:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.268394:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 10485760, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x5007 00010000:00010000:0.0:1789762879.268401:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.268413:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1789762879.268416:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.268422:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.268436:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.279457:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967701 is committed 00002000:00010000:0.0:1789762879.279474:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:0.0:1789762879.279480:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 20487 -> 22535 00010000:00010000:0.0:1789762879.279497:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.279506:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.279512:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.279517:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.279521:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.279527:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.279540:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.279545:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.279601:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140761472:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11249us (46842us total) trans 4294967701 rc 0/0 00000100:00100000:0.0:1789762879.279609:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 274 00000100:00100000:0.0:1789762879.279618:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283741403018 time 283741489541 state 0x2 ref 0 00000100:00100000:1.0:1789762879.281551:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762879.281589:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140761600 00000100:00100000:0.0:1789762879.281599:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140761600 00000100:00100000:0.0:1789762879.281643:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283741403018 time 283741489541 state 0x0 ref 1 00000100:00100000:0.0:1789762879.281659:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283791489541 time 283741489541 state 0x1 ref 1 00000100:00100000:2.0:1789762879.318417:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283791489541 time 283791569668 state 0x0 ref 1 00000100:00100000:2.0:1789762879.318440:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140761600:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762879.318488:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 11534336, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x5807 00010000:00010000:2.0:1789762879.318498:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c5700a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.318515:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:2.0:1789762879.318520:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762879.318525:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c5700a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.318536:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c5700a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.329798:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967702 is committed 00002000:00010000:0.0:1789762879.329873:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:0.0:1789762879.329880:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 22535 -> 24583 00010000:00010000:0.0:1789762879.329894:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c5700a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.329907:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c5700a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.329915:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c5700a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.329920:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.329923:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c5700a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.329930:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c5700a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.329944:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c5700a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.329960:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c5700a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.330022:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140761600:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11588us (48469us total) trans 4294967702 rc 0/0 00000100:00100000:0.0:1789762879.330030:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 275 00000100:00100000:0.0:1789762879.330039:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283791489541 time 283791569668 state 0x2 ref 0 00000100:00100000:1.0:1789762879.333244:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762879.333293:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140761728 00000100:00100000:3.0:1789762879.333303:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140761728 00000100:00100000:3.0:1789762879.333345:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283791489541 time 283791569668 state 0x0 ref 1 00000100:00100000:3.0:1789762879.333356:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283841569668 time 283791569668 state 0x1 ref 1 00000100:00100000:0.0:1789762879.368505:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283841569668 time 283841655962 state 0x0 ref 1 00000100:00100000:0.0:1789762879.368529:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140761728:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.368577:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 12582912, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x6007 00010000:00010000:0.0:1789762879.368585:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.368601:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1789762879.368605:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.368611:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.368625:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762879.380227:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967703 is committed 00002000:00010000:0.0:1789762879.380248:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:0.0:1789762879.380261:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 24583 -> 26631 00010000:00010000:0.0:1789762879.380274:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.380287:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.380296:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.380304:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.380309:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.380319:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.380339:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.380346:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.380411:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140761728:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11887us (47165us total) trans 4294967703 rc 0/0 00000100:00100000:0.0:1789762879.380419:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 276 00000100:00100000:0.0:1789762879.380428:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283841569668 time 283841655962 state 0x2 ref 0 00000100:00100000:2.0:1789762879.382452:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762879.382520:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140761856 00000100:00100000:0.0:1789762879.382528:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140761856 00000100:00100000:0.0:1789762879.382567:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283841569668 time 283841655962 state 0x0 ref 1 00000100:00100000:0.0:1789762879.382578:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283891655962 time 283841655962 state 0x1 ref 1 00000100:00100000:0.0:1789762879.418559:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283891655962 time 283891714985 state 0x0 ref 1 00000100:00100000:0.0:1789762879.418575:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140761856:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.418612:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 13631488, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x6807 00010000:00010000:0.0:1789762879.418618:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.418630:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1789762879.418634:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.418638:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.418648:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762879.428737:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967704 is committed 00002000:00010000:0.0:1789762879.428745:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:0.0:1789762879.428749:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 26631 -> 28679 00010000:00010000:0.0:1789762879.428760:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.428786:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.428796:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.428801:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.428805:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.428812:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.428855:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.428862:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.428915:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140761856:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10342us (46461us total) trans 4294967704 rc 0/0 00000100:00100000:0.0:1789762879.428923:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 277 00000100:00100000:0.0:1789762879.428932:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283891655962 time 283891714985 state 0x2 ref 0 00000100:00100000:1.0:1789762879.430908:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762879.430953:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140761984 00000100:00100000:3.0:1789762879.430960:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140761984 00000100:00100000:3.0:1789762879.430997:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283891655962 time 283891714985 state 0x0 ref 1 00000100:00100000:3.0:1789762879.431008:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283941714985 time 283891714985 state 0x1 ref 1 00000100:00100000:0.0:1789762879.468664:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283941714985 time 283941817483 state 0x0 ref 1 00000100:00100000:0.0:1789762879.468695:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140761984:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.468735:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 14680064, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x7007 00010000:00010000:0.0:1789762879.468742:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.468754:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1789762879.468757:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.468761:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.468772:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.479280:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967705 is committed 00002000:00010000:0.0:1789762879.479298:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:0.0:1789762879.479304:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 28679 -> 30727 00010000:00010000:0.0:1789762879.479317:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.479330:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.479338:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.479343:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.479352:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.479359:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.479372:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.479377:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.479431:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140761984:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10740us (48522us total) trans 4294967705 rc 0/0 00000100:00100000:0.0:1789762879.479439:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 278 00000100:00100000:0.0:1789762879.479448:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283941714985 time 283941817483 state 0x2 ref 0 00000100:00100000:2.0:1789762879.481586:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762879.481624:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140762112 00000100:00100000:0.0:1789762879.481632:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140762112 00000100:00100000:0.0:1789762879.481669:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283941714985 time 283941817483 state 0x0 ref 1 00000100:00100000:0.0:1789762879.481679:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283991817483 time 283941817483 state 0x1 ref 1 00000100:00100000:0.0:1789762879.518721:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283991817483 time 283991876768 state 0x0 ref 1 00000100:00100000:0.0:1789762879.518739:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140762112:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.518782:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 15728640, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x7807 00010000:00010000:0.0:1789762879.518788:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.518799:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1789762879.518803:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.518806:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.518831:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.527027:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789762879.530019:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967706 is committed 00002000:00010000:0.0:1789762879.530040:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:0.0:1789762879.530045:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 30727 -> 32775 00010000:00010000:0.0:1789762879.530056:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.530067:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.530073:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.530078:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.530082:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.530098:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.530115:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.530120:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.530188:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140762112:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11452us (48600us total) trans 4294967706 rc 0/0 00000100:00100000:0.0:1789762879.530197:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 279 00000100:00100000:0.0:1789762879.530206:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283991817483 time 283991876768 state 0x2 ref 0 00000100:00100000:1.0:1789762879.532524:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762879.532567:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140762240 00000100:00100000:3.0:1789762879.532576:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140762240 00000100:00100000:3.0:1789762879.532615:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 283991817483 time 283991876768 state 0x0 ref 1 00000100:00100000:3.0:1789762879.532626:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284041876768 time 283991876768 state 0x1 ref 1 00000100:00100000:0.0:1789762879.568829:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284041876768 time 284041969036 state 0x0 ref 1 00000100:00100000:0.0:1789762879.568880:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140762240:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.568930:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 16777216, mtime: 0x6aad9d3e, atime: 0x0, ctime: 0x6aad9d3e, blocks: 0x8007 00010000:00010000:0.0:1789762879.568939:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.568954:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789762879.568959:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.568965:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.568992:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.580622:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967707 is committed 00002000:00010000:0.0:1789762879.580647:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:0.0:1789762879.580653:0:11723:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb mtime from disk: 1789762878 -> 1789762879 00002000:00010000:0.0:1789762879.580656:0:11723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb ctime from disk: 1789762878 -> 1789762879 00002000:00010000:0.0:1789762879.580659:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 32775 -> 34823 00010000:00010000:0.0:1789762879.580671:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.580683:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.580692:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.580700:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.580705:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.580714:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.580733:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.580755:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.580871:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140762240:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11967us (48312us total) trans 4294967707 rc 0/0 00000100:00100000:0.0:1789762879.580882:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 280 00000100:00100000:0.0:1789762879.580895:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284041876768 time 284041969036 state 0x2 ref 0 00000100:00100000:1.0:1789762879.583036:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762879.583075:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140762368 00000100:00100000:0.0:1789762879.583084:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140762368 00000100:00100000:0.0:1789762879.583126:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284041876768 time 284041969036 state 0x0 ref 1 00000100:00100000:0.0:1789762879.583141:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284091969036 time 284041969036 state 0x1 ref 1 00000100:00100000:0.0:1789762879.618882:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284091969036 time 284092036283 state 0x0 ref 1 00000100:00100000:0.0:1789762879.618901:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140762368:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.618940:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 17825792, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0x8807 00010000:00010000:0.0:1789762879.618949:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.618962:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789762879.618966:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.618972:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.618993:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.630153:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967708 is committed 00002000:00010000:0.0:1789762879.630180:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:0.0:1789762879.630185:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 34823 -> 36871 00010000:00010000:0.0:1789762879.630195:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.630206:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.630215:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.630223:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.630228:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.630237:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.630254:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.630263:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.630329:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140762368:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11431us (47292us total) trans 4294967708 rc 0/0 00000100:00100000:0.0:1789762879.630339:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 281 00000100:00100000:0.0:1789762879.630350:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284091969036 time 284092036283 state 0x2 ref 0 00000100:00100000:2.0:1789762879.632275:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762879.632315:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140762496 00000100:00100000:3.0:1789762879.632323:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140762496 00000100:00100000:3.0:1789762879.632357:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284091969036 time 284092036283 state 0x0 ref 1 00000100:00100000:3.0:1789762879.632376:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284142036283 time 284092036283 state 0x1 ref 1 00000100:00100000:0.0:1789762879.668968:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284142036283 time 284142119401 state 0x0 ref 1 00000100:00100000:0.0:1789762879.668989:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140762496:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.669033:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 18874368, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0x9007 00010000:00010000:0.0:1789762879.669041:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.669055:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789762879.669059:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.669065:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.669079:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.679781:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967709 is committed 00002000:00010000:0.0:1789762879.679797:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:0.0:1789762879.679802:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 36871 -> 38919 00010000:00010000:0.0:1789762879.679811:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.679859:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.679866:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.679871:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.679875:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.679881:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.679895:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.679900:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.679951:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140762496:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10967us (47675us total) trans 4294967709 rc 0/0 00000100:00100000:0.0:1789762879.679959:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 282 00000100:00100000:0.0:1789762879.679967:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284142036283 time 284142119401 state 0x2 ref 0 00000100:00100000:2.0:1789762879.681963:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762879.681995:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140762624 00000100:00100000:0.0:1789762879.682006:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140762624 00000100:00100000:0.0:1789762879.682038:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284142036283 time 284142119401 state 0x0 ref 1 00000100:00100000:0.0:1789762879.682048:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284192119401 time 284142119401 state 0x1 ref 1 00000100:00100000:0.0:1789762879.719017:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284192119401 time 284192172253 state 0x0 ref 1 00000100:00100000:0.0:1789762879.719033:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140762624:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.719066:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 19922944, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0x9807 00010000:00010000:0.0:1789762879.719072:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700df lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.719083:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789762879.719086:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.719090:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.719100:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762879.730055:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967710 is committed 00002000:00010000:0.0:1789762879.730079:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:0.0:1789762879.730094:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 38919 -> 40967 00010000:00010000:0.0:1789762879.730112:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.730127:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.730148:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.730157:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.730163:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.730174:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.730190:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700df lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.730196:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700df lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.730268:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140762624:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11235us (48302us total) trans 4294967710 rc 0/0 00000100:00100000:0.0:1789762879.730275:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 283 00000100:00100000:0.0:1789762879.730285:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284192119401 time 284192172253 state 0x2 ref 0 00000100:00100000:1.0:1789762879.732492:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762879.732529:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140762752 00000100:00100000:3.0:1789762879.732537:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140762752 00000100:00100000:3.0:1789762879.732573:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284192119401 time 284192172253 state 0x0 ref 1 00000100:00100000:3.0:1789762879.732584:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284242172253 time 284192172253 state 0x1 ref 1 00000100:00100000:0.0:1789762879.769113:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284242172253 time 284242261441 state 0x0 ref 1 00000100:00100000:0.0:1789762879.769139:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140762752:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.769204:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 20971520, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0xa007 00010000:00010000:0.0:1789762879.769213:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.769228:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789762879.769233:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.769239:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.769254:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.779968:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967711 is committed 00002000:00010000:0.0:1789762879.779979:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:0.0:1789762879.779984:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 40967 -> 43015 00010000:00010000:0.0:1789762879.779996:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.780006:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.780014:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.780019:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.780022:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.780038:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.780053:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.780058:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.780118:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140762752:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10988us (47625us total) trans 4294967711 rc 0/0 00000100:00100000:0.0:1789762879.780126:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 284 00000100:00100000:0.0:1789762879.780136:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284242172253 time 284242261441 state 0x2 ref 0 00000100:00100000:2.0:1789762879.782234:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762879.782270:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140762880 00000100:00100000:0.0:1789762879.782278:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140762880 00000100:00100000:0.0:1789762879.782317:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284242172253 time 284242261441 state 0x0 ref 1 00000100:00100000:0.0:1789762879.782328:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284292261441 time 284242261441 state 0x1 ref 1 00000100:00100000:0.0:1789762879.819172:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284292261441 time 284292326467 state 0x0 ref 1 00000100:00100000:0.0:1789762879.819190:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140762880:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.819228:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 22020096, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0xa807 00010000:00010000:0.0:1789762879.819245:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.819258:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789762879.819261:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.819266:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.819277:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.832399:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967712 is committed 00002000:00010000:0.0:1789762879.832408:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:0.0:1789762879.832413:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 43015 -> 45063 00010000:00010000:0.0:1789762879.832425:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.832436:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.832443:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.832448:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.832452:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.832459:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.832481:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.832487:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.832547:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140762880:12345-192.168.203.31@tcp:4:dd.0 Request processed in 13360us (50311us total) trans 4294967712 rc 0/0 00000100:00100000:0.0:1789762879.832555:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 285 00000100:00100000:0.0:1789762879.832565:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284292261441 time 284292326467 state 0x2 ref 0 00000100:00100000:2.0:1789762879.834873:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762879.834914:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140763008 00000100:00100000:3.0:1789762879.834922:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140763008 00000100:00100000:3.0:1789762879.834962:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284292261441 time 284292326467 state 0x0 ref 1 00000100:00100000:3.0:1789762879.834973:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284342326467 time 284292326467 state 0x1 ref 1 00000100:00100000:0.0:1789762879.869269:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284342326467 time 284342420374 state 0x0 ref 1 00000100:00100000:0.0:1789762879.869293:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140763008:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.869350:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 23068672, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0xb007 00010000:00010000:0.0:1789762879.869358:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.869371:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789762879.869375:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.869381:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.869397:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.880985:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967713 is committed 00002000:00010000:0.0:1789762879.881000:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:0.0:1789762879.881006:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 45063 -> 47111 00010000:00010000:0.0:1789762879.881017:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.881028:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.881035:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.881041:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.881044:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.881050:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.881063:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.881068:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.881127:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140763008:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11841us (46253us total) trans 4294967713 rc 0/0 00000100:00100000:0.0:1789762879.881141:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 286 00000100:00100000:0.0:1789762879.881151:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284342326467 time 284342420374 state 0x2 ref 0 00000100:00100000:1.0:1789762879.883451:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762879.883520:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140763136 00000100:00100000:0.0:1789762879.883528:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140763136 00000100:00100000:0.0:1789762879.883573:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284342326467 time 284342420374 state 0x0 ref 1 00000100:00100000:0.0:1789762879.883583:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284392420374 time 284342420374 state 0x1 ref 1 00000100:00100000:0.0:1789762879.919336:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284392420374 time 284392487265 state 0x0 ref 1 00000100:00100000:0.0:1789762879.919359:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140763136:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.919406:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 24117248, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0xb807 00010000:00010000:0.0:1789762879.919413:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.919426:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789762879.919430:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.919435:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.919446:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.931486:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967714 is committed 00002000:00010000:0.0:1789762879.931619:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:0.0:1789762879.931633:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 47111 -> 49159 00010000:00010000:0.0:1789762879.931650:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.931664:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.931674:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.931683:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762879.931689:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.931699:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.931719:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.931728:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c5700fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.931885:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140763136:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12527us (48428us total) trans 4294967714 rc 0/0 00000100:00100000:0.0:1789762879.931897:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 287 00000100:00100000:0.0:1789762879.931911:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284392420374 time 284392487265 state 0x2 ref 0 00000100:00100000:2.0:1789762879.934473:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762879.934509:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140763264 00000100:00100000:3.0:1789762879.934518:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140763264 00000100:00100000:3.0:1789762879.934578:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284392420374 time 284392487265 state 0x0 ref 1 00000100:00100000:3.0:1789762879.934593:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284442487265 time 284392487265 state 0x1 ref 1 00000100:00100000:0.0:1789762879.969414:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284442487265 time 284442564186 state 0x0 ref 1 00000100:00100000:0.0:1789762879.969437:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140763264:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762879.969489:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 25165824, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0xc007 00010000:00010000:0.0:1789762879.969500:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c570102 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.969516:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789762879.969520:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.969525:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c570102 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.969537:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c570102 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762879.980358:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967715 is committed 00002000:00010000:1.0:1789762879.980377:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:1.0:1789762879.980382:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 49159 -> 51207 00010000:00010000:1.0:1789762879.980394:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c570102 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.980404:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c570102 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.980421:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c570102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.980426:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762879.980430:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c570102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.980436:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c570102 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.980450:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c570102 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.980456:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076588254/0xd08452c77c570102 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762879.980517:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140763264:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11087us (46044us total) trans 4294967715 rc 0/0 00000100:00100000:1.0:1789762879.980525:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 288 00000100:00100000:1.0:1789762879.980535:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284442487265 time 284442564186 state 0x2 ref 0 00000100:00100000:2.0:1789762879.982639:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762879.982693:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140763392 00000100:00100000:0.0:1789762879.982701:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140763392 00000100:00100000:0.0:1789762879.982737:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284442487265 time 284442564186 state 0x0 ref 1 00000100:00100000:0.0:1789762879.982748:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284492564186 time 284442564186 state 0x1 ref 1 00000100:00100000:0.0:1789762880.019475:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284492564186 time 284492618412 state 0x0 ref 1 00000100:00100000:0.0:1789762880.019498:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140763392:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762880.019563:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 26214400, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0xc807 00010000:00010000:0.0:1789762880.019570:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f68fbfa6/0xd08452c77c570109 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.019584:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789762880.019588:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762880.019592:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f68fbfa6/0xd08452c77c570109 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.019603:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f68fbfa6/0xd08452c77c570109 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762880.031347:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967716 is committed 00002000:00010000:1.0:1789762880.031397:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:1.0:1789762880.031402:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 51207 -> 53255 00010000:00010000:1.0:1789762880.031413:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f68fbfa6/0xd08452c77c570109 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.031435:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f68fbfa6/0xd08452c77c570109 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.031442:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f68fbfa6/0xd08452c77c570109 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.031446:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829ba00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762880.031450:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f68fbfa6/0xd08452c77c570109 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.031457:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f68fbfa6/0xd08452c77c570109 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.031470:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f68fbfa6/0xd08452c77c570109 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.031475:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f68fbfa6/0xd08452c77c570109 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762880.031538:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140763392:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12046us (48898us total) trans 4294967716 rc 0/0 00000100:00100000:1.0:1789762880.031548:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 289 00000100:00100000:1.0:1789762880.031557:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284492564186 time 284492618412 state 0x2 ref 0 00000100:00100000:1.0:1789762880.033492:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762880.033541:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140763520 00000100:00100000:3.0:1789762880.033549:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140763520 00000100:00100000:3.0:1789762880.033594:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284492564186 time 284492618412 state 0x0 ref 1 00000100:00100000:3.0:1789762880.033609:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284542618412 time 284492618412 state 0x1 ref 1 00000100:00100000:1.0:1789762880.069555:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284542618412 time 284542706653 state 0x0 ref 1 00000100:00100000:1.0:1789762880.069576:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140763520:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762880.069622:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 27262976, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0xd007 00010000:00010000:1.0:1789762880.069629:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570110 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.069642:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:1.0:1789762880.069645:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762880.069650:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570110 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.069661:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570110 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762880.079729:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967717 is committed 00002000:00010000:1.0:1789762880.079756:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:1.0:1789762880.079762:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 53255 -> 55303 00010000:00010000:1.0:1789762880.079773:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570110 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.079787:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570110 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.079798:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570110 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.079830:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762880.079851:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570110 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.079863:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570110 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.079881:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570110 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.079890:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570110 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762880.079951:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140763520:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10380us (46457us total) trans 4294967717 rc 0/0 00000100:00100000:1.0:1789762880.079962:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 290 00000100:00100000:1.0:1789762880.079971:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284542618412 time 284542706653 state 0x2 ref 0 00000100:00100000:1.0:1789762880.081891:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762880.081940:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140763648 00000100:00100000:0.0:1789762880.081948:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140763648 00000100:00100000:0.0:1789762880.081983:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284542618412 time 284542706653 state 0x0 ref 1 00000100:00100000:0.0:1789762880.081993:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284592706653 time 284542706653 state 0x1 ref 1 00000100:00100000:1.0:1789762880.119660:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284592706653 time 284592809015 state 0x0 ref 1 00000100:00100000:1.0:1789762880.119684:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140763648:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762880.119735:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 28311552, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0xd807 00010000:00010000:1.0:1789762880.119755:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570117 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.119769:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:1.0:1789762880.119774:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762880.119782:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570117 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.119798:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570117 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762880.130991:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 28311552 -> 29360128 00000001:00080000:3.0:1789762880.130991:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967718 is committed 00002000:00010000:0.0:1789762880.130999:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 55303 -> 57351 00010000:00010000:0.0:1789762880.131011:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570117 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.131021:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570117 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.131028:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570117 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.131040:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762880.131045:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570117 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.131056:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570117 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.131076:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570117 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.131086:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004942c08a/0xd08452c77c570117 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762880.131153:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140763648:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11475us (49262us total) trans 4294967718 rc 0/0 00000100:00100000:0.0:1789762880.131162:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 291 00000100:00100000:0.0:1789762880.131172:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284592706653 time 284592809015 state 0x2 ref 0 00000100:00100000:1.0:1789762880.133238:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762880.133279:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140763776 00000100:00100000:3.0:1789762880.133288:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140763776 00000100:00100000:3.0:1789762880.133325:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284592706653 time 284592809015 state 0x0 ref 1 00000100:00100000:3.0:1789762880.133336:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284642809015 time 284592809015 state 0x1 ref 1 00000004:00080000:2.0:1789762880.166978:0:8167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 284640141582ns, next at 285640138390ns, rc = 0 00000100:00100000:0.0:1789762880.166998:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149031680:0@lo:400:kworker.0 00000100:00100000:1.0:1789762880.166999:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149031424:0@lo:400:kworker.0 00000100:00100000:2.0:1789762880.167008:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d042b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149031552:0@lo:400:kworker.0 00000100:00100000:3.0:1789762880.167034:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d160030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149031296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762880.167082:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762880.167084:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762880.167089:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762880.167120:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149031552 00000100:00100000:0.0:1789762880.167128:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149031552 00000100:00100000:3.0:1789762880.167162:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149031808:0@lo:400:kworker.0 00000100:00100000:1.0:1789762880.167168:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149031936:0@lo:400:kworker.0 00000100:00100000:2.0:1789762880.167171:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149032064:0@lo:400:kworker.0 00000100:00100000:0.0:1789762880.167178:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789762880.167191:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149031552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762880.167216:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762880.167216:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762880.167255:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149031936 00000100:00100000:2.0:1789762880.167261:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149031936 00000100:00100000:0.0:1789762880.167277:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149031552:12345-0@lo:400:kworker.0 Request processed in 87us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762880.167286:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149031424 00000100:00100000:1.0:1789762880.167291:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149031424 00000100:00100000:3.0:1789762880.167294:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149031808 00000100:00100000:3.0:1789762880.167301:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149031808 00000100:00100000:0.0:1789762880.167309:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789762880.167318:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789762880.167329:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789762880.167331:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149031936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762880.167340:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789762880.167346:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149031424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762880.167353:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149031808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762880.167380:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149031936:12345-0@lo:400:kworker.0 Request processed in 53us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762880.167388:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:0.0:1789762880.167396:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762880.167410:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149031424:12345-0@lo:400:kworker.0 Request processed in 69us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762880.167417:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149031808:12345-0@lo:400:kworker.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762880.167421:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789762880.167429:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762880.167433:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789762880.167435:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149031936:0@lo:400:kworker.0 00000100:00100000:3.0:1789762880.167463:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149031296 00000100:00100000:0.0:1789762880.167465:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149031424:0@lo:400:kworker.0 00000100:00100000:3.0:1789762880.167467:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149031296 00000100:00100000:1.0:1789762880.167477:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149031680 00000100:00100000:2.0:1789762880.167482:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762880.167484:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149031680 00000100:00100000:3.0:1789762880.167502:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1789762880.167507:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762880.167516:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149031296:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762880.167532:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789762880.167532:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149031552:0@lo:400:kworker.0 00002000:00000024:3.0:1789762880.167548:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 13631488 granted 97058816 pending 25559040 free 3858759680 avail 3856662528 00000100:00100000:0.0:1789762880.167549:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149031680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762880.167566:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149032064 00000100:00100000:1.0:1789762880.167571:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149032064 00000100:00100000:2.0:1789762880.167593:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967698 gen 2 00000004:00080000:2.0:1789762880.167600:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d148df0e00, transno 4294967698 00000100:00100000:3.0:1789762880.167605:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1876702149031296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762880.167612:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789762880.167617:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149031808:0@lo:400:kworker.0 00000100:00100000:0.0:1789762880.167619:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149031680:12345-0@lo:400:kworker.0 Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762880.167623:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3279:x1876702149032064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762880.167643:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789762880.167644:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789762880.167657:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d160030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149031296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762880.167677:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149032064:12345-0@lo:400:kworker.0 Request processed in 57us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762880.167686:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789762880.167713:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d042b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149031680:0@lo:400:kworker.0 00000100:00100000:3.0:1789762880.167730:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149032064:0@lo:400:kworker.0 00000100:00100000:1.0:1789762880.169725:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284642809015 time 284642868906 state 0x0 ref 1 00000100:00100000:1.0:1789762880.169737:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140763776:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762880.169771:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 29360128, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0xe007 00010000:00010000:1.0:1789762880.169778:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57011e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.169790:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:1.0:1789762880.169794:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762880.169798:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57011e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.169826:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57011e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762880.182123:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967719 is committed 00002000:00010000:1.0:1789762880.182160:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:1.0:1789762880.182166:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 57351 -> 59399 00010000:00010000:1.0:1789762880.182180:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57011e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.182194:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57011e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.182212:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57011e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.182220:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762880.182225:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57011e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.182235:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57011e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.182253:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57011e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.182258:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57011e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762880.182327:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140763776:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12588us (49087us total) trans 4294967719 rc 0/0 00000100:00100000:1.0:1789762880.182336:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 292 00000100:00100000:1.0:1789762880.182346:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284642809015 time 284642868906 state 0x2 ref 0 00000100:00100000:1.0:1789762880.184471:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762880.184511:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140763904 00000100:00100000:0.0:1789762880.184519:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140763904 00000100:00100000:0.0:1789762880.184556:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284642809015 time 284642868906 state 0x0 ref 1 00000100:00100000:0.0:1789762880.184567:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284692868906 time 284642868906 state 0x1 ref 1 00000100:00100000:0.0:1789762880.219763:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284692868906 time 284692918797 state 0x0 ref 1 00000100:00100000:0.0:1789762880.219781:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140763904:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762880.219831:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 30408704, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0xe807 00010000:00010000:0.0:1789762880.219856:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a141fedc/0xd08452c77c570125 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.219869:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789762880.219881:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762880.219886:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a141fedc/0xd08452c77c570125 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.219897:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a141fedc/0xd08452c77c570125 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762880.230670:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967720 is committed 00002000:00010000:1.0:1789762880.230702:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:1.0:1789762880.230708:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 59399 -> 61447 00010000:00010000:1.0:1789762880.230718:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a141fedc/0xd08452c77c570125 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.230733:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a141fedc/0xd08452c77c570125 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.230740:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a141fedc/0xd08452c77c570125 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.230745:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829aa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762880.230748:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a141fedc/0xd08452c77c570125 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.230754:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a141fedc/0xd08452c77c570125 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.230767:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a141fedc/0xd08452c77c570125 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.230772:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a141fedc/0xd08452c77c570125 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762880.230882:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140763904:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11104us (46408us total) trans 4294967720 rc 0/0 00000100:00100000:1.0:1789762880.230892:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 293 00000100:00100000:1.0:1789762880.230901:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284692868906 time 284692918797 state 0x2 ref 0 00000100:00100000:2.0:1789762880.233082:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762880.233124:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140764032 00000100:00100000:3.0:1789762880.233133:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140764032 00000100:00100000:3.0:1789762880.233183:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284692868906 time 284692918797 state 0x0 ref 1 00000100:00100000:3.0:1789762880.233198:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284742918797 time 284692918797 state 0x1 ref 1 00000100:00100000:1.0:1789762880.269872:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284742918797 time 284743022781 state 0x0 ref 1 00000100:00100000:1.0:1789762880.269901:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140764032:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762880.269946:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 31457280, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0xf007 00010000:00010000:1.0:1789762880.269954:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57012c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.269967:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:1.0:1789762880.269971:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762880.269976:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57012c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.269986:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57012c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762880.281446:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967721 is committed 00002000:00010000:0.0:1789762880.281454:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:0.0:1789762880.281459:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 61447 -> 63495 00010000:00010000:0.0:1789762880.281470:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57012c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.281481:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57012c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.281488:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57012c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.281493:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762880.281497:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57012c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.281503:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57012c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.281518:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57012c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.281536:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b41cee3/0xd08452c77c57012c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762880.281619:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140764032:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11719us (48534us total) trans 4294967721 rc 0/0 00000100:00100000:0.0:1789762880.281628:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 294 00000100:00100000:0.0:1789762880.281638:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284742918797 time 284743022781 state 0x2 ref 0 00000100:00100000:2.0:1789762880.283927:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762880.283961:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140764160 00000100:00100000:0.0:1789762880.283970:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140764160 00000100:00100000:0.0:1789762880.284009:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284742918797 time 284743022781 state 0x0 ref 1 00000100:00100000:0.0:1789762880.284029:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284793022781 time 284743022781 state 0x1 ref 1 00000100:00100000:1.0:1789762880.319955:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284793022781 time 284793109510 state 0x0 ref 1 00000100:00100000:1.0:1789762880.319973:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140764160:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762880.320013:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 32505856, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0xf807 00010000:00010000:1.0:1789762880.320020:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbe1bca3/0xd08452c77c570133 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.320032:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:1.0:1789762880.320035:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762880.320040:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbe1bca3/0xd08452c77c570133 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.320065:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbe1bca3/0xd08452c77c570133 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762880.331122:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967722 is committed 00002000:00010000:2.0:1789762880.331155:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:2.0:1789762880.331160:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 63495 -> 65543 00010000:00010000:2.0:1789762880.331169:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbe1bca3/0xd08452c77c570133 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.331178:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbe1bca3/0xd08452c77c570133 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.331184:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbe1bca3/0xd08452c77c570133 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.331189:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762880.331193:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbe1bca3/0xd08452c77c570133 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.331199:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbe1bca3/0xd08452c77c570133 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.331225:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbe1bca3/0xd08452c77c570133 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.331235:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbe1bca3/0xd08452c77c570133 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762880.331304:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140764160:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11333us (47375us total) trans 4294967722 rc 0/0 00000100:00100000:2.0:1789762880.331316:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 295 00000100:00100000:2.0:1789762880.331327:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284793022781 time 284793109510 state 0x2 ref 0 00000100:00100000:2.0:1789762880.333353:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762880.333393:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140764288 00000100:00100000:3.0:1789762880.333401:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140764288 00000100:00100000:3.0:1789762880.333437:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284793022781 time 284793109510 state 0x0 ref 1 00000100:00100000:3.0:1789762880.333451:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284843109510 time 284793109510 state 0x1 ref 1 00000100:00100000:0.0:1789762880.370027:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284843109510 time 284843181141 state 0x0 ref 1 00000100:00100000:0.0:1789762880.370046:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140764288:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762880.370085:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 33554432, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0x10007 00010000:00010000:0.0:1789762880.370092:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000885b00b0/0xd08452c77c57013a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.370105:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789762880.370108:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762880.370122:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000885b00b0/0xd08452c77c57013a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.370133:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000885b00b0/0xd08452c77c57013a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762880.372164:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762880.372214:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762880.372236:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140764544 00000100:00100000:3.0:1789762880.372244:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140764416 00000100:00100000:0.0:1789762880.372246:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140764544 00000100:00100000:3.0:1789762880.372252:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140764416 00000100:00100000:1.0:1789762880.372272:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00080000:2.0:1789762880.372286:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762880.372307:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762880.372318:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140764672 00000100:00100000:0.0:1789762880.372321:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140764800 00000100:00100000:2.0:1789762880.372324:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140764672 00000100:00100000:0.0:1789762880.372327:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140764800 00000100:00100000:1.0:1789762880.372339:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:3.0:1789762880.372346:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 283 00000100:00100000:1.0:1789762880.372351:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140764544:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762880.372361:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140764416:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762880.372374:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:2.0:1789762880.372378:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:0.0:1789762880.372386:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140764800:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762880.372393:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+35:2344:x1876702140764672:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762880.372407:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140764416:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 50us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762880.372409:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140764544:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 61us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762880.372420:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 283 00000100:00100000:1.0:1789762880.372422:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:0.0:1789762880.372432:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140764800:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762880.372433:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+35:2344:x1876702140764672:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 46us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762880.372448:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:0.0:1789762880.372460:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00080000:2.0:1789762880.372481:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789762880.372487:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789762880.381033:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967723 is committed 00002000:00010000:1.0:1789762880.381074:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:1.0:1789762880.381079:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 65543 -> 67591 00010000:00010000:1.0:1789762880.381089:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000885b00b0/0xd08452c77c57013a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.381099:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000885b00b0/0xd08452c77c57013a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.381106:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000885b00b0/0xd08452c77c57013a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.381113:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762880.381118:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000885b00b0/0xd08452c77c57013a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.381141:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000885b00b0/0xd08452c77c57013a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.381162:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000885b00b0/0xd08452c77c57013a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.381169:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000885b00b0/0xd08452c77c57013a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762880.381231:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140764288:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11187us (47875us total) trans 4294967723 rc 0/0 00000100:00100000:1.0:1789762880.381241:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 296 00000100:00100000:1.0:1789762880.381251:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284843109510 time 284843181141 state 0x2 ref 0 00000100:00100000:1.0:1789762880.383271:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762880.383311:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140764928 00000100:00100000:0.0:1789762880.383316:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140764928 00000100:00100000:0.0:1789762880.383349:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284843109510 time 284843181141 state 0x0 ref 1 00000100:00100000:0.0:1789762880.383359:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284893181141 time 284843181141 state 0x1 ref 1 00000100:00100000:2.0:1789762880.420099:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284893181141 time 284893254562 state 0x0 ref 1 00000100:00100000:2.0:1789762880.420123:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140764928:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762880.420159:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 34603008, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0x10807 00010000:00010000:2.0:1789762880.420165:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570141 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.420177:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:2.0:1789762880.420180:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762880.420185:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570141 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.420195:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570141 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762880.431038:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967724 is committed 00002000:00010000:2.0:1789762880.431066:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 34603008 -> 35651584 00002000:00010000:2.0:1789762880.431071:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 67591 -> 69639 00010000:00010000:2.0:1789762880.431079:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570141 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.431087:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570141 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.431094:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570141 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.431099:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762880.431111:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570141 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.431120:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570141 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.431137:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570141 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.431146:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570141 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762880.431209:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140764928:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11087us (47936us total) trans 4294967724 rc 0/0 00000100:00100000:2.0:1789762880.431221:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 297 00000100:00100000:2.0:1789762880.431232:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284893181141 time 284893254562 state 0x2 ref 0 00000100:00100000:1.0:1789762880.433342:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762880.433384:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140765056 00000100:00100000:3.0:1789762880.433391:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140765056 00000100:00100000:3.0:1789762880.433424:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284893181141 time 284893254562 state 0x0 ref 1 00000100:00100000:3.0:1789762880.433434:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284943254562 time 284893254562 state 0x1 ref 1 00000100:00100000:1.0:1789762880.470181:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284943254562 time 284943333618 state 0x0 ref 1 00000100:00100000:1.0:1789762880.470201:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140765056:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762880.470241:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 35651584, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0x11007 00010000:00010000:1.0:1789762880.470248:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570148 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.470261:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:1.0:1789762880.470272:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762880.470277:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570148 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.470288:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570148 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762880.481015:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967725 is committed 00002000:00010000:1.0:1789762880.481031:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:1.0:1789762880.481036:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 69639 -> 71687 00010000:00010000:1.0:1789762880.481045:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570148 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.481055:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570148 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.481061:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570148 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.481066:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043bc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762880.481070:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570148 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.481077:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570148 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.481089:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570148 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.481103:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570148 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762880.481153:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140765056:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10958us (47810us total) trans 4294967725 rc 0/0 00000100:00100000:1.0:1789762880.481160:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 298 00000100:00100000:1.0:1789762880.481168:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284943254562 time 284943333618 state 0x2 ref 0 00000100:00100000:0.0:1789762880.483129:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762880.483177:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140765184 00000100:00100000:2.0:1789762880.483186:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140765184 00000100:00100000:2.0:1789762880.483220:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284943254562 time 284943333618 state 0x0 ref 1 00000100:00100000:2.0:1789762880.483231:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284993333618 time 284943333618 state 0x1 ref 1 00000100:00100000:2.0:1789762880.520238:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284993333618 time 284993390517 state 0x0 ref 1 00000100:00100000:2.0:1789762880.520259:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140765184:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762880.520300:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 36700160, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0x11807 00010000:00010000:2.0:1789762880.520306:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57014f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.520317:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=284s v=(0 0) 00010000:00010000:2.0:1789762880.520321:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762880.520325:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57014f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.520334:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57014f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762880.530986:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967726 is committed 00002000:00010000:2.0:1789762880.531037:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:2.0:1789762880.531041:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 71687 -> 73735 00010000:00010000:2.0:1789762880.531049:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57014f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.531058:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57014f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.531064:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57014f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.531069:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762880.531072:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57014f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.531089:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57014f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.531103:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57014f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.531108:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57014f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762880.531160:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140765184:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10907us (48032us total) trans 4294967726 rc 0/0 00000100:00100000:2.0:1789762880.531167:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 299 00000100:00100000:2.0:1789762880.531175:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284993333618 time 284993390517 state 0x2 ref 0 00000100:00100000:1.0:1789762880.533084:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762880.533126:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140765312 00000100:00100000:3.0:1789762880.533134:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140765312 00000100:00100000:3.0:1789762880.533173:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 284993333618 time 284993390517 state 0x0 ref 1 00000100:00100000:3.0:1789762880.533184:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285043390517 time 284993390517 state 0x1 ref 1 00010000:00010000:1.0:1789762880.550901:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762880.570346:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285043390517 time 285043500593 state 0x0 ref 1 00000100:00100000:1.0:1789762880.570366:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140765312:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762880.570413:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 37748736, mtime: 0x6aad9d3f, atime: 0x0, ctime: 0x6aad9d3f, blocks: 0x12007 00010000:00010000:1.0:1789762880.570422:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570156 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.570439:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:1.0:1789762880.570444:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762880.570450:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.570460:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762880.581147:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967727 is committed 00002000:00010000:1.0:1789762880.581182:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:1.0:1789762880.581186:0:11723:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb mtime from disk: 1789762879 -> 1789762880 00002000:00010000:1.0:1789762880.581188:0:11723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb ctime from disk: 1789762879 -> 1789762880 00002000:00010000:1.0:1789762880.581190:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 73735 -> 75783 00010000:00010000:1.0:1789762880.581201:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.581210:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.581216:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570156 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.581221:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762880.581225:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570156 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.581231:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570156 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.581244:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570156 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.581249:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570156 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762880.581334:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140765312:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10971us (48247us total) trans 4294967727 rc 0/0 00000100:00100000:1.0:1789762880.581344:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 300 00000100:00100000:1.0:1789762880.581353:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285043390517 time 285043500593 state 0x2 ref 0 00000100:00100000:0.0:1789762880.583369:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762880.583417:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140765440 00000100:00100000:2.0:1789762880.583425:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140765440 00000100:00100000:2.0:1789762880.583462:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285043390517 time 285043500593 state 0x0 ref 1 00000100:00100000:2.0:1789762880.583472:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285093500593 time 285043500593 state 0x1 ref 1 00000100:00100000:2.0:1789762880.620412:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285093500593 time 285093563046 state 0x0 ref 1 00000100:00100000:2.0:1789762880.620434:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140765440:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762880.620486:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 38797312, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x12807 00010000:00010000:2.0:1789762880.620508:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c57015d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.620525:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:2.0:1789762880.620529:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762880.620534:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c57015d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.620545:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c57015d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762880.631455:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967728 is committed 00002000:00010000:3.0:1789762880.631456:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:3.0:1789762880.631462:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 75783 -> 77831 00010000:00010000:3.0:1789762880.631471:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c57015d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.631481:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c57015d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.631488:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c57015d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.631502:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762880.631506:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c57015d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.631512:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c57015d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.631526:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c57015d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.631531:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c57015d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762880.631584:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140765440:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11156us (48214us total) trans 4294967728 rc 0/0 00000100:00100000:3.0:1789762880.631591:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 301 00000100:00100000:3.0:1789762880.631601:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285093500593 time 285093563046 state 0x2 ref 0 00000100:00100000:0.0:1789762880.633635:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762880.633669:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140765568 00000100:00100000:3.0:1789762880.633677:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140765568 00000100:00100000:3.0:1789762880.633712:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285093500593 time 285093563046 state 0x0 ref 1 00000100:00100000:3.0:1789762880.633723:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285143563046 time 285093563046 state 0x1 ref 1 00000100:00100000:1.0:1789762880.670499:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285143563046 time 285143652616 state 0x0 ref 1 00000100:00100000:1.0:1789762880.670518:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140765568:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762880.670559:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 39845888, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x13007 00010000:00010000:1.0:1789762880.670566:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570164 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.670579:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:1.0:1789762880.670582:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762880.670586:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570164 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.670596:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570164 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762880.678945:0:7131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 285152109680ns, next at 286152106722ns, rc = 0 00000100:00100000:2.0:1789762880.679232:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149032192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762880.679276:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762880.679320:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149032192 00000100:00100000:0.0:1789762880.679328:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149032192 00000100:00100000:0.0:1789762880.679376:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789762880.679394:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149032192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762880.679410:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528547840 pending 1703936 free 3834642432 avail 3809476608 00000100:00100000:0.0:1789762880.679458:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149032192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762880.679466:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789762880.679487:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149032192:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789762880.681423:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967729 is committed 00002000:00010000:2.0:1789762880.681479:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:2.0:1789762880.681484:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 77831 -> 79879 00010000:00010000:2.0:1789762880.681492:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570164 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.681501:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570164 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.681507:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570164 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.681512:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762880.681522:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570164 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.681529:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570164 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.681542:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570164 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.681547:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c570164 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762880.681591:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140765568:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11078us (47956us total) trans 4294967729 rc 0/0 00000100:00100000:2.0:1789762880.681599:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 302 00000100:00100000:2.0:1789762880.681607:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285143563046 time 285143652616 state 0x2 ref 0 00000100:00100000:2.0:1789762880.683485:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762880.683532:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140765696 00000100:00100000:0.0:1789762880.683538:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140765696 00000100:00100000:0.0:1789762880.683566:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285143563046 time 285143652616 state 0x0 ref 1 00000100:00100000:0.0:1789762880.683576:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285193652616 time 285143652616 state 0x1 ref 1 00000100:00100000:3.0:1789762880.720572:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285193652616 time 285193727897 state 0x0 ref 1 00000100:00100000:3.0:1789762880.720588:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140765696:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:3.0:1789762880.720621:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 40894464, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x13807 00010000:00010000:3.0:1789762880.720627:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57016b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.720638:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:3.0:1789762880.720641:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762880.720645:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57016b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.720654:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57016b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762880.731297:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967730 is committed 00002000:00010000:1.0:1789762880.731340:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:1.0:1789762880.731347:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 79879 -> 81927 00010000:00010000:1.0:1789762880.731355:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57016b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.731375:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57016b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.731382:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57016b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.731387:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762880.731390:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57016b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.731396:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57016b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.731408:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57016b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.731413:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57016b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762880.731468:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140765696:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10882us (47981us total) trans 4294967730 rc 0/0 00000100:00100000:1.0:1789762880.731475:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 303 00000100:00100000:1.0:1789762880.731483:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285193652616 time 285193727897 state 0x2 ref 0 00000100:00100000:0.0:1789762880.733474:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762880.733517:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140765824 00000100:00100000:3.0:1789762880.733525:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140765824 00000100:00100000:3.0:1789762880.733560:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285193652616 time 285193727897 state 0x0 ref 1 00000100:00100000:3.0:1789762880.733570:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285243727897 time 285193727897 state 0x1 ref 1 00000100:00100000:2.0:1789762880.770770:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285243727897 time 285243910146 state 0x0 ref 1 00000100:00100000:2.0:1789762880.770869:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140765824:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762880.770919:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 41943040, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x14007 00010000:00010000:2.0:1789762880.770950:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570172 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.770971:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:2.0:1789762880.770995:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762880.771004:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570172 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.771023:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570172 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762880.782036:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967731 is committed 00002000:00010000:2.0:1789762880.782057:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:2.0:1789762880.782062:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 81927 -> 83975 00010000:00010000:2.0:1789762880.782073:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570172 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.782082:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570172 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.782089:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570172 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.782094:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762880.782097:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570172 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.782105:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570172 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.782125:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570172 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.782149:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570172 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762880.782215:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140765824:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11421us (48738us total) trans 4294967731 rc 0/0 00000100:00100000:2.0:1789762880.782223:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 304 00000100:00100000:2.0:1789762880.782233:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285243727897 time 285243910146 state 0x2 ref 0 00000100:00100000:1.0:1789762880.784242:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762880.784296:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140765952 00000100:00100000:0.0:1789762880.784305:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140765952 00000100:00100000:0.0:1789762880.784349:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285243727897 time 285243910146 state 0x0 ref 1 00000100:00100000:0.0:1789762880.784360:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285293910146 time 285243910146 state 0x1 ref 1 00000100:00100000:1.0:1789762880.820869:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285293910146 time 285294023569 state 0x0 ref 1 00000100:00100000:1.0:1789762880.820887:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140765952:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762880.820926:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 42991616, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x14807 00010000:00010000:1.0:1789762880.820933:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570179 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.820945:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:1.0:1789762880.820948:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762880.820953:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570179 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.820963:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570179 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762880.833320:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967732 is committed 00002000:00010000:1.0:1789762880.833342:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:1.0:1789762880.833346:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 83975 -> 86023 00010000:00010000:1.0:1789762880.833358:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570179 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.833368:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570179 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.833375:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570179 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.833389:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762880.833392:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570179 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.833399:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570179 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.833413:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570179 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.833418:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570179 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762880.833485:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140765952:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12600us (49241us total) trans 4294967732 rc 0/0 00000100:00100000:1.0:1789762880.833494:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 305 00000100:00100000:1.0:1789762880.833504:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285293910146 time 285294023569 state 0x2 ref 0 00000100:00100000:1.0:1789762880.835825:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762880.835867:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140766080 00000100:00100000:3.0:1789762880.835876:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140766080 00000100:00100000:3.0:1789762880.835922:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285293910146 time 285294023569 state 0x0 ref 1 00000100:00100000:3.0:1789762880.835937:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285344023569 time 285294023569 state 0x1 ref 1 00000100:00100000:2.0:1789762880.870950:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285344023569 time 285344102858 state 0x0 ref 1 00000100:00100000:2.0:1789762880.870969:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140766080:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762880.871011:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 44040192, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x15007 00010000:00010000:2.0:1789762880.871018:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570180 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.871030:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:2.0:1789762880.871034:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762880.871038:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570180 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.871048:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570180 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762880.882004:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967733 is committed 00002000:00010000:1.0:1789762880.882012:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:1.0:1789762880.882017:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 86023 -> 88073 00010000:00010000:1.0:1789762880.882026:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570180 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.882036:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570180 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.882048:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570180 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.882054:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762880.882057:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570180 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.882064:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570180 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.882077:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570180 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.882082:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570180 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762880.882131:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140766080:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11167us (46305us total) trans 4294967733 rc 0/0 00000100:00100000:1.0:1789762880.882139:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 306 00000100:00100000:1.0:1789762880.882148:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285344023569 time 285344102858 state 0x2 ref 0 00000100:00100000:1.0:1789762880.884074:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762880.884120:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140766208 00000100:00100000:0.0:1789762880.884128:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140766208 00000100:00100000:0.0:1789762880.884164:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285344023569 time 285344102858 state 0x0 ref 1 00000100:00100000:0.0:1789762880.884184:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285394102858 time 285344102858 state 0x1 ref 1 00000100:00100000:1.0:1789762880.921025:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285394102858 time 285394180914 state 0x0 ref 1 00000100:00100000:1.0:1789762880.921042:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140766208:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762880.921083:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 45088768, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x15809 00010000:00010000:1.0:1789762880.921089:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570187 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.921102:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:1.0:1789762880.921105:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762880.921109:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570187 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.921118:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570187 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762880.931967:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967734 is committed 00002000:00010000:3.0:1789762880.931972:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:3.0:1789762880.931978:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 88073 -> 90121 00010000:00010000:3.0:1789762880.931989:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570187 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.932001:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570187 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.932011:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570187 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.932018:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762880.932023:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570187 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.932032:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570187 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.932049:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570187 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.932058:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570187 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762880.932120:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140766208:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11079us (48043us total) trans 4294967734 rc 0/0 00000100:00100000:3.0:1789762880.932140:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 307 00000100:00100000:3.0:1789762880.932151:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285394102858 time 285394180914 state 0x2 ref 0 00000100:00100000:2.0:1789762880.934047:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762880.934089:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140766336 00000100:00100000:3.0:1789762880.934098:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140766336 00000100:00100000:3.0:1789762880.934136:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285394102858 time 285394180914 state 0x0 ref 1 00000100:00100000:3.0:1789762880.934149:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285444180914 time 285394180914 state 0x1 ref 1 00000100:00100000:1.0:1789762880.971123:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285444180914 time 285444273242 state 0x0 ref 1 00000100:00100000:1.0:1789762880.971146:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140766336:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762880.971195:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 46137344, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x16009 00010000:00010000:1.0:1789762880.971202:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57018e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.971217:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:1.0:1789762880.971221:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762880.971228:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57018e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.971243:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57018e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762880.981634:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967735 is committed 00002000:00010000:1.0:1789762880.981645:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:1.0:1789762880.981650:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 90121 -> 92169 00010000:00010000:1.0:1789762880.981660:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57018e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.981669:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57018e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.981676:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57018e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.981681:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043ac00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762880.981685:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57018e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.981692:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57018e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.981705:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57018e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.981710:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57018e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762880.981763:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140766336:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10624us (47715us total) trans 4294967735 rc 0/0 00000100:00100000:1.0:1789762880.981776:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 308 00000100:00100000:1.0:1789762880.981785:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285444180914 time 285444273242 state 0x2 ref 0 00000100:00100000:2.0:1789762880.983829:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762880.983908:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140766464 00000100:00100000:0.0:1789762880.983917:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140766464 00000100:00100000:0.0:1789762880.983955:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285444180914 time 285444273242 state 0x0 ref 1 00000100:00100000:0.0:1789762880.983966:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285494273242 time 285444273242 state 0x1 ref 1 00000100:00100000:3.0:1789762881.021200:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285494273242 time 285494348374 state 0x0 ref 1 00000100:00100000:3.0:1789762881.021240:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140766464:12345-192.168.203.31@tcp:4:dd.0 00000100:00080000:2.0:1789762881.021258:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762881.021289:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 47185920, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x16809 00010000:00010000:3.0:1789762881.021297:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570195 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.021318:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:3.0:1789762881.021321:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762881.021325:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570195 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.021337:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570195 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762881.032364:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 47185920 -> 48234496 00000001:00080000:0.0:1789762881.032370:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967736 is committed 00002000:00010000:3.0:1789762881.032375:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 92169 -> 94217 00010000:00010000:3.0:1789762881.032387:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570195 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.032396:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570195 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.032403:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570195 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.032408:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fe00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762881.032411:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570195 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.032418:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570195 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.032431:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570195 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.032437:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570195 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762881.032492:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140766464:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11273us (48663us total) trans 4294967736 rc 0/0 00000100:00100000:3.0:1789762881.032499:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 309 00000100:00100000:3.0:1789762881.032508:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285494273242 time 285494348374 state 0x2 ref 0 00000100:00100000:0.0:1789762881.034455:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.034492:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140766592 00000100:00100000:3.0:1789762881.034501:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140766592 00000100:00100000:3.0:1789762881.034537:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285494273242 time 285494348374 state 0x0 ref 1 00000100:00100000:3.0:1789762881.034547:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285544348374 time 285494348374 state 0x1 ref 1 00000100:00100000:1.0:1789762881.071310:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285544348374 time 285544462502 state 0x0 ref 1 00000100:00100000:1.0:1789762881.071330:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140766592:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762881.071370:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 48234496, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x17009 00010000:00010000:1.0:1789762881.071377:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57019c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.071390:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:1.0:1789762881.071393:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762881.071397:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57019c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.071408:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57019c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762881.081825:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967737 is committed 00002000:00010000:1.0:1789762881.081912:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:1.0:1789762881.081917:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 94217 -> 96265 00010000:00010000:1.0:1789762881.081927:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57019c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.081936:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57019c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.081954:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57019c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.081960:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043ac00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762881.081963:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57019c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.081970:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57019c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.081983:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57019c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.081989:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c57019c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762881.082043:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140766592:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10717us (47586us total) trans 4294967737 rc 0/0 00000100:00100000:1.0:1789762881.082050:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 310 00000100:00100000:1.0:1789762881.082059:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285544348374 time 285544462502 state 0x2 ref 0 00000100:00100000:2.0:1789762881.084018:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762881.084061:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140766720 00000100:00100000:0.0:1789762881.084069:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140766720 00000100:00100000:0.0:1789762881.084105:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285544348374 time 285544462502 state 0x0 ref 1 00000100:00100000:0.0:1789762881.084116:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285594462502 time 285544462502 state 0x1 ref 1 00000100:00100000:3.0:1789762881.121402:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285594462502 time 285594551723 state 0x0 ref 1 00000100:00100000:3.0:1789762881.121427:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140766720:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:3.0:1789762881.121478:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 49283072, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x17809 00010000:00010000:3.0:1789762881.121486:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5701a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.121499:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:3.0:1789762881.121502:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762881.121507:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5701a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.121518:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5701a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762881.132422:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967738 is committed 00002000:00010000:1.0:1789762881.132481:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 49283072 -> 50331648 00002000:00010000:1.0:1789762881.132486:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 96265 -> 98313 00010000:00010000:1.0:1789762881.132496:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5701a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.132515:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5701a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.132521:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5701a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.132526:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fe00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762881.132530:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5701a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.132536:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5701a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.132549:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5701a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.132555:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5701a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762881.132610:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140766720:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11192us (48591us total) trans 4294967738 rc 0/0 00000100:00100000:1.0:1789762881.132617:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 311 00000100:00100000:1.0:1789762881.132626:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285594462502 time 285594551723 state 0x2 ref 0 00000100:00100000:0.0:1789762881.134680:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.134721:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140766848 00000100:00100000:3.0:1789762881.134732:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140766848 00000100:00100000:3.0:1789762881.134777:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285594462502 time 285594551723 state 0x0 ref 1 00000100:00100000:3.0:1789762881.134799:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285644551723 time 285594551723 state 0x1 ref 1 00000100:00100000:1.0:1789762881.171475:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285644551723 time 285644621573 state 0x0 ref 1 00000100:00100000:1.0:1789762881.171514:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140766848:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762881.171561:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 50331648, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x18009 00010000:00010000:1.0:1789762881.171569:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.171583:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:1.0:1789762881.171586:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762881.171591:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.171602:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762881.181991:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967739 is committed 00002000:00010000:1.0:1789762881.182011:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:1.0:1789762881.182016:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 98313 -> 100361 00010000:00010000:1.0:1789762881.182026:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.182036:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.182043:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.182047:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043ac00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762881.182056:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.182063:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.182077:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.182082:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762881.182137:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140766848:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10631us (47456us total) trans 4294967739 rc 0/0 00000100:00100000:1.0:1789762881.182145:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 312 00000100:00100000:1.0:1789762881.182155:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285644551723 time 285644621573 state 0x2 ref 0 00000100:00100000:0.0:1789762881.184230:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762881.184306:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140766976 00000100:00100000:2.0:1789762881.184314:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140766976 00000100:00100000:2.0:1789762881.184352:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285644551723 time 285644621573 state 0x0 ref 1 00000100:00100000:2.0:1789762881.184363:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285694621573 time 285644621573 state 0x1 ref 1 00000100:00100000:1.0:1789762881.221535:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285694621573 time 285694691481 state 0x0 ref 1 00000100:00100000:1.0:1789762881.221552:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140766976:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762881.221585:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 51380224, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x18809 00010000:00010000:1.0:1789762881.221592:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.221604:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:1.0:1789762881.221607:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762881.221619:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.221629:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762881.231936:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967740 is committed 00002000:00010000:1.0:1789762881.231940:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:1.0:1789762881.231945:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 100361 -> 102409 00010000:00010000:1.0:1789762881.231954:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.231964:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.231971:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.231976:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043ac00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762881.231980:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.231986:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.231998:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.232013:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762881.232065:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140766976:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10517us (47834us total) trans 4294967740 rc 0/0 00000100:00100000:1.0:1789762881.232072:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 313 00000100:00100000:1.0:1789762881.232081:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285694621573 time 285694691481 state 0x2 ref 0 00000100:00100000:0.0:1789762881.234098:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.234141:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140767104 00000100:00100000:3.0:1789762881.234149:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140767104 00000100:00100000:3.0:1789762881.234189:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285694621573 time 285694691481 state 0x0 ref 1 00000100:00100000:3.0:1789762881.234204:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285744691481 time 285694691481 state 0x1 ref 1 00000100:00100000:1.0:1789762881.271615:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285744691481 time 285744765808 state 0x0 ref 1 00000100:00100000:1.0:1789762881.271635:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140767104:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762881.271680:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 52428800, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x19009 00010000:00010000:1.0:1789762881.271687:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.271700:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:1.0:1789762881.271704:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762881.271708:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.271723:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762881.283142:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967741 is committed 00002000:00010000:2.0:1789762881.283149:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:2.0:1789762881.283154:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 102409 -> 104457 00010000:00010000:2.0:1789762881.283165:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.283175:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.283181:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.283187:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043ac00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762881.283191:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.283197:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.283218:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.283224:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c5701b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762881.283277:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140767104:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11646us (49179us total) trans 4294967741 rc 0/0 00000100:00100000:2.0:1789762881.283285:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 314 00000100:00100000:2.0:1789762881.283293:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285744691481 time 285744765808 state 0x2 ref 0 00000100:00100000:2.0:1789762881.285661:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762881.285739:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140767232 00000100:00100000:0.0:1789762881.285747:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140767232 00000100:00100000:0.0:1789762881.285782:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285744691481 time 285744765808 state 0x0 ref 1 00000100:00100000:0.0:1789762881.285793:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285794765808 time 285744765808 state 0x1 ref 1 00000100:00100000:1.0:1789762881.321688:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285794765808 time 285794843949 state 0x0 ref 1 00000100:00100000:1.0:1789762881.321713:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140767232:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762881.321757:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 53477376, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x19809 00010000:00010000:1.0:1789762881.321766:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c5701bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.321780:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:1.0:1789762881.321783:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762881.321787:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c5701bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.321797:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c5701bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762881.332312:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967742 is committed 00002000:00010000:1.0:1789762881.332320:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:1.0:1789762881.332327:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 104457 -> 106505 00010000:00010000:1.0:1789762881.332337:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c5701bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.332346:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c5701bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.332352:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c5701bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.332357:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762881.332366:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c5701bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.332373:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c5701bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.332384:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c5701bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.332389:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c5701bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762881.332441:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140767232:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10730us (46779us total) trans 4294967742 rc 0/0 00000100:00100000:1.0:1789762881.332448:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 315 00000100:00100000:1.0:1789762881.332456:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285794765808 time 285794843949 state 0x2 ref 0 00000100:00100000:0.0:1789762881.334655:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.334693:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140767360 00000100:00100000:3.0:1789762881.334701:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140767360 00000100:00100000:3.0:1789762881.334736:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285794765808 time 285794843949 state 0x0 ref 1 00000100:00100000:3.0:1789762881.334746:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285844843949 time 285794843949 state 0x1 ref 1 00000100:00100000:2.0:1789762881.371800:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285844843949 time 285844954800 state 0x0 ref 1 00000100:00100000:2.0:1789762881.371846:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140767360:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762881.371882:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 54525952, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x1a009 00010000:00010000:2.0:1789762881.371889:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c5701c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.371900:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:2.0:1789762881.371903:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762881.371907:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c5701c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.371930:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c5701c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762881.382934:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967743 is committed 00002000:00010000:2.0:1789762881.382954:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:2.0:1789762881.382959:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 106505 -> 108553 00010000:00010000:2.0:1789762881.382968:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c5701c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.382978:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c5701c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.382985:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c5701c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.382989:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762881.382993:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c5701c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.383000:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c5701c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.383013:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c5701c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.383018:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6ae1b52/0xd08452c77c5701c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762881.383081:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140767360:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11254us (48426us total) trans 4294967743 rc 0/0 00000100:00100000:2.0:1789762881.383089:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 316 00000100:00100000:2.0:1789762881.383098:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285844843949 time 285844954800 state 0x2 ref 0 00000100:00100000:0.0:1789762881.385452:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.385489:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140767488 00000100:00100000:3.0:1789762881.385496:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140767488 00000100:00100000:3.0:1789762881.385532:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285844843949 time 285844954800 state 0x0 ref 1 00000100:00100000:3.0:1789762881.385543:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285894954800 time 285844954800 state 0x1 ref 1 00000100:00100000:1.0:1789762881.421880:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285894954800 time 285895032581 state 0x0 ref 1 00000100:00100000:1.0:1789762881.421900:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140767488:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762881.421940:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 55574528, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x1a809 00010000:00010000:1.0:1789762881.421946:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c9e3b2/0xd08452c77c5701cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.421959:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:1.0:1789762881.421962:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762881.421975:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c9e3b2/0xd08452c77c5701cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.421986:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c9e3b2/0xd08452c77c5701cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762881.433100:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967744 is committed 00002000:00010000:2.0:1789762881.433121:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:2.0:1789762881.433126:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 108553 -> 110601 00010000:00010000:2.0:1789762881.433135:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c9e3b2/0xd08452c77c5701cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.433144:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c9e3b2/0xd08452c77c5701cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.433151:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c9e3b2/0xd08452c77c5701cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.433156:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762881.433160:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c9e3b2/0xd08452c77c5701cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.433166:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c9e3b2/0xd08452c77c5701cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.433179:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c9e3b2/0xd08452c77c5701cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.433194:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c9e3b2/0xd08452c77c5701cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762881.433248:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140767488:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11353us (47795us total) trans 4294967744 rc 0/0 00000100:00100000:2.0:1789762881.433255:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 317 00000100:00100000:2.0:1789762881.433263:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285894954800 time 285895032581 state 0x2 ref 0 00000100:00100000:2.0:1789762881.435467:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.435506:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140767616 00000100:00100000:3.0:1789762881.435514:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140767616 00000100:00100000:3.0:1789762881.435564:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285894954800 time 285895032581 state 0x0 ref 1 00000100:00100000:3.0:1789762881.435579:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285945032581 time 285895032581 state 0x1 ref 1 00000100:00100000:2.0:1789762881.471964:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285945032581 time 285945116537 state 0x0 ref 1 00000100:00100000:2.0:1789762881.471984:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140767616:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762881.472027:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 56623104, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x1b009 00010000:00010000:2.0:1789762881.472034:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.472047:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:2.0:1789762881.472050:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762881.472055:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.472064:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762881.482966:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967745 is committed 00002000:00010000:2.0:1789762881.482989:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 56623104 -> 57671680 00002000:00010000:2.0:1789762881.482994:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 110601 -> 112649 00010000:00010000:2.0:1789762881.483003:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.483012:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.483018:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.483023:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762881.483027:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.483033:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.483046:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.483051:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762881.483113:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140767616:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11132us (47643us total) trans 4294967745 rc 0/0 00000100:00100000:2.0:1789762881.483131:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 318 00000100:00100000:2.0:1789762881.483141:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285945032581 time 285945116537 state 0x2 ref 0 00000100:00100000:2.0:1789762881.485234:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.485267:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140767744 00000100:00100000:3.0:1789762881.485276:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140767744 00000100:00100000:3.0:1789762881.485316:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285945032581 time 285945116537 state 0x0 ref 1 00000100:00100000:3.0:1789762881.485326:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285995116537 time 285945116537 state 0x1 ref 1 00000100:00100000:2.0:1789762881.522036:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285995116537 time 285995190194 state 0x0 ref 1 00000100:00100000:2.0:1789762881.522056:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140767744:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762881.522103:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 57671680, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x1b809 00010000:00010000:2.0:1789762881.522113:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701db lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.522129:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:2.0:1789762881.522134:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762881.522139:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.522150:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762881.532877:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967746 is committed 00002000:00010000:1.0:1789762881.532882:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:1.0:1789762881.532889:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 112649 -> 114697 00010000:00010000:1.0:1789762881.532902:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.532914:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.532921:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.532926:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762881.532929:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.532936:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.532950:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701db lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.532965:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701db lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762881.533020:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140767744:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10969us (47784us total) trans 4294967746 rc 0/0 00000100:00100000:1.0:1789762881.533027:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 319 00000100:00100000:1.0:1789762881.533035:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285995116537 time 285995190194 state 0x2 ref 0 00000100:00100000:0.0:1789762881.535064:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.535102:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140767872 00000100:00100000:3.0:1789762881.535111:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140767872 00000100:00100000:3.0:1789762881.535147:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 285995116537 time 285995190194 state 0x0 ref 1 00000100:00100000:3.0:1789762881.535157:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286045190194 time 285995190194 state 0x1 ref 1 00000100:00100000:2.0:1789762881.572136:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286045190194 time 286045288125 state 0x0 ref 1 00000100:00100000:2.0:1789762881.572157:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140767872:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762881.572199:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 58720256, mtime: 0x6aad9d40, atime: 0x0, ctime: 0x6aad9d40, blocks: 0x1c009 00010000:00010000:2.0:1789762881.572217:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.572229:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1789762881.572233:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762881.572237:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.572249:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.574917:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789762881.582942:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967747 is committed 00002000:00010000:2.0:1789762881.583001:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:2.0:1789762881.583006:0:11723:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb mtime from disk: 1789762880 -> 1789762881 00002000:00010000:2.0:1789762881.583008:0:11723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb ctime from disk: 1789762880 -> 1789762881 00002000:00010000:2.0:1789762881.583009:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 114697 -> 116745 00010000:00010000:2.0:1789762881.583019:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.583030:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.583037:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.583043:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762881.583046:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.583064:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.583077:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.583083:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5701e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762881.583143:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140767872:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10991us (48078us total) trans 4294967747 rc 0/0 00000100:00100000:2.0:1789762881.583152:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 320 00000100:00100000:2.0:1789762881.583160:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286045190194 time 286045288125 state 0x2 ref 0 00000100:00100000:2.0:1789762881.585393:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.585431:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140768000 00000100:00100000:3.0:1789762881.585439:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140768000 00000100:00100000:3.0:1789762881.585482:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286045190194 time 286045288125 state 0x0 ref 1 00000100:00100000:3.0:1789762881.585498:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286095288125 time 286045288125 state 0x1 ref 1 00000100:00100000:1.0:1789762881.622207:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286095288125 time 286095356486 state 0x0 ref 1 00000100:00100000:1.0:1789762881.622230:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140768000:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762881.622277:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 59768832, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x1c809 00010000:00010000:1.0:1789762881.622286:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.622312:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:1.0:1789762881.622318:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762881.622324:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.622340:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762881.632930:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967748 is committed 00002000:00010000:1.0:1789762881.632945:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:1.0:1789762881.632951:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 116745 -> 118793 00010000:00010000:1.0:1789762881.632961:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.632971:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.632978:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.632983:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762881.632986:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.632993:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.633006:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.633010:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762881.633067:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140768000:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10844us (47672us total) trans 4294967748 rc 0/0 00000100:00100000:1.0:1789762881.633081:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 321 00000100:00100000:1.0:1789762881.633090:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286095288125 time 286095356486 state 0x2 ref 0 00000100:00100000:0.0:1789762881.635332:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.635364:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140768128 00000100:00100000:3.0:1789762881.635373:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140768128 00000100:00100000:3.0:1789762881.635411:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286095288125 time 286095356486 state 0x0 ref 1 00000100:00100000:3.0:1789762881.635428:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286145356486 time 286095356486 state 0x1 ref 1 00000100:00100000:2.0:1789762881.672277:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286145356486 time 286145431384 state 0x0 ref 1 00000100:00100000:2.0:1789762881.672299:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140768128:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762881.672347:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 60817408, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x1d009 00010000:00010000:2.0:1789762881.672354:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5701f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.672365:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1789762881.672368:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762881.672380:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5701f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.672390:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5701f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762881.682583:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967749 is committed 00002000:00010000:2.0:1789762881.682603:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:2.0:1789762881.682609:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 118793 -> 120841 00010000:00010000:2.0:1789762881.682620:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5701f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.682630:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5701f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.682637:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5701f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.682642:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762881.682646:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5701f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.682653:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5701f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.682666:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5701f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.682681:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5701f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762881.682744:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140768128:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10449us (47410us total) trans 4294967749 rc 0/0 00000100:00100000:2.0:1789762881.682752:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 322 00000100:00100000:2.0:1789762881.682761:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286145356486 time 286145431384 state 0x2 ref 0 00000100:00100000:0.0:1789762881.684877:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.684929:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140768256 00000100:00100000:3.0:1789762881.684937:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140768256 00000100:00100000:3.0:1789762881.684974:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286145356486 time 286145431384 state 0x0 ref 1 00000100:00100000:3.0:1789762881.684984:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286195431384 time 286145431384 state 0x1 ref 1 00000100:00100000:1.0:1789762881.722349:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286195431384 time 286195504796 state 0x0 ref 1 00000100:00100000:1.0:1789762881.722366:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140768256:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762881.722402:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 61865984, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x1d809 00010000:00010000:1.0:1789762881.722409:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.722420:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:1.0:1789762881.722423:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762881.722427:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.722437:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762881.733163:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967750 is committed 00002000:00010000:2.0:1789762881.733178:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:2.0:1789762881.733183:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 120841 -> 122889 00010000:00010000:2.0:1789762881.733194:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.733203:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.733210:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.733215:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762881.733218:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.733225:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.733248:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.733257:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759dae60/0xd08452c77c5701f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762881.733322:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140768256:12345-192.168.203.31@tcp:4:dd.0 Request processed in 10959us (48446us total) trans 4294967750 rc 0/0 00000100:00100000:2.0:1789762881.733330:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 323 00000100:00100000:2.0:1789762881.733338:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286195431384 time 286195504796 state 0x2 ref 0 00000100:00100000:1.0:1789762881.735312:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.735351:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140768384 00000100:00100000:3.0:1789762881.735359:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140768384 00000100:00100000:3.0:1789762881.735393:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286195431384 time 286195504796 state 0x0 ref 1 00000100:00100000:3.0:1789762881.735404:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286245504796 time 286195504796 state 0x1 ref 1 00000100:00100000:2.0:1789762881.772423:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286245504796 time 286245578960 state 0x0 ref 1 00000100:00100000:2.0:1789762881.772440:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140768384:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762881.772477:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 62914560, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x1e009 00010000:00010000:2.0:1789762881.772483:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c5701fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.772494:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1789762881.772497:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762881.772501:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c5701fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.772511:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c5701fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762881.784735:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967751 is committed 00002000:00010000:1.0:1789762881.784739:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:1.0:1789762881.784748:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 122889 -> 124937 00010000:00010000:1.0:1789762881.784761:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c5701fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.784772:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c5701fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.784787:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c5701fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.784792:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762881.784796:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c5701fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.784817:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c5701fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.784854:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c5701fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.784863:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c5701fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762881.784957:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140768384:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12517us (49641us total) trans 4294967751 rc 0/0 00000100:00100000:1.0:1789762881.784968:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 324 00000100:00100000:1.0:1789762881.784979:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286245504796 time 286245578960 state 0x2 ref 0 00000100:00100000:0.0:1789762881.787265:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.787330:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140768512 00000100:00100000:3.0:1789762881.787341:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140768512 00000100:00100000:3.0:1789762881.787389:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286245504796 time 286245578960 state 0x0 ref 1 00000100:00100000:3.0:1789762881.787401:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286295578960 time 286245578960 state 0x1 ref 1 00000100:00100000:2.0:1789762881.822523:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286295578960 time 286295677918 state 0x0 ref 1 00000100:00100000:2.0:1789762881.822541:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140768512:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762881.822582:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 63963136, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x1e809 00010000:00010000:2.0:1789762881.822589:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570205 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.822602:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1789762881.822605:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762881.822609:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.822620:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762881.835201:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967752 is committed 00002000:00010000:2.0:1789762881.835268:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:2.0:1789762881.835275:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 124937 -> 126985 00010000:00010000:2.0:1789762881.835286:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.835300:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.835309:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.835326:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762881.835331:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.835342:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570205 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.835360:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570205 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.835368:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570205 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762881.835427:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140768512:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12890us (48165us total) trans 4294967752 rc 0/0 00000100:00100000:2.0:1789762881.835434:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 325 00000100:00100000:2.0:1789762881.835443:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286295578960 time 286295677918 state 0x2 ref 0 00000100:00100000:2.0:1789762881.837447:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.837486:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140768640 00000100:00100000:3.0:1789762881.837495:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140768640 00000100:00100000:3.0:1789762881.837531:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286295578960 time 286295677918 state 0x0 ref 1 00000100:00100000:3.0:1789762881.837551:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286345677918 time 286295677918 state 0x1 ref 1 00000100:00100000:1.0:1789762881.872602:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286345677918 time 286345753824 state 0x0 ref 1 00000100:00100000:1.0:1789762881.872624:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140768640:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762881.872679:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 65011712, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x1f009 00010000:00010000:1.0:1789762881.872686:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57020c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.872699:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:1.0:1789762881.872702:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762881.872707:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57020c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.872719:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57020c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762881.884730:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 65011712 -> 66060288 00000001:00080000:0.0:1789762881.884736:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967753 is committed 00002000:00010000:1.0:1789762881.884736:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 126985 -> 129033 00010000:00010000:1.0:1789762881.884756:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57020c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.884767:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57020c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.884775:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57020c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.884780:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762881.884784:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57020c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.884813:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57020c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.884827:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57020c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.884852:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57020c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762881.884922:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140768640:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12304us (47474us total) trans 4294967753 rc 0/0 00000100:00100000:1.0:1789762881.884933:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 326 00000100:00100000:1.0:1789762881.884944:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286345677918 time 286345753824 state 0x2 ref 0 00000100:00100000:2.0:1789762881.887017:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.887057:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140768768 00000100:00100000:3.0:1789762881.887064:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140768768 00000100:00100000:3.0:1789762881.887109:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286345677918 time 286345753824 state 0x0 ref 1 00000100:00100000:3.0:1789762881.887125:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286395753824 time 286345753824 state 0x1 ref 1 00000100:00100000:2.0:1789762881.922672:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286395753824 time 286395823518 state 0x0 ref 1 00000100:00100000:2.0:1789762881.922694:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140768768:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762881.922738:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 66060288, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x1f809 00010000:00010000:2.0:1789762881.922755:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570213 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.922768:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1789762881.922772:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762881.922776:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.922787:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762881.934726:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967754 is committed 00002000:00010000:2.0:1789762881.934734:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:2.0:1789762881.934740:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 129033 -> 131081 00010000:00010000:2.0:1789762881.934750:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.934759:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570213 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.934766:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570213 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.934771:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762881.934775:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570213 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.934781:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570213 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.934817:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570213 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.934824:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570213 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762881.934896:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140768768:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12208us (47878us total) trans 4294967754 rc 0/0 00000100:00100000:2.0:1789762881.934903:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 327 00000100:00100000:2.0:1789762881.934911:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286395753824 time 286395823518 state 0x2 ref 0 00000100:00100000:0.0:1789762881.936950:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.936996:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140768896 00000100:00100000:3.0:1789762881.937004:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140768896 00000100:00100000:3.0:1789762881.937040:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286395753824 time 286395823518 state 0x0 ref 1 00000100:00100000:3.0:1789762881.937050:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286445823518 time 286395823518 state 0x1 ref 1 00000100:00100000:1.0:1789762881.972729:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286445823518 time 286445884100 state 0x0 ref 1 00000100:00100000:1.0:1789762881.972760:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140768896:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762881.972813:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 67108864, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x20009 00010000:00010000:1.0:1789762881.972820:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57021a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.972831:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:1.0:1789762881.972853:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762881.972858:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57021a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.972876:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57021a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762881.987941:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967755 is committed 00002000:00010000:3.0:1789762881.987942:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:3.0:1789762881.987955:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 131081 -> 133129 00010000:00010000:3.0:1789762881.987968:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57021a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.987979:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57021a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.987986:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57021a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.987991:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762881.988001:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57021a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.988008:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57021a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.988024:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57021a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.988029:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f3eb938/0xd08452c77c57021a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762881.988105:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140768896:12345-192.168.203.31@tcp:4:dd.0 Request processed in 15358us (51155us total) trans 4294967755 rc 0/0 00000100:00100000:3.0:1789762881.988115:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 328 00000100:00100000:3.0:1789762881.988125:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286445823518 time 286445884100 state 0x2 ref 0 00000100:00100000:2.0:1789762881.990357:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762881.990389:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140769024 00000100:00100000:3.0:1789762881.990398:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140769024 00000100:00100000:3.0:1789762881.990444:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286445823518 time 286445884100 state 0x0 ref 1 00000100:00100000:3.0:1789762881.990458:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286495884100 time 286445884100 state 0x1 ref 1 00000100:00100000:2.0:1789762882.022825:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286495884100 time 286495978105 state 0x0 ref 1 00000100:00100000:2.0:1789762882.022898:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140769024:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762882.022943:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 68157440, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x20809 00010000:00010000:2.0:1789762882.022952:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c570221 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.022968:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1789762882.022971:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762882.022977:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c570221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.023001:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c570221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762882.035442:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967756 is committed 00002000:00010000:3.0:1789762882.035464:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:3.0:1789762882.035471:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 133129 -> 135177 00010000:00010000:3.0:1789762882.035480:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c570221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.035495:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c570221 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.035502:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c570221 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.035508:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762882.035511:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c570221 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.035517:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c570221 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.035530:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c570221 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.035535:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c570221 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762882.035594:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140769024:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12703us (45237us total) trans 4294967756 rc 0/0 00000100:00100000:3.0:1789762882.035601:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 329 00000100:00100000:3.0:1789762882.035609:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286495884100 time 286495978105 state 0x2 ref 0 00000100:00100000:2.0:1789762882.038007:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.038059:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140769152 00000100:00100000:3.0:1789762882.038075:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140769152 00000100:00100000:3.0:1789762882.038131:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286495884100 time 286495978105 state 0x0 ref 1 00000100:00100000:3.0:1789762882.038148:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286545978105 time 286495978105 state 0x1 ref 1 00000100:00100000:3.0:1789762882.072862:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286545978105 time 286546016219 state 0x0 ref 1 00000100:00100000:3.0:1789762882.072879:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140769152:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:3.0:1789762882.072926:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 69206016, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x21009 00010000:00010000:3.0:1789762882.072933:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570228 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.072945:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:3.0:1789762882.072949:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762882.072953:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.072965:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762882.085377:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 69206016 -> 70254592 00000001:00080000:0.0:1789762882.085380:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967757 is committed 00002000:00010000:1.0:1789762882.085386:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 135177 -> 137225 00010000:00010000:1.0:1789762882.085398:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.085408:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570228 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.085415:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570228 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.085420:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762882.085423:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570228 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.085429:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570228 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.085443:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570228 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.085449:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570228 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762882.085516:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140769152:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12641us (47512us total) trans 4294967757 rc 0/0 00000100:00100000:1.0:1789762882.085524:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 330 00000100:00100000:1.0:1789762882.085532:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286545978105 time 286546016219 state 0x2 ref 0 00000100:00100000:0.0:1789762882.087828:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.087888:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140769280 00000100:00100000:3.0:1789762882.087896:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140769280 00000100:00100000:3.0:1789762882.087932:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286545978105 time 286546016219 state 0x0 ref 1 00000100:00100000:3.0:1789762882.087943:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286596016219 time 286546016219 state 0x1 ref 1 00000100:00100000:3.0:1789762882.122947:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286596016219 time 286596097050 state 0x0 ref 1 00000100:00100000:3.0:1789762882.122971:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140769280:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:3.0:1789762882.123017:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 70254592, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x21809 00010000:00010000:3.0:1789762882.123024:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c57022f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.123037:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:3.0:1789762882.123040:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762882.123045:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c57022f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.123056:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c57022f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762882.136049:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:1.0:1789762882.136056:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 137225 -> 139273 00000001:00080000:0.0:1789762882.136057:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967758 is committed 00010000:00010000:1.0:1789762882.136071:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c57022f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.136082:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c57022f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.136089:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c57022f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.136094:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762882.136098:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c57022f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.136104:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c57022f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.136118:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c57022f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.136135:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000140b2998/0xd08452c77c57022f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762882.136195:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140769280:12345-192.168.203.31@tcp:4:dd.0 Request processed in 13231us (48368us total) trans 4294967758 rc 0/0 00000100:00100000:1.0:1789762882.136202:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 331 00000100:00100000:1.0:1789762882.136211:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286596016219 time 286596097050 state 0x2 ref 0 00000100:00100000:2.0:1789762882.138284:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.138324:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140769408 00000100:00100000:3.0:1789762882.138333:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140769408 00000100:00100000:3.0:1789762882.138369:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286596016219 time 286596097050 state 0x0 ref 1 00000100:00100000:3.0:1789762882.138384:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286646097050 time 286596097050 state 0x1 ref 1 00000100:00100000:1.0:1789762882.173014:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286646097050 time 286646166502 state 0x0 ref 1 00000100:00100000:1.0:1789762882.173034:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140769408:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762882.173090:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 71303168, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x22009 00010000:00010000:1.0:1789762882.173099:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c570236 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.173116:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:1.0:1789762882.173120:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762882.173127:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c570236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.173141:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c570236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762882.185892:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:3.0:1789762882.185898:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 139273 -> 141321 00000001:00080000:0.0:1789762882.185907:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967759 is committed 00010000:00010000:3.0:1789762882.185910:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c570236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.185936:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c570236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.185943:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c570236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.185950:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043ac00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762882.185954:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c570236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.185960:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c570236 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.185975:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c570236 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.185980:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4aae037/0xd08452c77c570236 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762882.186053:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140769408:12345-192.168.203.31@tcp:4:dd.0 Request processed in 13022us (47767us total) trans 4294967759 rc 0/0 00000100:00100000:3.0:1789762882.186062:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 332 00000100:00100000:3.0:1789762882.186071:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286646097050 time 286646166502 state 0x2 ref 0 00000100:00100000:0.0:1789762882.188280:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.188330:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140769536 00000100:00100000:3.0:1789762882.188348:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140769536 00000100:00100000:3.0:1789762882.188388:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286646097050 time 286646166502 state 0x0 ref 1 00000100:00100000:3.0:1789762882.188399:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286696166502 time 286646166502 state 0x1 ref 1 00000100:00100000:0.0:1789762882.223105:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286696166502 time 286696253180 state 0x0 ref 1 00000100:00100000:0.0:1789762882.223135:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1463cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140769536:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789762882.223201:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 72351744, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x22809 00010000:00010000:0.0:1789762882.223210:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e543ffb/0xd08452c77c57023d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.223235:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:0.0:1789762882.223240:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762882.223246:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e543ffb/0xd08452c77c57023d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.223261:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e543ffb/0xd08452c77c57023d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762882.231703:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967379 is committed 00000001:00080000:2.0:1789762882.231720:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967378 is committed 00000001:00080000:0.0:1789762882.237242:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967760 is committed 00002000:00010000:1.0:1789762882.237251:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:1.0:1789762882.237263:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 141321 -> 143369 00010000:00010000:1.0:1789762882.237275:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e543ffb/0xd08452c77c57023d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.237285:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e543ffb/0xd08452c77c57023d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.237292:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e543ffb/0xd08452c77c57023d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.237297:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829be00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762882.237300:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e543ffb/0xd08452c77c57023d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.237307:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e543ffb/0xd08452c77c57023d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.237322:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e543ffb/0xd08452c77c57023d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.237327:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e543ffb/0xd08452c77c57023d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762882.237395:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1463cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140769536:12345-192.168.203.31@tcp:4:dd.0 Request processed in 14271us (49119us total) trans 4294967760 rc 0/0 00000100:00100000:1.0:1789762882.237405:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 333 00000100:00100000:1.0:1789762882.237414:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286696166502 time 286696253180 state 0x2 ref 0 00000100:00100000:0.0:1789762882.239488:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.239534:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140769664 00000100:00100000:3.0:1789762882.239542:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140769664 00000100:00100000:3.0:1789762882.239581:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286696166502 time 286696253180 state 0x0 ref 1 00000100:00100000:3.0:1789762882.239592:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286746253180 time 286696253180 state 0x1 ref 1 00000100:00100000:3.0:1789762882.273141:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286746253180 time 286746296201 state 0x0 ref 1 00000100:00100000:3.0:1789762882.273158:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140769664:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:3.0:1789762882.273196:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 73400320, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x23009 00010000:00010000:3.0:1789762882.273203:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570244 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.273214:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:3.0:1789762882.273218:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762882.273222:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570244 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.273232:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570244 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762882.286599:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967761 is committed 00002000:00010000:1.0:1789762882.286599:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:1.0:1789762882.286612:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 143369 -> 145417 00010000:00010000:1.0:1789762882.286625:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570244 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.286636:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570244 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.286645:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570244 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.286654:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762882.286660:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570244 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.286670:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570244 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.286690:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570244 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.286699:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570244 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762882.286774:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140769664:12345-192.168.203.31@tcp:4:dd.0 Request processed in 13617us (47285us total) trans 4294967761 rc 0/0 00000100:00100000:1.0:1789762882.286793:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 334 00000100:00100000:1.0:1789762882.286818:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286746253180 time 286746296201 state 0x2 ref 0 00000100:00100000:0.0:1789762882.288999:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.289044:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140769792 00000100:00100000:3.0:1789762882.289053:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140769792 00000100:00100000:3.0:1789762882.289092:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286746253180 time 286746296201 state 0x0 ref 1 00000100:00100000:3.0:1789762882.289103:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286796296201 time 286746296201 state 0x1 ref 1 00000100:00100000:1.0:1789762882.323253:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286796296201 time 286796407570 state 0x0 ref 1 00000100:00100000:1.0:1789762882.323272:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140769792:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762882.323313:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 74448896, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x23809 00010000:00010000:1.0:1789762882.323320:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c57024b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.323332:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:1.0:1789762882.323335:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762882.323340:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c57024b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.323351:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c57024b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762882.335317:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967762 is committed 00002000:00010000:1.0:1789762882.335329:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:1.0:1789762882.335336:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 145417 -> 147465 00010000:00010000:1.0:1789762882.335346:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c57024b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.335356:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c57024b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.335373:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c57024b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.335378:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762882.335381:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c57024b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.335387:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c57024b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.335401:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c57024b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.335406:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c57024b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762882.335465:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140769792:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12196us (46467us total) trans 4294967762 rc 0/0 00000100:00100000:1.0:1789762882.335471:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 335 00000100:00100000:1.0:1789762882.335479:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286796296201 time 286796407570 state 0x2 ref 0 00000100:00100000:0.0:1789762882.337537:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.337590:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140769920 00000100:00100000:3.0:1789762882.337600:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140769920 00000100:00100000:3.0:1789762882.337640:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286796296201 time 286796407570 state 0x0 ref 1 00000100:00100000:3.0:1789762882.337650:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286846407570 time 286796407570 state 0x1 ref 1 00000100:00100000:1.0:1789762882.373358:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286846407570 time 286846506922 state 0x0 ref 1 00000100:00100000:1.0:1789762882.373386:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140769920:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762882.373451:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 75497472, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x24009 00010000:00010000:1.0:1789762882.373459:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570252 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.373472:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:1.0:1789762882.373475:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762882.373480:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570252 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.373491:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570252 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762882.385595:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967763 is committed 00002000:00010000:2.0:1789762882.385626:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 75497472 -> 76546048 00002000:00010000:2.0:1789762882.385632:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 147465 -> 149513 00010000:00010000:2.0:1789762882.385644:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570252 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.385654:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570252 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.385661:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570252 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.385666:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762882.385670:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570252 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.385677:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570252 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.385692:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570252 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.385704:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025981f9d/0xd08452c77c570252 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762882.385778:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140769920:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12399us (48239us total) trans 4294967763 rc 0/0 00000100:00100000:2.0:1789762882.385787:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 336 00000100:00100000:2.0:1789762882.385815:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286846407570 time 286846506922 state 0x2 ref 0 00000100:00100000:2.0:1789762882.387996:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.388034:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140770048 00000100:00100000:3.0:1789762882.388042:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140770048 00000100:00100000:3.0:1789762882.388081:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286846407570 time 286846506922 state 0x0 ref 1 00000100:00100000:3.0:1789762882.388092:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286896506922 time 286846506922 state 0x1 ref 1 00000100:00100000:1.0:1789762882.423433:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286896506922 time 286896587493 state 0x0 ref 1 00000100:00100000:1.0:1789762882.423451:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140770048:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762882.423489:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 76546048, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x24809 00010000:00010000:1.0:1789762882.423496:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570259 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.423509:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:1.0:1789762882.423512:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762882.423516:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570259 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.423527:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570259 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762882.435822:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967764 is committed 00002000:00010000:1.0:1789762882.435823:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:1.0:1789762882.435831:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 149513 -> 151561 00010000:00010000:1.0:1789762882.435864:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570259 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.435875:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570259 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.435883:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570259 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.435889:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762882.435892:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570259 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.435898:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570259 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.435912:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570259 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.435916:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570259 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762882.435975:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140770048:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12528us (47978us total) trans 4294967764 rc 0/0 00000100:00100000:1.0:1789762882.435993:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 337 00000100:00100000:1.0:1789762882.436002:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286896506922 time 286896587493 state 0x2 ref 0 00000100:00100000:2.0:1789762882.438023:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.438058:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140770176 00000100:00100000:3.0:1789762882.438065:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140770176 00000100:00100000:3.0:1789762882.438105:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286896506922 time 286896587493 state 0x0 ref 1 00000100:00100000:3.0:1789762882.438118:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286946587493 time 286896587493 state 0x1 ref 1 00000100:00100000:2.0:1789762882.473546:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286946587493 time 286946696726 state 0x0 ref 1 00000100:00100000:2.0:1789762882.473568:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140770176:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762882.473615:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 77594624, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x25009 00010000:00010000:2.0:1789762882.473623:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570260 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.473636:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1789762882.473639:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762882.473643:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570260 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.473655:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570260 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762882.485435:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967765 is committed 00002000:00010000:2.0:1789762882.485481:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:2.0:1789762882.485489:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 151561 -> 153609 00010000:00010000:2.0:1789762882.485498:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570260 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.485507:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570260 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.485514:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570260 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.485519:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762882.485522:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570260 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.485529:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570260 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.485544:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570260 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.485549:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570260 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762882.485607:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140770176:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12044us (47584us total) trans 4294967765 rc 0/0 00000100:00100000:2.0:1789762882.485621:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 338 00000100:00100000:2.0:1789762882.485629:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286946587493 time 286946696726 state 0x2 ref 0 00000100:00100000:2.0:1789762882.487752:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.487788:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140770304 00000100:00100000:3.0:1789762882.487813:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140770304 00000100:00100000:3.0:1789762882.487866:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286946587493 time 286946696726 state 0x0 ref 1 00000100:00100000:3.0:1789762882.487877:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286996696726 time 286946696726 state 0x1 ref 1 00000100:00100000:1.0:1789762882.523616:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286996696726 time 286996771985 state 0x0 ref 1 00000100:00100000:1.0:1789762882.523635:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140770304:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762882.523670:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 78643200, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x25809 00010000:00010000:1.0:1789762882.523677:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570267 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.523688:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=286s v=(0 0) 00010000:00010000:1.0:1789762882.523691:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762882.523695:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570267 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.523705:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570267 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762882.536039:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967766 is committed 00002000:00010000:2.0:1789762882.536061:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 78643200 -> 79691776 00002000:00010000:2.0:1789762882.536066:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 153609 -> 155657 00010000:00010000:2.0:1789762882.536076:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570267 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.536086:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570267 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.536092:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570267 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.536098:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043b600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762882.536101:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570267 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.536107:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570267 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.536120:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570267 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.536125:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e81eafe7/0xd08452c77c570267 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762882.536186:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140770304:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12555us (48432us total) trans 4294967766 rc 0/0 00000100:00100000:2.0:1789762882.536196:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 339 00000100:00100000:2.0:1789762882.536206:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286996696726 time 286996771985 state 0x2 ref 0 00000100:00100000:0.0:1789762882.538204:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.538246:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140770432 00000100:00100000:3.0:1789762882.538261:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140770432 00000100:00100000:3.0:1789762882.538296:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 286996696726 time 286996771985 state 0x0 ref 1 00000100:00100000:3.0:1789762882.538306:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287046771985 time 286996771985 state 0x1 ref 1 00000100:00100000:2.0:1789762882.573678:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287046771985 time 287046831626 state 0x0 ref 1 00000100:00100000:2.0:1789762882.573697:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140770432:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762882.573736:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 79691776, mtime: 0x6aad9d41, atime: 0x0, ctime: 0x6aad9d41, blocks: 0x26009 00010000:00010000:2.0:1789762882.573743:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57026e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.573756:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789762882.573760:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762882.573764:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57026e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.573775:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57026e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762882.585482:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967767 is committed 00002000:00010000:1.0:1789762882.585488:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:1.0:1789762882.585494:0:11723:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb mtime from disk: 1789762881 -> 1789762882 00002000:00010000:1.0:1789762882.585497:0:11723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb ctime from disk: 1789762881 -> 1789762882 00002000:00010000:1.0:1789762882.585499:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 155657 -> 157705 00010000:00010000:1.0:1789762882.585510:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57026e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.585531:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57026e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.585538:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57026e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.585542:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762882.585546:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57026e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.585553:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57026e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.585572:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57026e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.585581:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57026e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762882.585659:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140770432:12345-192.168.203.31@tcp:4:dd.0 Request processed in 11964us (47457us total) trans 4294967767 rc 0/0 00000100:00100000:1.0:1789762882.585668:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 340 00000100:00100000:1.0:1789762882.585678:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287046771985 time 287046831626 state 0x2 ref 0 00000100:00100000:2.0:1789762882.587808:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.587862:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140770560 00000100:00100000:3.0:1789762882.587871:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140770560 00000100:00100000:3.0:1789762882.587908:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287046771985 time 287046831626 state 0x0 ref 1 00000100:00100000:3.0:1789762882.587919:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287096831626 time 287046831626 state 0x1 ref 1 00010000:00010000:2.0:1789762882.598937:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762882.623781:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287096831626 time 287096937063 state 0x0 ref 1 00000100:00100000:2.0:1789762882.623823:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140770560:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762882.623877:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 80740352, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x26809 00010000:00010000:2.0:1789762882.623886:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c570275 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.623902:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789762882.623907:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762882.623913:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c570275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.623927:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c570275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762882.635786:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 80740352 -> 81788928 00000001:00080000:0.0:1789762882.635789:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967768 is committed 00002000:00010000:1.0:1789762882.635812:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 157705 -> 159753 00010000:00010000:1.0:1789762882.635824:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c570275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.635854:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c570275 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.635861:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c570275 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.635866:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762882.635869:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c570275 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.635875:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c570275 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.635889:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c570275 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.635894:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c570275 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762882.635953:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140770560:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12132us (48158us total) trans 4294967768 rc 0/0 00000100:00100000:1.0:1789762882.635960:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 341 00000100:00100000:1.0:1789762882.635968:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287096831626 time 287096937063 state 0x2 ref 0 00000100:00100000:0.0:1789762882.638031:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.638076:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140770688 00000100:00100000:3.0:1789762882.638084:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140770688 00000100:00100000:3.0:1789762882.638117:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287096831626 time 287096937063 state 0x0 ref 1 00000100:00100000:3.0:1789762882.638128:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287146937063 time 287096937063 state 0x1 ref 1 00000100:00100000:1.0:1789762882.673889:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287146937063 time 287147040359 state 0x0 ref 1 00000100:00100000:1.0:1789762882.673914:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140770688:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762882.673960:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 81788928, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x27009 00010000:00010000:1.0:1789762882.673967:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c57027c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.673981:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:1.0:1789762882.673984:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762882.673988:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c57027c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.673999:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c57027c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762882.686743:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967769 is committed 00002000:00010000:2.0:1789762882.686761:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 81788928 -> 82837504 00002000:00010000:2.0:1789762882.686766:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 159753 -> 161801 00010000:00010000:2.0:1789762882.686776:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c57027c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.686785:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c57027c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.686804:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c57027c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.686810:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762882.686821:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c57027c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.686829:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c57027c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.686861:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c57027c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.686867:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c57027c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762882.686926:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140770688:12345-192.168.203.31@tcp:4:dd.0 Request processed in 13020us (48896us total) trans 4294967769 rc 0/0 00000100:00100000:2.0:1789762882.686934:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 342 00000100:00100000:2.0:1789762882.686943:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287146937063 time 287147040359 state 0x2 ref 0 00000100:00100000:0.0:1789762882.689012:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.689058:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140770816 00000100:00100000:3.0:1789762882.689067:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140770816 00000100:00100000:3.0:1789762882.689104:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287146937063 time 287147040359 state 0x0 ref 1 00000100:00100000:3.0:1789762882.689123:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287197040359 time 287147040359 state 0x1 ref 1 00000100:00100000:1.0:1789762882.723971:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287197040359 time 287197123633 state 0x0 ref 1 00000100:00100000:1.0:1789762882.723991:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140770816:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762882.724030:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 82837504, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x27809 00010000:00010000:1.0:1789762882.724037:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570283 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.724049:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:1.0:1789762882.724053:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762882.724066:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570283 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.724077:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570283 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762882.736488:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967770 is committed 00002000:00010000:1.0:1789762882.736490:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:1.0:1789762882.736503:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 161801 -> 163849 00010000:00010000:1.0:1789762882.736517:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570283 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.736532:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570283 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.736543:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570283 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.736550:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762882.736554:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570283 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.736561:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570283 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.736576:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570283 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.736590:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570283 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762882.736657:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140770816:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12671us (47649us total) trans 4294967770 rc 0/0 00000100:00100000:1.0:1789762882.736665:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 343 00000100:00100000:1.0:1789762882.736675:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287197040359 time 287197123633 state 0x2 ref 0 00000100:00100000:0.0:1789762882.739050:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.739098:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140770944 00000100:00100000:3.0:1789762882.739107:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140770944 00000100:00100000:3.0:1789762882.739147:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287197040359 time 287197123633 state 0x0 ref 1 00000100:00100000:3.0:1789762882.739158:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287247123633 time 287197123633 state 0x1 ref 1 00000100:00100000:2.0:1789762882.774060:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287247123633 time 287247210317 state 0x0 ref 1 00000100:00100000:2.0:1789762882.774084:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140770944:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762882.774132:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 83886080, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x28009 00010000:00010000:2.0:1789762882.774140:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c57028a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.774154:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789762882.774157:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762882.774173:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c57028a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.774184:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c57028a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762882.786562:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967771 is committed 00002000:00010000:2.0:1789762882.786649:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:2.0:1789762882.786654:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 163849 -> 165897 00010000:00010000:2.0:1789762882.786666:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c57028a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.786676:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c57028a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.786683:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c57028a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.786687:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762882.786691:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c57028a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.786698:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c57028a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.786713:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c57028a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.786729:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006b4858/0xd08452c77c57028a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762882.786816:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140770944:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12736us (47765us total) trans 4294967771 rc 0/0 00000100:00100000:2.0:1789762882.786825:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 344 00000100:00100000:2.0:1789762882.786863:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287247123633 time 287247210317 state 0x2 ref 0 00000100:00100000:0.0:1789762882.789029:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.789084:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140771072 00000100:00100000:3.0:1789762882.789093:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140771072 00000100:00100000:3.0:1789762882.789134:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287247123633 time 287247210317 state 0x0 ref 1 00000100:00100000:3.0:1789762882.789145:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287297210317 time 287247210317 state 0x1 ref 1 00000100:00100000:1.0:1789762882.824159:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287297210317 time 287297309930 state 0x0 ref 1 00000100:00100000:1.0:1789762882.824182:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140771072:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762882.824230:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 84934656, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x28809 00010000:00010000:1.0:1789762882.824238:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570291 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.824251:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:1.0:1789762882.824255:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762882.824259:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570291 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.824270:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570291 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762882.836269:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967772 is committed 00002000:00010000:2.0:1789762882.836334:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:2.0:1789762882.836339:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 165897 -> 167945 00010000:00010000:2.0:1789762882.836349:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570291 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.836359:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570291 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.836365:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570291 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.836370:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762882.836374:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570291 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.836381:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570291 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.836406:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570291 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.836412:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e25f248/0xd08452c77c570291 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762882.836472:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140771072:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12297us (47449us total) trans 4294967772 rc 0/0 00000100:00100000:2.0:1789762882.836482:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 345 00000100:00100000:2.0:1789762882.836492:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287297210317 time 287297309930 state 0x2 ref 0 00000100:00100000:0.0:1789762882.838550:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.838605:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140771200 00000100:00100000:3.0:1789762882.838613:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140771200 00000100:00100000:3.0:1789762882.838651:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287297210317 time 287297309930 state 0x0 ref 1 00000100:00100000:3.0:1789762882.838661:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287347309930 time 287297309930 state 0x1 ref 1 00000100:00100000:2.0:1789762882.874235:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287347309930 time 287347381849 state 0x0 ref 1 00000100:00100000:2.0:1789762882.874260:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140771200:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762882.874307:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 85983232, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x29009 00010000:00010000:2.0:1789762882.874314:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570298 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.874326:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789762882.874330:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762882.874335:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570298 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.874346:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570298 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762882.886874:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967773 is committed 00002000:00010000:2.0:1789762882.886877:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:2.0:1789762882.886883:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 167945 -> 169993 00010000:00010000:2.0:1789762882.886896:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570298 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.886906:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570298 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.886913:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570298 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.886918:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762882.886922:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570298 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.886929:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570298 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.886943:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570298 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.886948:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c570298 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762882.887011:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140771200:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12758us (48466us total) trans 4294967773 rc 0/0 00000100:00100000:2.0:1789762882.887027:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 346 00000100:00100000:2.0:1789762882.887036:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287347309930 time 287347381849 state 0x2 ref 0 00000100:00100000:0.0:1789762882.889066:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.889116:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140771328 00000100:00100000:3.0:1789762882.889125:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140771328 00000100:00100000:3.0:1789762882.889162:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287347309930 time 287347381849 state 0x0 ref 1 00000100:00100000:3.0:1789762882.889181:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287397381849 time 287347381849 state 0x1 ref 1 00000100:00100000:2.0:1789762882.924324:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287397381849 time 287397480397 state 0x0 ref 1 00000100:00100000:2.0:1789762882.924340:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140771328:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762882.924374:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 87031808, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x29809 00010000:00010000:2.0:1789762882.924380:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c57029f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.924391:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789762882.924394:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762882.924398:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c57029f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.924408:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c57029f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762882.937146:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 87031808 -> 88080384 00000001:00080000:0.0:1789762882.937152:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967774 is committed 00002000:00010000:1.0:1789762882.937163:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 169993 -> 172041 00010000:00010000:1.0:1789762882.937174:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c57029f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.937184:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c57029f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.937191:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c57029f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.937195:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762882.937198:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c57029f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.937205:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c57029f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.937217:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c57029f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.937222:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015d64091/0xd08452c77c57029f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762882.937275:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140771328:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12938us (48214us total) trans 4294967774 rc 0/0 00000100:00100000:1.0:1789762882.937286:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 347 00000100:00100000:1.0:1789762882.937294:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287397381849 time 287397480397 state 0x2 ref 0 00000100:00100000:0.0:1789762882.939218:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.939263:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140771456 00000100:00100000:3.0:1789762882.939270:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140771456 00000100:00100000:3.0:1789762882.939303:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287397381849 time 287397480397 state 0x0 ref 1 00000100:00100000:3.0:1789762882.939313:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287447480397 time 287397480397 state 0x1 ref 1 00000100:00100000:2.0:1789762882.974432:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287447480397 time 287447587041 state 0x0 ref 1 00000100:00100000:2.0:1789762882.974450:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140771456:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762882.974485:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 88080384, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x2a009 00010000:00010000:2.0:1789762882.974492:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c5702a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.974513:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789762882.974516:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762882.974520:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c5702a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.974530:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c5702a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762882.987131:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967775 is committed 00002000:00010000:2.0:1789762882.987175:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:2.0:1789762882.987181:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 172041 -> 174089 00010000:00010000:2.0:1789762882.987193:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c5702a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.987202:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c5702a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.987209:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c5702a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.987214:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762882.987218:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c5702a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.987225:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c5702a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.987252:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c5702a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.987258:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021625ca6/0xd08452c77c5702a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762882.987328:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140771456:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12880us (48109us total) trans 4294967775 rc 0/0 00000100:00100000:2.0:1789762882.987335:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 348 00000100:00100000:2.0:1789762882.987344:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287447480397 time 287447587041 state 0x2 ref 0 00000100:00100000:0.0:1789762882.989376:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762882.989418:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140771584 00000100:00100000:3.0:1789762882.989427:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140771584 00000100:00100000:3.0:1789762882.989466:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287447480397 time 287447587041 state 0x0 ref 1 00000100:00100000:3.0:1789762882.989477:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287497587041 time 287447587041 state 0x1 ref 1 00000100:00100000:1.0:1789762883.024517:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287497587041 time 287497668362 state 0x0 ref 1 00000100:00100000:1.0:1789762883.024554:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140771584:12345-192.168.203.31@tcp:4:dd.0 00000100:00080000:2.0:1789762883.024588:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1789762883.024602:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 89128960, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x2a809 00010000:00010000:1.0:1789762883.024611:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0e7264b/0xd08452c77c5702ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.024623:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:1.0:1789762883.024627:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762883.024632:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e7264b/0xd08452c77c5702ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.024643:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0e7264b/0xd08452c77c5702ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762883.037094:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967776 is committed 00002000:00010000:2.0:1789762883.037111:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:2.0:1789762883.037120:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 174089 -> 176137 00010000:00010000:2.0:1789762883.037129:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0e7264b/0xd08452c77c5702ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.037138:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e7264b/0xd08452c77c5702ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.037145:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0e7264b/0xd08452c77c5702ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.037150:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762883.037154:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0e7264b/0xd08452c77c5702ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.037167:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0e7264b/0xd08452c77c5702ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.037182:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0e7264b/0xd08452c77c5702ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.037187:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0e7264b/0xd08452c77c5702ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.037246:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140771584:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12714us (47872us total) trans 4294967776 rc 0/0 00000100:00100000:2.0:1789762883.037253:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 349 00000100:00100000:2.0:1789762883.037261:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287497587041 time 287497668362 state 0x2 ref 0 00000100:00100000:0.0:1789762883.039432:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.039477:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140771712 00000100:00100000:3.0:1789762883.039485:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140771712 00000100:00100000:3.0:1789762883.039522:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287497587041 time 287497668362 state 0x0 ref 1 00000100:00100000:3.0:1789762883.039532:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287547668362 time 287497668362 state 0x1 ref 1 00000100:00100000:2.0:1789762883.074580:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287547668362 time 287547735661 state 0x0 ref 1 00000100:00100000:2.0:1789762883.074598:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140771712:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762883.074635:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 90177536, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x2b009 00010000:00010000:2.0:1789762883.074641:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.074652:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789762883.074656:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762883.074660:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.074679:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762883.087255:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967777 is committed 00002000:00010000:2.0:1789762883.087264:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:2.0:1789762883.087271:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 176137 -> 178185 00010000:00010000:2.0:1789762883.087286:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.087300:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.087311:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.087318:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762883.087322:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.087328:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.087340:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.087345:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.087404:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140771712:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12808us (47973us total) trans 4294967777 rc 0/0 00000100:00100000:2.0:1789762883.087413:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 350 00000100:00100000:2.0:1789762883.087420:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287547668362 time 287547735661 state 0x2 ref 0 00000100:00100000:0.0:1789762883.089426:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.089472:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140771840 00000100:00100000:3.0:1789762883.089480:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140771840 00000100:00100000:3.0:1789762883.089514:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287547668362 time 287547735661 state 0x0 ref 1 00000100:00100000:3.0:1789762883.089523:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287597735661 time 287547735661 state 0x1 ref 1 00000100:00100000:2.0:1789762883.124659:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287597735661 time 287597814510 state 0x0 ref 1 00000100:00100000:2.0:1789762883.124677:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140771840:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762883.124713:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 91226112, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x2b809 00010000:00010000:2.0:1789762883.124720:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.124731:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789762883.124735:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762883.124739:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.124748:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762883.137419:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967778 is committed 00002000:00010000:2.0:1789762883.137459:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:2.0:1789762883.137464:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 178185 -> 180233 00010000:00010000:2.0:1789762883.137472:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.137491:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.137498:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.137502:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762883.137506:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.137512:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.137525:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.137530:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.137585:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140771840:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12911us (48161us total) trans 4294967778 rc 0/0 00000100:00100000:2.0:1789762883.137595:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 351 00000100:00100000:2.0:1789762883.137603:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287597735661 time 287597814510 state 0x2 ref 0 00000100:00100000:0.0:1789762883.139614:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.139658:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140771968 00000100:00100000:3.0:1789762883.139666:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140771968 00000100:00100000:3.0:1789762883.139702:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287597735661 time 287597814510 state 0x0 ref 1 00000100:00100000:3.0:1789762883.139712:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287647814510 time 287597814510 state 0x1 ref 1 00000100:00100000:2.0:1789762883.174741:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287647814510 time 287647894873 state 0x0 ref 1 00000100:00100000:2.0:1789762883.174766:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140771968:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762883.174814:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 92274688, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x2c009 00010000:00010000:2.0:1789762883.174821:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.174853:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789762883.174857:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762883.174862:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.174872:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762883.186825:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967779 is committed 00002000:00010000:1.0:1789762883.186865:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 92274688 -> 93323264 00002000:00010000:1.0:1789762883.186879:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 180233 -> 182281 00010000:00010000:1.0:1789762883.186901:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.186919:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.186931:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.186954:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762883.186960:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.186971:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.186998:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.187007:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9daff2/0xd08452c77c5702c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762883.187129:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140771968:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12360us (47512us total) trans 4294967779 rc 0/0 00000100:00100000:1.0:1789762883.187143:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 352 00000100:00100000:1.0:1789762883.187159:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287647814510 time 287647894873 state 0x2 ref 0 00000100:00100000:0.0:1789762883.189899:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.189934:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140772096 00000100:00100000:3.0:1789762883.189944:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140772096 00000100:00100000:3.0:1789762883.189987:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287647814510 time 287647894873 state 0x0 ref 1 00000100:00100000:3.0:1789762883.189998:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287697894873 time 287647894873 state 0x1 ref 1 00000100:00100000:2.0:1789762883.224923:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287697894873 time 287698073822 state 0x0 ref 1 00000100:00100000:2.0:1789762883.224972:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140772096:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762883.225036:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 93323264, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x2c809 00010000:00010000:2.0:1789762883.225047:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e26bda24/0xd08452c77c5702c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.225066:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789762883.225071:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762883.225078:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e26bda24/0xd08452c77c5702c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.225138:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e26bda24/0xd08452c77c5702c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762883.240588:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967780 is committed 00002000:00010000:2.0:1789762883.240663:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 93323264 -> 94371840 00002000:00010000:2.0:1789762883.240673:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 182281 -> 184329 00010000:00010000:2.0:1789762883.240688:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e26bda24/0xd08452c77c5702c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.240705:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e26bda24/0xd08452c77c5702c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.240717:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e26bda24/0xd08452c77c5702c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.240726:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762883.240732:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e26bda24/0xd08452c77c5702c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.240744:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e26bda24/0xd08452c77c5702c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.240766:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e26bda24/0xd08452c77c5702c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.240776:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e26bda24/0xd08452c77c5702c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.240930:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140772096:12345-192.168.203.31@tcp:4:dd.0 Request processed in 15972us (51032us total) trans 4294967780 rc 0/0 00000100:00100000:2.0:1789762883.240938:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 353 00000100:00100000:2.0:1789762883.240946:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287697894873 time 287698073822 state 0x2 ref 0 00000100:00100000:0.0:1789762883.243966:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.244045:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140772224 00000100:00100000:3.0:1789762883.244060:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140772224 00000100:00100000:3.0:1789762883.244127:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287697894873 time 287698073822 state 0x0 ref 1 00000100:00100000:3.0:1789762883.244138:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287748073822 time 287698073822 state 0x1 ref 1 00000100:00100000:1.0:1789762883.275049:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287748073822 time 287748196883 state 0x0 ref 1 00000100:00100000:1.0:1789762883.275079:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140772224:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762883.275133:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 94371840, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x2d009 00010000:00010000:1.0:1789762883.275140:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.275159:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:1.0:1789762883.275162:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762883.275167:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.275177:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762883.287399:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967781 is committed 00002000:00010000:1.0:1789762883.287399:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 94371840 -> 95420416 00002000:00010000:1.0:1789762883.287406:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 184329 -> 186379 00010000:00010000:1.0:1789762883.287416:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.287425:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.287432:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.287437:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762883.287441:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.287447:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.287471:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.287477:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762883.287531:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140772224:12345-192.168.203.31@tcp:4:dd.0 Request processed in 12462us (43570us total) trans 4294967781 rc 0/0 00000100:00100000:1.0:1789762883.287538:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 354 00000100:00100000:1.0:1789762883.287546:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287748073822 time 287748196883 state 0x2 ref 0 00000100:00100000:2.0:1789762883.289736:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.289779:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140772352 00000100:00100000:3.0:1789762883.289797:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140772352 00000100:00100000:3.0:1789762883.289852:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287748073822 time 287748196883 state 0x0 ref 1 00000100:00100000:3.0:1789762883.289864:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287798196883 time 287748196883 state 0x1 ref 1 00000100:00100000:2.0:1789762883.325191:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287798196883 time 287798319162 state 0x0 ref 1 00000100:00100000:2.0:1789762883.325225:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140772352:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762883.325290:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 95420416, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x2d80b 00010000:00010000:2.0:1789762883.325301:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c5702d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.325322:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789762883.325327:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762883.325335:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c5702d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.325358:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c5702d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762883.342502:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967782 is committed 00002000:00010000:2.0:1789762883.342559:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 95420416 -> 96468992 00002000:00010000:2.0:1789762883.342563:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 186379 -> 188427 00010000:00010000:2.0:1789762883.342573:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c5702d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.342589:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c5702d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.342597:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c5702d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.342602:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762883.342606:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c5702d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.342612:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c5702d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.342626:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c5702d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.342631:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c5702d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.342691:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140772352:12345-192.168.203.31@tcp:4:dd.0 Request processed in 17478us (52953us total) trans 4294967782 rc 0/0 00000100:00100000:2.0:1789762883.342698:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 355 00000100:00100000:2.0:1789762883.342707:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287798196883 time 287798319162 state 0x2 ref 0 00000100:00100000:2.0:1789762883.345942:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.346033:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140772480 00000100:00100000:3.0:1789762883.346048:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140772480 00000100:00100000:3.0:1789762883.346109:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287798196883 time 287798319162 state 0x0 ref 1 00000100:00100000:3.0:1789762883.346128:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287848319162 time 287798319162 state 0x1 ref 1 00000100:00100000:1.0:1789762883.375334:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287848319162 time 287848479638 state 0x0 ref 1 00000100:00100000:1.0:1789762883.375370:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140772480:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762883.375447:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 96468992, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x2e00b 00010000:00010000:1.0:1789762883.375464:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702de lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.375492:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:1.0:1789762883.375501:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762883.375513:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.375539:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762883.397725:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967783 is committed 00002000:00010000:1.0:1789762883.397902:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:1.0:1789762883.397912:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 188427 -> 190475 00010000:00010000:1.0:1789762883.397931:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.397949:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.397961:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.397971:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762883.397977:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.397990:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.398014:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702de lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.398024:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702de lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762883.398141:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140772480:12345-192.168.203.31@tcp:4:dd.0 Request processed in 22781us (52201us total) trans 4294967783 rc 0/0 00000100:00100000:1.0:1789762883.398170:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 356 00000100:00100000:1.0:1789762883.398187:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287848319162 time 287848479638 state 0x2 ref 0 00000100:00100000:2.0:1789762883.402254:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.402336:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140772608 00000100:00100000:3.0:1789762883.402353:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140772608 00000100:00100000:3.0:1789762883.402436:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287848319162 time 287848479638 state 0x0 ref 1 00000100:00100000:3.0:1789762883.402462:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287898479638 time 287848479638 state 0x1 ref 1 00000100:00100000:2.0:1789762883.425484:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287898479638 time 287898630359 state 0x0 ref 1 00000100:00100000:2.0:1789762883.425519:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140772608:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762883.425597:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 97517568, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x2e80b 00010000:00010000:2.0:1789762883.425613:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5702e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.425637:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789762883.425644:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762883.425652:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5702e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.425671:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5702e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762883.446377:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967784 is committed 00002000:00010000:2.0:1789762883.446494:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 97517568 -> 98566144 00002000:00010000:2.0:1789762883.446506:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 190475 -> 192523 00010000:00010000:2.0:1789762883.446527:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5702e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.446550:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5702e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.446567:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5702e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.446597:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762883.446604:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5702e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.446617:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5702e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.446639:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5702e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.446649:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce10a2fe/0xd08452c77c5702e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.446750:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140772608:12345-192.168.203.31@tcp:4:dd.0 Request processed in 21241us (44496us total) trans 4294967784 rc 0/0 00000100:00100000:2.0:1789762883.446763:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 357 00000100:00100000:2.0:1789762883.446777:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287898479638 time 287898630359 state 0x2 ref 0 00000100:00100000:2.0:1789762883.450567:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.450653:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140772736 00000100:00100000:3.0:1789762883.450665:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140772736 00000100:00100000:3.0:1789762883.450723:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287898479638 time 287898630359 state 0x0 ref 1 00000100:00100000:3.0:1789762883.450743:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287948630359 time 287898630359 state 0x1 ref 1 00000100:00100000:1.0:1789762883.475666:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287948630359 time 287948813836 state 0x0 ref 1 00000100:00100000:1.0:1789762883.475697:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140772736:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762883.475755:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 98566144, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x2f00b 00010000:00010000:1.0:1789762883.475767:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.475814:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:1.0:1789762883.475821:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762883.475829:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.475882:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762883.499220:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967785 is committed 00002000:00010000:1.0:1789762883.499225:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:1.0:1789762883.499236:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 192523 -> 194571 00010000:00010000:1.0:1789762883.499257:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.499276:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.499310:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.499320:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762883.499326:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.499338:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.499363:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.499374:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762883.499508:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140772736:12345-192.168.203.31@tcp:4:dd.0 Request processed in 23816us (48940us total) trans 4294967785 rc 0/0 00000100:00100000:1.0:1789762883.499521:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 358 00000100:00100000:1.0:1789762883.499559:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287948630359 time 287948813836 state 0x2 ref 0 00000100:00100000:0.0:1789762883.504091:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.504206:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140772864 00000100:00100000:3.0:1789762883.504220:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140772864 00000100:00100000:3.0:1789762883.504284:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287948630359 time 287948813836 state 0x0 ref 1 00000100:00100000:3.0:1789762883.504303:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287998813836 time 287948813836 state 0x1 ref 1 00000100:00100000:2.0:1789762883.525872:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287998813836 time 287998994861 state 0x0 ref 1 00000100:00100000:2.0:1789762883.525900:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140772864:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762883.525957:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 99614720, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x2f80b 00010000:00010000:2.0:1789762883.525969:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5702f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.526000:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789762883.526029:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762883.526037:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5702f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.526055:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5702f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762883.548119:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967786 is committed 00002000:00010000:2.0:1789762883.548214:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:2.0:1789762883.548223:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 194571 -> 196619 00010000:00010000:2.0:1789762883.548238:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5702f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.548255:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5702f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.548268:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5702f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.548277:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762883.548284:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5702f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.548296:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5702f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.548341:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5702f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.548352:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ebbee26/0xd08452c77c5702f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.548459:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140772864:12345-192.168.203.31@tcp:4:dd.0 Request processed in 22560us (44365us total) trans 4294967786 rc 0/0 00000100:00100000:2.0:1789762883.548478:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 359 00000100:00100000:2.0:1789762883.548498:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287998813836 time 287998994861 state 0x2 ref 0 00000100:00100000:0.0:1789762883.552248:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.552324:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140772992 00000100:00100000:3.0:1789762883.552337:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140772992 00000100:00100000:3.0:1789762883.552396:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 287998813836 time 287998994861 state 0x0 ref 1 00000100:00100000:3.0:1789762883.552414:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288048994861 time 287998994861 state 0x1 ref 1 00000100:00100000:1.0:1789762883.576002:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288048994861 time 288049149761 state 0x0 ref 1 00000100:00100000:1.0:1789762883.576033:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140772992:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1789762883.576108:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 100663296, mtime: 0x6aad9d42, atime: 0x0, ctime: 0x6aad9d42, blocks: 0x3000b 00010000:00010000:1.0:1789762883.576120:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.576141:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=288s v=(0 0) 00010000:00010000:1.0:1789762883.576146:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762883.576154:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.576171:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762883.598031:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967787 is committed 00002000:00010000:2.0:1789762883.598103:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:2.0:1789762883.598112:0:11723:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb mtime from disk: 1789762882 -> 1789762883 00002000:00010000:2.0:1789762883.598116:0:11723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb ctime from disk: 1789762882 -> 1789762883 00002000:00010000:2.0:1789762883.598120:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 196619 -> 198667 00010000:00010000:2.0:1789762883.598138:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.598156:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.598168:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.598177:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762883.598196:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.598210:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.598233:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.598244:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbcea42f/0xd08452c77c5702fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.598352:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140772992:12345-192.168.203.31@tcp:4:dd.0 Request processed in 22323us (46102us total) trans 4294967787 rc 0/0 00000100:00100000:2.0:1789762883.598366:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 360 00000100:00100000:2.0:1789762883.598382:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288048994861 time 288049149761 state 0x2 ref 0 00000100:00100000:2.0:1789762883.602163:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.602242:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140773120 00000100:00100000:3.0:1789762883.602257:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140773120 00000100:00100000:3.0:1789762883.602321:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288048994861 time 288049149761 state 0x0 ref 1 00000100:00100000:3.0:1789762883.602340:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288099149761 time 288049149761 state 0x1 ref 1 00010000:00010000:2.0:1789762883.623046:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762883.626193:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288099149761 time 288099343359 state 0x0 ref 1 00000100:00100000:2.0:1789762883.626222:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140773120:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762883.626277:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 101711872, mtime: 0x6aad9d43, atime: 0x0, ctime: 0x6aad9d43, blocks: 0x3080b 00010000:00010000:2.0:1789762883.626289:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570301 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.626329:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1789762883.626335:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762883.626342:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570301 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.626359:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570301 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762883.648946:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 101711872 -> 102760448 00000001:00080000:0.0:1789762883.648949:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967788 is committed 00002000:00010000:2.0:1789762883.648958:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 198667 -> 200715 00010000:00010000:2.0:1789762883.648979:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570301 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.648997:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570301 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.649010:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570301 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.649020:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762883.649027:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570301 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.649038:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570301 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.649081:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570301 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.649092:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570301 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.649185:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140773120:12345-192.168.203.31@tcp:4:dd.0 Request processed in 22968us (47022us total) trans 4294967788 rc 0/0 00000100:00100000:2.0:1789762883.649202:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 361 00000100:00100000:2.0:1789762883.649224:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288099149761 time 288099343359 state 0x2 ref 0 00000100:00100000:2.0:1789762883.652897:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.652972:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140773248 00000100:00100000:3.0:1789762883.652986:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140773248 00000100:00100000:3.0:1789762883.653046:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288099149761 time 288099343359 state 0x0 ref 1 00000100:00100000:3.0:1789762883.653064:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288149343359 time 288099343359 state 0x1 ref 1 00000100:00100000:2.0:1789762883.676355:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288149343359 time 288149480610 state 0x0 ref 1 00000100:00100000:2.0:1789762883.676392:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140773248:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762883.676463:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 102760448, mtime: 0x6aad9d43, atime: 0x0, ctime: 0x6aad9d43, blocks: 0x3100b 00010000:00010000:2.0:1789762883.676475:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570308 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.676497:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1789762883.676503:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762883.676511:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570308 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.676553:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570308 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762883.699142:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967789 is committed 00002000:00010000:2.0:1789762883.699172:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:2.0:1789762883.699182:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 200715 -> 202763 00010000:00010000:2.0:1789762883.699200:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570308 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.699218:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570308 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.699231:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570308 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.699241:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762883.699247:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570308 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.699259:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570308 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.699283:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570308 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.699292:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c570308 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.699402:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140773248:12345-192.168.203.31@tcp:4:dd.0 Request processed in 23019us (46503us total) trans 4294967789 rc 0/0 00000100:00100000:2.0:1789762883.699416:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 362 00000100:00100000:2.0:1789762883.699431:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288149343359 time 288149480610 state 0x2 ref 0 00000100:00100000:0.0:1789762883.703286:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.703365:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140773376 00000100:00100000:3.0:1789762883.703379:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140773376 00000100:00100000:3.0:1789762883.703441:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288149343359 time 288149480610 state 0x0 ref 1 00000100:00100000:3.0:1789762883.703460:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288199480610 time 288149480610 state 0x1 ref 1 00000100:00100000:2.0:1789762883.726487:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288199480610 time 288199636921 state 0x0 ref 1 00000100:00100000:2.0:1789762883.726513:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140773376:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:2.0:1789762883.726564:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 103809024, mtime: 0x6aad9d43, atime: 0x0, ctime: 0x6aad9d43, blocks: 0x3180b 00010000:00010000:2.0:1789762883.726575:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c57030f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.726593:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1789762883.726599:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762883.726606:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c57030f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.726623:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c57030f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762883.747735:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967790 is committed 00002000:00010000:2.0:1789762883.747871:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:2.0:1789762883.747880:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 202763 -> 204811 00010000:00010000:2.0:1789762883.747896:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c57030f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.747925:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c57030f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.747938:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c57030f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.747948:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a9c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762883.747953:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c57030f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.747964:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c57030f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.747984:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c57030f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.747994:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f65f2a/0xd08452c77c57030f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.748087:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140773376:12345-192.168.203.31@tcp:4:dd.0 Request processed in 21577us (44801us total) trans 4294967790 rc 0/0 00000100:00100000:2.0:1789762883.748100:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 363 00000100:00100000:2.0:1789762883.748114:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288199480610 time 288199636921 state 0x2 ref 0 00000100:00100000:0.0:1789762883.750699:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.750781:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140773632 00000100:00100000:3.0:1789762883.750819:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140773632 00000100:00080000:2.0:1789762883.750933:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762883.750981:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:3.0:1789762883.751010:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+8:12859:x1876702140773632:12345-192.168.203.31@tcp:35:dd.0 00000001:00080000:3.0:1789762883.751372:0:8160:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967478 00000100:00100000:3.0:1789762883.751490:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+10:12859:x1876702140773632:12345-192.168.203.31@tcp:35:dd.0 Request processed in 492us (793us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789762883.751500:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000020:00080000:3.0:1789762883.751506:0:8160:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789762883.794560:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762883.794663:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140773760 00000100:00100000:1.0:1789762883.794679:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140773760 00000100:00100000:1.0:1789762883.794768:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1789762883.794807:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a049c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+6:5572:x1876702140773760:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762883.794865:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789762883.794891:0:5797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb blocks from disk: 1 -> 16391 00010000:00010000:1.0:1789762883.794922:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf7b0c25/0xd08452c77c56feee lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e95c expref: 6 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.794956:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762883.795027:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a049c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+5:5572:x1876702140773760:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 246us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762883.795038:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1789762883.837044:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762883.837147:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140774016 00000100:00100000:1.0:1789762883.837173:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140774016 00000100:00100000:1.0:1789762883.837242:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:1.0:1789762883.837254:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+10:12875:x1876702140774016:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762883.837282:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762883.837316:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043bc00/0xd08452c77c570316 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9b0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.837452:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57031d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.837475:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57031d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.837496:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57031d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762883.837515:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 104857600 00010000:00010000:1.0:1789762883.837672:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043bc00/0xd08452c77c570316 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9b0 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.837693:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57031d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9b0 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.837703:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:1.0:1789762883.837707:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789762883.837711:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d15043b200, rc 0) 00000100:00100000:1.0:1789762883.837775:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+12:12875:x1876702140774016:12345-192.168.203.31@tcp:101:dd.0 Request processed in 523us (743us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789762883.837941:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:0.0:1789762883.840081:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.840145:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140774144 00000100:00100000:3.0:1789762883.840171:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140774144 00000100:00100000:3.0:1789762883.840227:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:3.0:1789762883.840239:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140774144:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762883.840254:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762883.840272:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c57032b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9b7 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762883.840303:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 104857600, mtime: 0x6aad9d43, atime: 0x0, ctime: 0x6aad9d43, blocks: 0x3200b 00010000:00010000:3.0:1789762883.840328:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=288s v=(0 0) 00010000:00010000:3.0:1789762883.840337:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762883.840353:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c57032b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9b7 expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.840381:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c57032b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9b7 expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.840433:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003ea00, rc 0) 00000100:00100000:3.0:1789762883.840487:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140774144:12345-192.168.203.31@tcp:101:dd.0 Request processed in 249us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762883.840497:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:0.0:1789762883.844821:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.844912:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140774272 00000100:00100000:3.0:1789762883.844926:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140774272 00000100:00100000:3.0:1789762883.844998:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 2 deadline 283011559888 time 282911582432 state 0x0 ref 1 00000100:00100000:3.0:1789762883.845023:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 2 deadline 283011582432 time 282911582432 state 0x1 ref 1 00000100:00100000:3.0:1789762883.845069:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 2 deadline 283011582432 time 288318224564 state 0x0 ref 1 00000100:00100000:3.0:1789762883.845097:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140774272:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762883.845138:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570332 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.845161:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762883.845167:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762883.845174:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570332 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.845190:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570332 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.852170:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570332 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.852189:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570332 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.852202:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570332 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.852212:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762883.852217:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570332 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.852229:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570332 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.852248:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570332 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.852257:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570332 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762883.852328:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140774272:12345-192.168.203.31@tcp:3:dd.0 Request processed in 7240us (7508us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762883.852340:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 364 00000100:00100000:3.0:1789762883.852353:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 2 deadline 283011582432 time 288318224564 state 0x2 ref 0 00000100:00100000:2.0:1789762883.855916:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762883.856008:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140774400 00000100:00100000:1.0:1789762883.856019:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140774400 00000100:00100000:1.0:1789762883.856066:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 2 deadline 283011582432 time 288318224564 state 0x0 ref 1 00000100:00100000:1.0:1789762883.856083:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 2 deadline 288418224564 time 288318224564 state 0x1 ref 1 00000100:00100000:1.0:1789762883.856123:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 1 deadline 288418224564 time 288329282358 state 0x0 ref 1 00000100:00100000:1.0:1789762883.856139:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140774400:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762883.856167:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570339 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.856183:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762883.856189:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762883.856195:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570339 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.856211:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570339 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.861148:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570339 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.861168:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570339 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.861197:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570339 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.861218:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043bc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762883.861223:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570339 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.861233:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570339 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.861249:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570339 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.861258:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389f7ec1/0xd08452c77c570339 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762883.861327:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140774400:12345-192.168.203.31@tcp:3:dd.0 Request processed in 5189us (5412us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762883.861337:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 365 00000100:00100000:1.0:1789762883.861348:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 1 deadline 288418224564 time 288329282358 state 0x2 ref 0 00000100:00100000:0.0:1789762883.864433:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762883.864519:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140774528 00000100:00100000:2.0:1789762883.864531:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140774528 00000100:00100000:2.0:1789762883.864585:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 1 deadline 288418224564 time 288329282358 state 0x0 ref 1 00000100:00100000:2.0:1789762883.864603:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 1 deadline 288429282358 time 288329282358 state 0x1 ref 1 00000100:00100000:2.0:1789762883.864646:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288429282358 time 288337805825 state 0x0 ref 1 00000100:00100000:2.0:1789762883.864662:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140774528:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:2.0:1789762883.864693:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570340 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.864710:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762883.864715:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762883.864723:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570340 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.864738:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570340 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.869124:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570340 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.869138:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570340 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.869161:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570340 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.869168:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762883.869173:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570340 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.869181:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570340 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.869198:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570340 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.869206:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c570340 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.869258:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140774528:12345-192.168.203.31@tcp:3:dd.0 Request processed in 4598us (4829us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762883.869268:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 366 00000100:00100000:2.0:1789762883.869278:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288429282358 time 288337805825 state 0x2 ref 0 00000100:00100000:2.0:1789762883.870985:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762883.871020:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140774656 00000100:00100000:3.0:1789762883.871025:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140774656 00000100:00100000:3.0:1789762883.871054:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288429282358 time 288337805825 state 0x0 ref 1 00000100:00100000:3.0:1789762883.871063:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288437805825 time 288337805825 state 0x1 ref 1 00000100:00100000:3.0:1789762883.964779:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288437805825 time 288437914713 state 0x0 ref 1 00000100:00100000:3.0:1789762883.964881:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140774656:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762883.964946:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570347 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.964973:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762883.964980:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762883.964991:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570347 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.965014:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570347 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.969973:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570347 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.969993:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570347 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.970030:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570347 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.970039:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762883.970045:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570347 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.970056:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570347 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.970078:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570347 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762883.970088:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570347 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762883.970168:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140774656:12345-192.168.203.31@tcp:3:dd.0 Request processed in 5341us (99180us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762883.970180:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 367 00000100:00100000:3.0:1789762883.970193:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288437805825 time 288437914713 state 0x2 ref 0 00000100:00100000:0.0:1789762883.973952:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762883.974060:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140774784 00000100:00100000:1.0:1789762883.974075:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140774784 00000100:00100000:1.0:1789762883.974138:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288437805825 time 288437914713 state 0x0 ref 1 00000100:00100000:1.0:1789762883.974157:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288537914713 time 288437914713 state 0x1 ref 1 00000100:00100000:2.0:1789762884.064862:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288537914713 time 288537996398 state 0x0 ref 1 00000100:00100000:2.0:1789762884.064885:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140774784:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:2.0:1789762884.064931:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57034e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.064945:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762884.064949:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762884.064953:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57034e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.064965:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57034e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.067897:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57034e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.067908:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57034e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.067922:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57034e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.067929:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1583a8800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762884.067932:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57034e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.067939:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57034e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.067953:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57034e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.067958:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009319b233/0xd08452c77c57034e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762884.068006:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140774784:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3129us (94059us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762884.068013:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 368 00000100:00100000:0.0:1789762884.068021:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288537914713 time 288537996398 state 0x2 ref 0 00000100:00100000:0.0:1789762884.069675:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762884.069710:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140774912 00000100:00100000:3.0:1789762884.069719:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140774912 00000100:00100000:3.0:1789762884.069754:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288537914713 time 288537996398 state 0x0 ref 1 00000100:00100000:3.0:1789762884.069774:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288637996398 time 288537996398 state 0x1 ref 1 00000100:00100000:3.0:1789762884.164925:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288637996398 time 288638074820 state 0x0 ref 1 00000100:00100000:3.0:1789762884.164951:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140774912:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762884.164985:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570355 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.164999:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762884.165002:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762884.165007:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570355 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.165017:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570355 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.168005:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570355 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.168015:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570355 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.168022:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570355 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.168039:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762884.168043:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570355 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.168049:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570355 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.168062:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570355 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.168067:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570355 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762884.168114:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140774912:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3173us (98438us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762884.168121:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 369 00000100:00100000:3.0:1789762884.168129:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288637996398 time 288638074820 state 0x2 ref 0 00000100:00100000:2.0:1789762884.169862:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762884.169905:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140775040 00000100:00100000:1.0:1789762884.169920:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140775040 00000100:00100000:1.0:1789762884.169955:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288637996398 time 288638074820 state 0x0 ref 1 00000100:00100000:1.0:1789762884.169966:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288738074820 time 288638074820 state 0x1 ref 1 00000100:00100000:0.0:1789762884.264978:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288738074820 time 288738130298 state 0x0 ref 1 00000100:00100000:0.0:1789762884.264998:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140775040:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762884.265040:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000690125b/0xd08452c77c57035c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.265057:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762884.265060:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762884.265066:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000690125b/0xd08452c77c57035c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.265079:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000690125b/0xd08452c77c57035c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.268147:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000690125b/0xd08452c77c57035c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.268158:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000690125b/0xd08452c77c57035c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.268166:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000690125b/0xd08452c77c57035c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.268172:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cbb200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762884.268177:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000690125b/0xd08452c77c57035c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.268183:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000690125b/0xd08452c77c57035c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.268209:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000690125b/0xd08452c77c57035c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.268215:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000690125b/0xd08452c77c57035c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762884.268275:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140775040:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3281us (98412us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762884.268283:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 370 00000100:00100000:2.0:1789762884.268291:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288738074820 time 288738130298 state 0x2 ref 0 00000100:00100000:3.0:1789762884.270117:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762884.270165:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140775168 00000100:00100000:0.0:1789762884.270173:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140775168 00000100:00100000:0.0:1789762884.270217:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288738074820 time 288738130298 state 0x0 ref 1 00000100:00100000:0.0:1789762884.270234:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288838130298 time 288738130298 state 0x1 ref 1 00000001:00080000:2.0:1789762884.271289:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967480 is committed 00000004:00080000:2.0:1789762884.271300:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000004:00080000:2.0:1789762884.271320:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000100:00100000:2.0:1789762884.271377:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149032320:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789762884.271391:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d160034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149032448:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789762884.271427:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762884.271461:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149032320 00000100:00100000:1.0:1789762884.271465:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149032320 00000100:00080000:3.0:1789762884.271498:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762884.271509:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789762884.271517:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149032320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789762884.271532:0:8803:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:8 count 1 00002000:00010000:1.0:1789762884.271551:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 8388608, mtime: 0x6aad9d3c, atime: 0x0, ctime: 0x6aad9d3c, blocks: 0x4007 00010000:00010000:1.0:1789762884.271557:0:8803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000389f7ec1/0xd08452c77c570363 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.271565:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=288s v=(0 0) 00010000:00010000:1.0:1789762884.271568:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762884.271572:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000389f7ec1/0xd08452c77c570363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.271580:0:8803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000389f7ec1/0xd08452c77c570363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.271586:0:8803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000389f7ec1/0xd08452c77c570363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.271592:0:8803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000389f7ec1/0xd08452c77c570363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.271611:0:8803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762884.271621:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762884.271628:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000389f7ec1/0xd08452c77c570363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.271637:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043bc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762884.271647:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000389f7ec1/0xd08452c77c570363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.271654:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000389f7ec1/0xd08452c77c570363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.271664:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000389f7ec1/0xd08452c77c570363 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.271669:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000389f7ec1/0xd08452c77c570363 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.271681:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762884.271683:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762884.271684:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762884.271918:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762884.271950:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149032448 00000100:00100000:2.0:1789762884.271956:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149032448 00000100:00080000:3.0:1789762884.271983:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762884.271994:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789762884.272003:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149032448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789762884.272017:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:12 count 1 00002000:00010000:2.0:1789762884.272035:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 8388608, mtime: 0x6aad9d3c, atime: 0x0, ctime: 0x6aad9d3c, blocks: 0x4007 00010000:00010000:2.0:1789762884.272040:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c57036a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.272057:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1789762884.272060:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762884.272064:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c57036a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.272073:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c57036a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.272079:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c57036a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.272084:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c57036a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.272100:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789762884.272116:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149032320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 599us (691us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1789762884.272125:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:0.0:1789762884.272131:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762884.272138:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c57036a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762884.272144:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967379 gen 2 00010000:00010000:0.0:1789762884.272148:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc14a9350) 00000004:00080000:3.0:1789762884.272151:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d148cd6300, transno 4294967379 00010000:00010000:0.0:1789762884.272153:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c57036a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.272162:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c57036a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762884.272171:0:3277:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d173d24000 x1876702149032320/t4294967380(4294967380) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789762900 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789762884.272184:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d173d24000/2, rc 0, transno 4294967380 00000100:00100000:3.0:1789762884.272189:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149032320:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789762884.272191:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c57036a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.272198:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c57036a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.272214:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762884.272216:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762884.272217:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762884.272750:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149032448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 749us (834us total) trans 4294967791 rc 0/0 00000100:00100000:2.0:1789762884.272756:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000004:00080000:0.0:1789762884.272777:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d160034000/2, rc 0, transno 4294967791 00000100:00100000:0.0:1789762884.272795:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d160034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149032448:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789762884.365080:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288838130298 time 288838229972 state 0x0 ref 1 00000100:00100000:3.0:1789762884.365105:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140775168:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762884.365141:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570371 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.365167:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762884.365171:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762884.365176:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570371 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.365187:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570371 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.367625:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570371 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.367636:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570371 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.367643:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570371 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.367649:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762884.367653:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570371 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.367659:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570371 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.367682:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570371 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.367689:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570371 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762884.367747:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140775168:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2652us (97632us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762884.367755:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 371 00000100:00100000:0.0:1789762884.367763:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288838130298 time 288838229972 state 0x2 ref 0 00000100:00100000:0.0:1789762884.369578:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762884.369623:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140775296 00000100:00100000:1.0:1789762884.369631:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140775296 00000100:00100000:1.0:1789762884.369668:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288838130298 time 288838229972 state 0x0 ref 1 00000100:00100000:1.0:1789762884.369678:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288938229972 time 288838229972 state 0x1 ref 1 00000100:00100000:2.0:1789762884.465178:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288938229972 time 288938327642 state 0x0 ref 1 00000100:00100000:2.0:1789762884.465202:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140775296:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:2.0:1789762884.465241:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c570378 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.465254:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762884.465270:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762884.465275:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c570378 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.465287:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c570378 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.467925:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c570378 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.467935:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c570378 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.467942:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c570378 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.467948:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762884.467952:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c570378 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.467958:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c570378 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.467970:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c570378 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.467974:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002705ff6f/0xd08452c77c570378 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762884.468034:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140775296:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2840us (98455us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762884.468042:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 372 00000100:00100000:2.0:1789762884.468050:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288938229972 time 288938327642 state 0x2 ref 0 00000100:00100000:1.0:1789762884.470043:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762884.470093:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140775424 00000100:00100000:0.0:1789762884.470101:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140775424 00000100:00100000:0.0:1789762884.470151:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 288938229972 time 288938327642 state 0x0 ref 1 00000100:00100000:0.0:1789762884.470162:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289038327642 time 288938327642 state 0x1 ref 1 00000100:00100000:0.0:1789762884.565256:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289038327642 time 289038405309 state 0x0 ref 1 00000100:00100000:0.0:1789762884.565281:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140775424:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762884.565318:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57037f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.565350:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762884.565354:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762884.565359:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57037f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.565371:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57037f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.567952:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57037f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.567962:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57037f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.567970:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57037f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.567976:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cde00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762884.567980:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57037f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.567987:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57037f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.568001:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57037f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.568017:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57037f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762884.568064:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140775424:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2793us (98021us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762884.568071:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 373 00000100:00100000:0.0:1789762884.568079:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289038327642 time 289038405309 state 0x2 ref 0 00000100:00100000:3.0:1789762884.570077:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762884.570118:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140775552 00000100:00100000:1.0:1789762884.570125:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140775552 00000100:00100000:1.0:1789762884.570161:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289038327642 time 289038405309 state 0x0 ref 1 00000100:00100000:1.0:1789762884.570172:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289138405309 time 289038405309 state 0x1 ref 1 00010000:00010000:2.0:1789762884.646948:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762884.665379:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289138405309 time 289138531282 state 0x0 ref 1 00000100:00100000:2.0:1789762884.665403:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140775552:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:2.0:1789762884.665439:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c570386 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.665453:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762884.665456:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762884.665461:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c570386 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.665471:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c570386 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.668219:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c570386 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.668231:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c570386 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.668238:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c570386 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.668247:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762884.668252:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c570386 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.668263:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c570386 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.668282:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c570386 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.668301:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065800d53/0xd08452c77c570386 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762884.668355:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140775552:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2961us (98279us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762884.668363:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 374 00000100:00100000:0.0:1789762884.668371:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289138405309 time 289138531282 state 0x2 ref 0 00000100:00100000:3.0:1789762884.670179:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762884.670245:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140775680 00000100:00100000:0.0:1789762884.670255:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140775680 00000100:00100000:0.0:1789762884.670298:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289138405309 time 289138531282 state 0x0 ref 1 00000100:00100000:0.0:1789762884.670312:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289238531282 time 289138531282 state 0x1 ref 1 00000100:00100000:0.0:1789762884.765452:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289238531282 time 289238602030 state 0x0 ref 1 00000100:00100000:0.0:1789762884.765475:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140775680:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762884.765510:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57038d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.765524:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762884.765528:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762884.765532:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57038d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.765560:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57038d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.768190:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57038d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.768203:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57038d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.768210:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57038d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.768215:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cde00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762884.768219:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57038d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.768225:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57038d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.768238:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57038d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.768246:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57038d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762884.768316:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140775680:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2848us (98137us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762884.768324:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 375 00000100:00100000:0.0:1789762884.768332:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289238531282 time 289238602030 state 0x2 ref 0 00000100:00100000:3.0:1789762884.770044:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762884.770093:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140775808 00000100:00100000:1.0:1789762884.770102:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140775808 00000100:00100000:1.0:1789762884.770137:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289238531282 time 289238602030 state 0x0 ref 1 00000100:00100000:1.0:1789762884.770148:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289338602030 time 289238602030 state 0x1 ref 1 00000100:00100000:0.0:1789762884.865567:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289338602030 time 289338717040 state 0x0 ref 1 00000100:00100000:0.0:1789762884.865592:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140775808:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762884.865629:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c570394 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.865642:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762884.865646:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762884.865651:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c570394 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.865661:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c570394 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.868399:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c570394 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.868412:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c570394 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.868442:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c570394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.868450:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cde00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762884.868456:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c570394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.868467:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c570394 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.868485:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c570394 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.868494:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c570394 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762884.868546:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140775808:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2962us (98502us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762884.868555:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 376 00000100:00100000:0.0:1789762884.868564:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289338602030 time 289338717040 state 0x2 ref 0 00000100:00100000:3.0:1789762884.870221:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762884.870260:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140775936 00000100:00100000:0.0:1789762884.870268:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140775936 00000100:00100000:0.0:1789762884.870302:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289338602030 time 289338717040 state 0x0 ref 1 00000100:00100000:0.0:1789762884.870320:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289438717040 time 289338717040 state 0x1 ref 1 00000100:00100000:0.0:1789762884.965628:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289438717040 time 289438777822 state 0x0 ref 1 00000100:00100000:0.0:1789762884.965651:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140775936:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762884.965687:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57039b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.965701:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762884.965704:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762884.965709:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57039b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.965721:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57039b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.968519:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57039b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.968533:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57039b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.968543:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57039b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.968565:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cde00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762884.968570:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57039b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.968580:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57039b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.968600:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57039b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.968609:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57039b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762884.968664:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140775936:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3021us (98443us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762884.968670:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 377 00000100:00100000:0.0:1789762884.968678:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289438717040 time 289438777822 state 0x2 ref 0 00000100:00100000:1.0:1789762884.970464:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762884.970525:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140776064 00000100:00100000:2.0:1789762884.970533:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140776064 00000100:00100000:2.0:1789762884.970571:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289438717040 time 289438777822 state 0x0 ref 1 00000100:00100000:2.0:1789762884.970581:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289538777822 time 289438777822 state 0x1 ref 1 00000100:00100000:0.0:1789762885.065713:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289538777822 time 289538863762 state 0x0 ref 1 00000100:00100000:0.0:1789762885.065747:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140776064:12345-192.168.203.31@tcp:3:dd.0 00000100:00080000:3.0:1789762885.065793:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762885.065798:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.065867:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.065872:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.065877:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.065888:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.068666:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.068681:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.068692:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.068702:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cde00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762885.068708:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.068718:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.068738:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.068761:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762885.068866:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140776064:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3106us (98371us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762885.068875:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 378 00000100:00100000:0.0:1789762885.068884:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289538777822 time 289538863762 state 0x2 ref 0 00000100:00100000:2.0:1789762885.070748:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762885.070792:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140776192 00000100:00100000:0.0:1789762885.070799:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140776192 00000100:00100000:0.0:1789762885.070856:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289538777822 time 289538863762 state 0x0 ref 1 00000100:00100000:0.0:1789762885.070868:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289638863762 time 289538863762 state 0x1 ref 1 00000100:00100000:0.0:1789762885.165821:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289638863762 time 289638966964 state 0x0 ref 1 00000100:00100000:0.0:1789762885.165890:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140776192:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762885.165934:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.165948:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.165952:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.165957:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.165985:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.168925:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.168941:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.168951:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.168960:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cde00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762885.168964:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.168975:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.168992:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.169002:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762885.169081:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140776192:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3205us (98332us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762885.169092:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 379 00000100:00100000:0.0:1789762885.169104:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289638863762 time 289638966964 state 0x2 ref 0 00000100:00100000:3.0:1789762885.170913:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762885.170957:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140776320 00000100:00100000:2.0:1789762885.170966:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140776320 00000100:00100000:2.0:1789762885.171003:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289638863762 time 289638966964 state 0x0 ref 1 00000100:00100000:2.0:1789762885.171013:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289738966964 time 289638966964 state 0x1 ref 1 00000100:00100000:0.0:1789762885.265901:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289738966964 time 289739051020 state 0x0 ref 1 00000100:00100000:0.0:1789762885.265925:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140776320:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762885.265960:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.265974:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.265977:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.265981:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.265992:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.268945:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.268956:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.268975:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.268981:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cde00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762885.268984:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.268991:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.269004:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.269010:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762885.269054:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140776320:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3138us (98143us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762885.269061:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 380 00000100:00100000:0.0:1789762885.269068:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289738966964 time 289739051020 state 0x2 ref 0 00000100:00100000:1.0:1789762885.270909:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762885.270944:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140776448 00000100:00100000:0.0:1789762885.270951:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140776448 00000100:00100000:0.0:1789762885.270984:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289738966964 time 289739051020 state 0x0 ref 1 00000100:00100000:0.0:1789762885.271005:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289839051020 time 289739051020 state 0x1 ref 1 00000100:00100000:3.0:1789762885.286967:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149032704:0@lo:400:kworker.0 00000100:00100000:0.0:1789762885.286979:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d04320f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149032576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762885.287003:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d150cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149032832:0@lo:400:kworker.0 00000100:00100000:3.0:1789762885.287026:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762885.287027:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762885.287042:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762885.287071:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149032704 00000100:00100000:1.0:1789762885.287077:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149032704 00000100:00100000:0.0:1789762885.287081:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d150cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149033216:0@lo:400:kworker.0 00000100:00100000:2.0:1789762885.287081:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d150caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149033344:0@lo:400:kworker.0 00000100:00100000:3.0:1789762885.287088:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d150cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149033088:0@lo:400:kworker.0 00000100:00100000:1.0:1789762885.287111:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789762885.287120:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a133c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149032704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762885.287126:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762885.287134:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762885.287152:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149033344 00000100:00100000:3.0:1789762885.287158:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149033344 00000100:00100000:1.0:1789762885.287184:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a133c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149032704:12345-0@lo:400:kworker.0 Request processed in 65us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762885.287192:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762885.287194:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149032832 00000100:00100000:1.0:1789762885.287195:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789762885.287201:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149032832 00000100:00100000:3.0:1789762885.287201:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789762885.287213:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149033344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762885.287234:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149032704:0@lo:400:kworker.0 00000100:00100000:1.0:1789762885.287235:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149032576 00000100:00100000:0.0:1789762885.287239:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149033216 00000100:00100000:1.0:1789762885.287243:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149032576 00000100:00100000:2.0:1789762885.287254:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789762885.287257:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149033216 00000100:00100000:2.0:1789762885.287264:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d150caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149032960:0@lo:400:kworker.0 00000100:00100000:3.0:1789762885.287272:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3277:x1876702149033344:12345-0@lo:400:kworker.0 Request processed in 61us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762885.287281:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789762885.287292:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762885.287297:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789762885.287301:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149033088 00000100:00100000:0.0:1789762885.287304:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149032960 00000100:00100000:1.0:1789762885.287309:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149032576:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762885.287311:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149032960 00000100:00100000:3.0:1789762885.287312:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149033088 00002000:00000024:1.0:1789762885.287336:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 13631488 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789762885.287347:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d150caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149033344:0@lo:400:kworker.0 00000100:00100000:0.0:1789762885.287348:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789762885.287348:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789762885.287364:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149032832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762885.287364:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149033088:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789762885.287378:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762885.287382:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149032576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762885.287388:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789762885.287409:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789762885.287418:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789762885.287424:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149032832:12345-0@lo:400:kworker.0 Request processed in 61us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762885.287425:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149033216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762885.287426:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149033088:12345-0@lo:400:kworker.0 Request processed in 63us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762885.287433:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149032960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762885.287445:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789762885.287445:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789762885.287477:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149033216:12345-0@lo:400:kworker.0 Request processed in 60us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762885.287485:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789762885.287490:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d150cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149032832:0@lo:400:kworker.0 00000100:00100000:1.0:1789762885.287492:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149032960:12345-0@lo:400:kworker.0 Request processed in 61us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762885.287501:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d150caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149032960:0@lo:400:kworker.0 00000100:00100000:1.0:1789762885.287502:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789762885.287526:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d150cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149033088:0@lo:400:kworker.0 00000100:00100000:0.0:1789762885.287561:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d04320f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149032576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762885.287573:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d150cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149033216:0@lo:400:kworker.0 00000100:00100000:0.0:1789762885.366055:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289839051020 time 289839195154 state 0x0 ref 1 00000100:00100000:0.0:1789762885.366093:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140776448:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762885.366168:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.366200:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.366206:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.366214:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.366234:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.371670:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.371696:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.371710:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.371719:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cde00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762885.371725:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.371736:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.371804:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.371828:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762885.371964:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140776448:12345-192.168.203.31@tcp:3:dd.0 Request processed in 5880us (101047us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762885.371997:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 381 00000100:00100000:0.0:1789762885.372007:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289839051020 time 289839195154 state 0x2 ref 0 00000100:00100000:2.0:1789762885.375444:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762885.375494:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140776576 00000100:00100000:1.0:1789762885.375503:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140776576 00000100:00100000:1.0:1789762885.375541:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289839051020 time 289839195154 state 0x0 ref 1 00000100:00100000:1.0:1789762885.375551:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289939195154 time 289839195154 state 0x1 ref 1 00000100:00100000:0.0:1789762885.466216:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289939195154 time 289939358085 state 0x0 ref 1 00000100:00100000:0.0:1789762885.466252:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140776576:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762885.466304:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703be lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.466327:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.466333:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.466342:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.466360:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.471629:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.471660:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.471682:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.471700:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cde00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762885.471710:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.471730:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.471759:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703be lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.471798:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5703be lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762885.471939:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140776576:12345-192.168.203.31@tcp:3:dd.0 Request processed in 5696us (96490us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762885.471956:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 382 00000100:00100000:0.0:1789762885.471984:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289939195154 time 289939358085 state 0x2 ref 0 00000100:00100000:0.0:1789762885.475943:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762885.476004:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140776704 00000100:00100000:3.0:1789762885.476017:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140776704 00000100:00100000:3.0:1789762885.476093:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 289939195154 time 289939358085 state 0x0 ref 1 00000100:00100000:3.0:1789762885.476112:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290039358085 time 289939358085 state 0x1 ref 1 00000100:00100000:2.0:1789762885.492578:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762885.492648:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762885.492706:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762885.492798:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140776960 00000100:00100000:2.0:1789762885.492810:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762885.492813:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140776832 00000100:00100000:0.0:1789762885.492816:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140776960 00000100:00100000:3.0:1789762885.492830:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140776832 00000100:00100000:1.0:1789762885.492896:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140777216 00000100:00100000:2.0:1789762885.492922:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140777088 00000100:00100000:1.0:1789762885.492925:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140777216 00000100:00100000:2.0:1789762885.492934:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140777088 00000100:00100000:3.0:1789762885.492959:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 285 00000100:00100000:3.0:1789762885.492982:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140776832:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762885.492993:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:0.0:1789762885.493015:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140776960:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762885.493025:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:1.0:1789762885.493043:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:2.0:1789762885.493052:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140777088:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762885.493082:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140777216:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762885.493083:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140776832:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 98us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762885.493106:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140776960:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 91us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762885.493118:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 285 00000100:00100000:2.0:1789762885.493127:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140777088:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 80us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762885.493140:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:2.0:1789762885.493152:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:1.0:1789762885.493164:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140777216:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 99us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762885.493177:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00080000:1.0:1789762885.493248:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762885.493258:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762885.566374:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290039358085 time 290039515220 state 0x0 ref 1 00000100:00100000:0.0:1789762885.566411:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140776704:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762885.566466:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703c5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.566488:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762885.566494:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.566503:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.566524:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.571601:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.571656:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.571673:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.571683:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cda00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762885.571689:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.571701:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.571724:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.571735:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762885.571895:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140776704:12345-192.168.203.31@tcp:3:dd.0 Request processed in 5493us (95954us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762885.571909:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 383 00000100:00100000:0.0:1789762885.571924:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290039358085 time 290039515220 state 0x2 ref 0 00000100:00100000:0.0:1789762885.575635:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762885.575808:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140777344 00000100:00100000:1.0:1789762885.575822:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140777344 00000100:00100000:1.0:1789762885.575934:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290039358085 time 290039515220 state 0x0 ref 1 00000100:00100000:1.0:1789762885.575954:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290139515220 time 290039515220 state 0x1 ref 1 00000100:00100000:0.0:1789762885.666563:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290139515220 time 290139703922 state 0x0 ref 1 00000100:00100000:0.0:1789762885.666600:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140777344:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762885.666655:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703cc lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.666679:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.666685:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.666694:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.666713:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.671050:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762885.671943:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.671964:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.671976:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.671987:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cda00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762885.671994:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.672006:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.672054:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.672065:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f818f17d/0xd08452c77c5703cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762885.672155:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140777344:12345-192.168.203.31@tcp:3:dd.0 Request processed in 5566us (96521us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762885.672169:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 384 00000100:00100000:2.0:1789762885.672183:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290139515220 time 290139703922 state 0x2 ref 0 00000100:00100000:2.0:1789762885.675598:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762885.675676:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140777472 00000100:00100000:3.0:1789762885.675691:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140777472 00000100:00100000:3.0:1789762885.675766:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290139515220 time 290139703922 state 0x0 ref 1 00000100:00100000:3.0:1789762885.675821:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290239703922 time 290139703922 state 0x1 ref 1 00000100:00100000:0.0:1789762885.766882:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290239703922 time 290239968701 state 0x0 ref 1 00000100:00100000:0.0:1789762885.766925:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140777472:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762885.766979:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c5703d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.767001:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.767007:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.767015:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c5703d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.767034:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c5703d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.772325:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c5703d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.772348:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c5703d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.772361:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c5703d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.772370:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cca00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762885.772377:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c5703d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.772388:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c5703d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.772410:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c5703d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.772419:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c5703d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762885.772509:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140777472:12345-192.168.203.31@tcp:3:dd.0 Request processed in 5600us (96912us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762885.772522:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 385 00000100:00100000:0.0:1789762885.772549:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290239703922 time 290239968701 state 0x2 ref 0 00000100:00100000:3.0:1789762885.776112:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762885.776212:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140777600 00000100:00100000:1.0:1789762885.776226:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140777600 00000100:00100000:1.0:1789762885.776294:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290239703922 time 290239968701 state 0x0 ref 1 00000100:00100000:1.0:1789762885.776321:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290339968701 time 290239968701 state 0x1 ref 1 00000100:00100000:0.0:1789762885.799183:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d04320f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149033472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762885.799287:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762885.799360:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149033472 00000100:00100000:3.0:1789762885.799373:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149033472 00000100:00100000:3.0:1789762885.799440:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789762885.799454:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149033472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762885.799498:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526712832 pending 0 free 3746562048 avail 3744464896 00000100:00100000:3.0:1789762885.799569:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149033472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762885.799580:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789762885.799645:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d04320f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149033472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762885.866947:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290339968701 time 290340090781 state 0x0 ref 1 00000100:00100000:2.0:1789762885.866975:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140777600:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:2.0:1789762885.867023:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c5703da lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.867042:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762885.867048:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762885.867054:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c5703da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.867070:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c5703da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.870181:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c5703da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.870199:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c5703da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.870211:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c5703da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.870221:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762885.870226:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c5703da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.870233:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c5703da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.870246:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c5703da lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.870254:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c5703da lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762885.870327:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140777600:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3358us (94216us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762885.870339:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 386 00000100:00100000:2.0:1789762885.870367:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290339968701 time 290340090781 state 0x2 ref 0 00000100:00100000:1.0:1789762885.872394:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762885.872443:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140777728 00000100:00100000:3.0:1789762885.872453:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140777728 00000100:00100000:3.0:1789762885.872493:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290339968701 time 290340090781 state 0x0 ref 1 00000100:00100000:3.0:1789762885.872504:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290440090781 time 290340090781 state 0x1 ref 1 00000100:00100000:0.0:1789762885.967034:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290440090781 time 290440181456 state 0x0 ref 1 00000100:00100000:0.0:1789762885.967067:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140777728:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762885.967104:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001cb447af/0xd08452c77c5703e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.967118:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.967121:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762885.967126:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cb447af/0xd08452c77c5703e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762885.967137:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cb447af/0xd08452c77c5703e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.970132:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001cb447af/0xd08452c77c5703e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.970143:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cb447af/0xd08452c77c5703e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.970150:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cb447af/0xd08452c77c5703e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.970155:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829b200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762885.970158:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cb447af/0xd08452c77c5703e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.970174:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cb447af/0xd08452c77c5703e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.970187:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cb447af/0xd08452c77c5703e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.970192:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cb447af/0xd08452c77c5703e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762885.970245:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140777728:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3186us (97852us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762885.970255:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 387 00000100:00100000:3.0:1789762885.970266:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290440090781 time 290440181456 state 0x2 ref 0 00000100:00100000:1.0:1789762885.972092:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762885.972135:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140777856 00000100:00100000:2.0:1789762885.972143:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140777856 00000100:00100000:2.0:1789762885.972181:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290440090781 time 290440181456 state 0x0 ref 1 00000100:00100000:2.0:1789762885.972192:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290540181456 time 290440181456 state 0x1 ref 1 00000100:00100000:2.0:1789762886.067089:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290540181456 time 290540240124 state 0x0 ref 1 00000100:00100000:2.0:1789762886.067109:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140777856:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:2.0:1789762886.067143:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c5703e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762886.067157:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762886.067160:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762886.067164:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c5703e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762886.067175:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c5703e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.070153:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c5703e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.070166:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c5703e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.070174:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c5703e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.070186:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762886.070190:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c5703e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.070197:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c5703e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.070211:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c5703e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.070218:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c5703e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762886.070284:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140777856:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3179us (98191us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762886.070293:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 388 00000100:00100000:0.0:1789762886.070301:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290540181456 time 290540240124 state 0x2 ref 0 00000100:00100000:1.0:1789762886.072037:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762886.072086:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140777984 00000100:00100000:3.0:1789762886.072093:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140777984 00000100:00100000:3.0:1789762886.072129:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290540181456 time 290540240124 state 0x0 ref 1 00000100:00100000:3.0:1789762886.072139:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290640240124 time 290540240124 state 0x1 ref 1 00000100:00100000:3.0:1789762886.167166:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290640240124 time 290640315269 state 0x0 ref 1 00000100:00100000:3.0:1789762886.167191:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140777984:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762886.167247:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703ef lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.167280:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762886.167285:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762886.167290:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.167302:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.170129:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.170140:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.170149:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.170158:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fec00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762886.170163:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.170173:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.170192:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.170212:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762886.170262:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140777984:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3082us (98226us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762886.170269:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 389 00000100:00100000:3.0:1789762886.170277:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290640240124 time 290640315269 state 0x2 ref 0 00000100:00100000:1.0:1789762886.172070:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762886.172118:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140778112 00000100:00100000:2.0:1789762886.172126:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140778112 00000100:00100000:2.0:1789762886.172163:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290640240124 time 290640315269 state 0x0 ref 1 00000100:00100000:2.0:1789762886.172175:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290740315269 time 290640315269 state 0x1 ref 1 00000100:00100000:0.0:1789762886.267240:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290740315269 time 290740389497 state 0x0 ref 1 00000100:00100000:0.0:1789762886.267262:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140778112:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762886.267298:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5703f6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.267338:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762886.267342:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762886.267346:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5703f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.267358:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5703f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.270009:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5703f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.270025:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5703f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.270036:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5703f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.270045:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148cc4e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762886.270050:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5703f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.270061:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5703f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.270080:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5703f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.270103:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5703f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762886.270168:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140778112:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2912us (98099us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762886.270176:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 390 00000100:00100000:0.0:1789762886.270184:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290740315269 time 290740389497 state 0x2 ref 0 00000100:00100000:1.0:1789762886.271949:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762886.271990:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140778240 00000100:00100000:3.0:1789762886.271998:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140778240 00000100:00100000:3.0:1789762886.272031:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290740315269 time 290740389497 state 0x0 ref 1 00000100:00100000:3.0:1789762886.272041:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290840389497 time 290740389497 state 0x1 ref 1 00000100:00100000:3.0:1789762886.367301:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290840389497 time 290840453006 state 0x0 ref 1 00000100:00100000:3.0:1789762886.367324:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140778240:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762886.367356:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703fd lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.367368:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762886.367372:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762886.367376:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.367401:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.370224:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.370234:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.370240:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.370245:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fec00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762886.370248:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.370254:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.370266:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.370271:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c5703fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762886.370325:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140778240:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3008us (98376us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762886.370332:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 391 00000100:00100000:3.0:1789762886.370340:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290840389497 time 290840453006 state 0x2 ref 0 00000100:00100000:1.0:1789762886.372122:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762886.372166:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140778368 00000100:00100000:2.0:1789762886.372175:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140778368 00000100:00100000:2.0:1789762886.372217:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290840389497 time 290840453006 state 0x0 ref 1 00000100:00100000:2.0:1789762886.372227:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290940453006 time 290840453006 state 0x1 ref 1 00000100:00100000:0.0:1789762886.467408:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290940453006 time 290940557192 state 0x0 ref 1 00000100:00100000:0.0:1789762886.467432:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140778368:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762886.467468:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c570404 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.467482:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762886.467486:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762886.467490:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c570404 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.467502:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c570404 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.470222:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c570404 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.470246:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c570404 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.470252:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c570404 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.470258:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148cc4e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762886.470261:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c570404 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.470268:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c570404 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.470287:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c570404 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.470292:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c570404 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762886.470345:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140778368:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2921us (98223us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762886.470356:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 392 00000100:00100000:0.0:1789762886.470366:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290940453006 time 290940557192 state 0x2 ref 0 00000100:00100000:2.0:1789762886.472155:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762886.472195:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140778496 00000100:00100000:3.0:1789762886.472204:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140778496 00000100:00100000:3.0:1789762886.472241:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 290940453006 time 290940557192 state 0x0 ref 1 00000100:00100000:3.0:1789762886.472256:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291040557192 time 290940557192 state 0x1 ref 1 00000100:00100000:3.0:1789762886.567458:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291040557192 time 291040607629 state 0x0 ref 1 00000100:00100000:3.0:1789762886.567481:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140778496:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762886.567517:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c57040b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.567531:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762886.567534:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762886.567539:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c57040b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.567552:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c57040b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.570035:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c57040b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.570053:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c57040b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.570061:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c57040b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.570066:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fec00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762886.570069:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c57040b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.570076:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c57040b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.570088:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c57040b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.570093:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9dc8bee/0xd08452c77c57040b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762886.570142:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140778496:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2668us (97987us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762886.570149:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 393 00000100:00100000:0.0:1789762886.570157:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291040557192 time 291040607629 state 0x2 ref 0 00000100:00100000:2.0:1789762886.571905:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762886.571952:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140778624 00000100:00100000:1.0:1789762886.571966:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140778624 00000100:00100000:1.0:1789762886.572003:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291040557192 time 291040607629 state 0x0 ref 1 00000100:00100000:1.0:1789762886.572013:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291140607629 time 291040607629 state 0x1 ref 1 00000100:00100000:0.0:1789762886.667585:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291140607629 time 291140734127 state 0x0 ref 1 00000100:00100000:0.0:1789762886.667622:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140778624:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762886.667660:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570412 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.667676:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762886.667681:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762886.667688:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570412 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.667705:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570412 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.670389:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570412 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.670401:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570412 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.670409:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570412 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.670414:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762886.670418:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570412 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.670424:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570412 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.670445:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570412 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.670451:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570412 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762886.670498:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140778624:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2882us (98592us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762886.670506:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 394 00000100:00100000:0.0:1789762886.670515:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291140607629 time 291140734127 state 0x2 ref 0 00000100:00100000:1.0:1789762886.672370:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762886.672414:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140778752 00000100:00100000:2.0:1789762886.672422:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140778752 00000100:00100000:2.0:1789762886.672458:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291140607629 time 291140734127 state 0x0 ref 1 00000100:00100000:2.0:1789762886.672468:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291240734127 time 291140734127 state 0x1 ref 1 00010000:00010000:3.0:1789762886.694960:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762886.767684:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291240734127 time 291240829022 state 0x0 ref 1 00000100:00100000:0.0:1789762886.767720:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140778752:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762886.767779:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570419 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.767798:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762886.767804:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762886.767811:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570419 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.767826:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570419 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.770658:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570419 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.770670:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570419 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.770677:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570419 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.770682:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762886.770685:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570419 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.770692:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570419 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.770706:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570419 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.770714:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570419 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762886.770788:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140778752:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3081us (98418us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762886.770796:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 395 00000100:00100000:0.0:1789762886.770811:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291240734127 time 291240829022 state 0x2 ref 0 00000100:00100000:3.0:1789762886.772686:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762886.772726:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140778880 00000100:00100000:1.0:1789762886.772734:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140778880 00000100:00100000:1.0:1789762886.772784:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291240734127 time 291240829022 state 0x0 ref 1 00000100:00100000:1.0:1789762886.772799:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291340829022 time 291240829022 state 0x1 ref 1 00000100:00100000:0.0:1789762886.867780:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291340829022 time 291340916974 state 0x0 ref 1 00000100:00100000:0.0:1789762886.867802:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04320f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140778880:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762886.867867:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570420 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.867881:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762886.867885:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762886.867889:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570420 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.867900:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570420 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762886.870504:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570420 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762886.870518:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570420 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762886.870529:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570420 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762886.870537:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762886.870543:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570420 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762886.870570:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570420 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762886.870585:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570420 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762886.870591:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570420 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762886.870638:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04320f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140778880:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2843us (97952us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762886.870645:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 396 00000100:00100000:2.0:1789762886.870654:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291340829022 time 291340916974 state 0x2 ref 0 00000100:00100000:3.0:1789762886.872337:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762886.872380:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140779008 00000100:00100000:2.0:1789762886.872388:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140779008 00000100:00100000:2.0:1789762886.872427:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291340829022 time 291340916974 state 0x0 ref 1 00000100:00100000:2.0:1789762886.872438:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291440916974 time 291340916974 state 0x1 ref 1 00000100:00100000:0.0:1789762886.967885:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291440916974 time 291441034951 state 0x0 ref 1 00000100:00100000:0.0:1789762886.967909:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140779008:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762886.967947:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570427 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.967960:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762886.967964:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762886.967969:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570427 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.967994:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570427 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.970798:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570427 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.970810:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570427 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.970816:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570427 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.970821:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762886.970825:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570427 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.970848:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570427 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.970862:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570427 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.970867:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570427 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762886.970927:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140779008:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3026us (98590us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762886.970934:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 397 00000100:00100000:0.0:1789762886.970942:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291440916974 time 291441034951 state 0x2 ref 0 00000100:00100000:1.0:1789762886.972807:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762886.972864:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140779136 00000100:00100000:2.0:1789762886.972872:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140779136 00000100:00100000:2.0:1789762886.972908:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291440916974 time 291441034951 state 0x0 ref 1 00000100:00100000:2.0:1789762886.972918:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291541034951 time 291441034951 state 0x1 ref 1 00000100:00100000:2.0:1789762887.067938:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291541034951 time 291541084879 state 0x0 ref 1 00000100:00100000:2.0:1789762887.067969:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140779136:12345-192.168.203.31@tcp:3:dd.0 00000100:00080000:1.0:1789762887.068004:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762887.068005:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57042e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762887.068020:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762887.068023:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762887.068028:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57042e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762887.068040:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57042e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.070906:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57042e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.070918:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57042e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.070926:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57042e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.070932:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cde00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762887.070936:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57042e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.070942:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57042e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.070957:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57042e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.070963:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c57042e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762887.071029:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140779136:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3075us (98222us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762887.071038:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 398 00000100:00100000:0.0:1789762887.071045:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291541034951 time 291541084879 state 0x2 ref 0 00000100:00100000:1.0:1789762887.072815:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762887.072892:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140779264 00000100:00100000:2.0:1789762887.072900:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140779264 00000100:00100000:2.0:1789762887.072936:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291541034951 time 291541084879 state 0x0 ref 1 00000100:00100000:2.0:1789762887.072946:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291641084879 time 291541084879 state 0x1 ref 1 00000100:00100000:0.0:1789762887.168018:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291641084879 time 291641167513 state 0x0 ref 1 00000100:00100000:0.0:1789762887.168038:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140779264:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762887.168081:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570435 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.168095:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.168099:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.168104:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570435 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.168115:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570435 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.170710:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570435 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.170725:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570435 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.170755:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570435 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.170776:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762887.170782:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570435 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.170791:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570435 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.170820:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570435 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.170827:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570435 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762887.170906:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140779264:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2872us (98090us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762887.170913:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 399 00000100:00100000:0.0:1789762887.170921:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291641084879 time 291641167513 state 0x2 ref 0 00000100:00100000:3.0:1789762887.172740:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762887.172799:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140779392 00000100:00100000:2.0:1789762887.172808:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140779392 00000100:00100000:2.0:1789762887.172881:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291641084879 time 291641167513 state 0x0 ref 1 00000100:00100000:2.0:1789762887.172896:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291741167513 time 291641167513 state 0x1 ref 1 00000100:00100000:0.0:1789762887.268099:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291741167513 time 291741247209 state 0x0 ref 1 00000100:00100000:0.0:1789762887.268122:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140779392:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762887.268178:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57043c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.268191:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.268194:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.268199:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57043c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.268211:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57043c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.271304:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57043c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.271316:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57043c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.271324:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57043c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.271330:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762887.271334:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57043c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.271340:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57043c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.271365:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57043c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.271371:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57043c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762887.271419:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140779392:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3302us (98680us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762887.271426:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 400 00000100:00100000:0.0:1789762887.271433:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291741167513 time 291741247209 state 0x2 ref 0 00000100:00100000:1.0:1789762887.273294:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762887.273352:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140779520 00000100:00100000:2.0:1789762887.273360:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140779520 00000100:00100000:2.0:1789762887.273401:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291741167513 time 291741247209 state 0x0 ref 1 00000100:00100000:2.0:1789762887.273416:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291841247209 time 291741247209 state 0x1 ref 1 00000001:00080000:1.0:1789762887.345281:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967380 is committed 00000100:00100000:0.0:1789762887.368194:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291841247209 time 291841343233 state 0x0 ref 1 00000100:00100000:0.0:1789762887.368220:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140779520:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762887.368259:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570443 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.368273:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.368276:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.368281:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570443 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.368293:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570443 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.371125:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570443 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.371138:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570443 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.371148:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570443 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.371156:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762887.371160:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570443 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.371167:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570443 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.371182:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570443 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.371190:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570443 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762887.371243:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140779520:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3031us (97948us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762887.371251:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 401 00000100:00100000:0.0:1789762887.371264:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291841247209 time 291841343233 state 0x2 ref 0 00000100:00100000:1.0:1789762887.373079:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762887.373135:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140779648 00000100:00100000:2.0:1789762887.373144:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140779648 00000100:00100000:2.0:1789762887.373185:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291841247209 time 291841343233 state 0x0 ref 1 00000100:00100000:2.0:1789762887.373201:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291941343233 time 291841343233 state 0x1 ref 1 00000100:00100000:0.0:1789762887.468311:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291941343233 time 291941443586 state 0x0 ref 1 00000100:00100000:0.0:1789762887.468339:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140779648:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762887.468375:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57044a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.468390:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.468393:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.468398:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57044a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.468409:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57044a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.471335:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57044a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.471345:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57044a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.471352:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57044a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.471358:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762887.471374:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57044a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.471382:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57044a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.471395:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57044a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.471401:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57044a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762887.471447:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140779648:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3118us (98368us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762887.471453:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 402 00000100:00100000:0.0:1789762887.471460:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291941343233 time 291941443586 state 0x2 ref 0 00000100:00100000:3.0:1789762887.473211:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762887.473267:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140779776 00000100:00100000:2.0:1789762887.473276:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140779776 00000100:00100000:2.0:1789762887.473318:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 291941343233 time 291941443586 state 0x0 ref 1 00000100:00100000:2.0:1789762887.473334:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292041443586 time 291941443586 state 0x1 ref 1 00000100:00100000:0.0:1789762887.568387:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292041443586 time 292041537009 state 0x0 ref 1 00000100:00100000:0.0:1789762887.568412:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140779776:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762887.568452:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570451 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.568476:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762887.568480:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.568484:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570451 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.568511:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570451 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.572000:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570451 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.572014:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570451 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.572024:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570451 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.572031:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762887.572035:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570451 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.572042:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570451 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.572055:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570451 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.572060:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570451 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762887.572119:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140779776:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3716us (98908us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762887.572126:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 403 00000100:00100000:0.0:1789762887.572133:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292041443586 time 292041537009 state 0x2 ref 0 00000100:00100000:2.0:1789762887.574122:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762887.574170:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140779904 00000100:00100000:1.0:1789762887.574178:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140779904 00000100:00100000:1.0:1789762887.574216:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292041443586 time 292041537009 state 0x0 ref 1 00000100:00100000:1.0:1789762887.574235:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292141537009 time 292041537009 state 0x1 ref 1 00000100:00100000:0.0:1789762887.668477:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292141537009 time 292141626869 state 0x0 ref 1 00000100:00100000:0.0:1789762887.668502:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140779904:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762887.668540:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570458 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.668554:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.668557:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.668562:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570458 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.668573:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570458 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.671405:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570458 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.671422:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570458 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.671447:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570458 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.671453:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762887.671456:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570458 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.671462:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570458 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.671475:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570458 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.671480:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570458 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762887.671525:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140779904:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3032us (97405us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762887.671534:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 404 00000100:00100000:0.0:1789762887.671542:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292141537009 time 292141626869 state 0x2 ref 0 00000100:00100000:2.0:1789762887.673262:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762887.673307:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140780032 00000100:00100000:1.0:1789762887.673316:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140780032 00000100:00100000:1.0:1789762887.673351:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292141537009 time 292141626869 state 0x0 ref 1 00000100:00100000:1.0:1789762887.673382:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292241626869 time 292141626869 state 0x1 ref 1 00010000:00010000:0.0:1789762887.718963:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762887.768871:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292241626869 time 292242020488 state 0x0 ref 1 00000100:00100000:0.0:1789762887.768896:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140780032:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762887.768944:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57045f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.768958:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.768961:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.768966:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57045f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.768976:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57045f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.771505:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57045f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.771516:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57045f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.771523:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57045f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.771528:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762887.771532:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57045f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.771538:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57045f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.771561:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57045f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.771567:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c57045f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762887.771612:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140780032:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2726us (98352us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762887.771618:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 405 00000100:00100000:0.0:1789762887.771626:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292241626869 time 292242020488 state 0x2 ref 0 00000100:00100000:0.0:1789762887.773540:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762887.773586:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140780160 00000100:00100000:1.0:1789762887.773595:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140780160 00000100:00100000:1.0:1789762887.773631:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292241626869 time 292242020488 state 0x0 ref 1 00000100:00100000:1.0:1789762887.773642:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292342020488 time 292242020488 state 0x1 ref 1 00000100:00100000:0.0:1789762887.868980:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292342020488 time 292342129778 state 0x0 ref 1 00000100:00100000:0.0:1789762887.869007:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140780160:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762887.869057:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570466 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.869074:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.869079:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.869085:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570466 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.869113:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570466 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762887.871644:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570466 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762887.871655:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570466 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762887.871673:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570466 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762887.871679:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762887.871683:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570466 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762887.871693:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570466 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762887.871707:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570466 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762887.871712:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570466 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762887.871768:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140780160:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2772us (98228us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762887.871775:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 406 00000100:00100000:2.0:1789762887.871783:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292342020488 time 292342129778 state 0x2 ref 0 00000100:00100000:0.0:1789762887.873693:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762887.873735:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140780288 00000100:00100000:1.0:1789762887.873743:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140780288 00000100:00100000:1.0:1789762887.873797:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292342020488 time 292342129778 state 0x0 ref 1 00000100:00100000:1.0:1789762887.873808:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292442129778 time 292342129778 state 0x1 ref 1 00000100:00100000:0.0:1789762887.969092:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292442129778 time 292442235879 state 0x0 ref 1 00000100:00100000:0.0:1789762887.969122:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140780288:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762887.969160:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c57046d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.969175:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.969178:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762887.969182:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c57046d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762887.969193:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c57046d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.973086:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c57046d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.973108:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c57046d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.973120:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c57046d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.973129:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fe00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762887.973135:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c57046d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.973145:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c57046d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.973166:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c57046d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.973175:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c57046d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762887.973280:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140780288:12345-192.168.203.31@tcp:3:dd.0 Request processed in 4165us (99583us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762887.973291:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 407 00000100:00100000:3.0:1789762887.973303:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292442129778 time 292442235879 state 0x2 ref 0 00000100:00100000:3.0:1789762887.975774:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762887.975820:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140780416 00000100:00100000:1.0:1789762887.975830:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140780416 00000100:00100000:1.0:1789762887.975905:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292442129778 time 292442235879 state 0x0 ref 1 00000100:00100000:1.0:1789762887.975920:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292542235879 time 292442235879 state 0x1 ref 1 00000100:00100000:2.0:1789762888.069167:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292542235879 time 292542317541 state 0x0 ref 1 00000100:00100000:2.0:1789762888.069189:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140780416:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:2.0:1789762888.069239:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570474 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.069253:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762888.069257:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762888.069261:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570474 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.069272:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570474 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.071980:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570474 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.071989:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570474 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.071996:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570474 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.072002:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762888.072006:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570474 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.072013:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570474 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.072036:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570474 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.072042:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570474 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762888.072117:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140780416:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2933us (96364us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762888.072127:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 408 00000100:00100000:2.0:1789762888.072136:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292542235879 time 292542317541 state 0x2 ref 0 00000100:00100000:3.0:1789762888.074288:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762888.074329:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140780544 00000100:00100000:1.0:1789762888.074338:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140780544 00000100:00100000:1.0:1789762888.074377:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292542235879 time 292542317541 state 0x0 ref 1 00000100:00100000:1.0:1789762888.074387:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292642317541 time 292542317541 state 0x1 ref 1 00000100:00100000:3.0:1789762888.169250:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292642317541 time 292642395603 state 0x0 ref 1 00000100:00100000:3.0:1789762888.169282:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140780544:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762888.169324:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc0aa8fd/0xd08452c77c57047b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.169343:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762888.169348:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762888.169367:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc0aa8fd/0xd08452c77c57047b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.169379:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc0aa8fd/0xd08452c77c57047b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.172199:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc0aa8fd/0xd08452c77c57047b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.172210:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc0aa8fd/0xd08452c77c57047b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.172218:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc0aa8fd/0xd08452c77c57047b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.172224:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16018a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762888.172228:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc0aa8fd/0xd08452c77c57047b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.172238:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc0aa8fd/0xd08452c77c57047b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.172257:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc0aa8fd/0xd08452c77c57047b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.172267:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc0aa8fd/0xd08452c77c57047b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762888.172327:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140780544:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3058us (98038us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762888.172334:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 409 00000100:00100000:1.0:1789762888.172342:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292642317541 time 292642395603 state 0x2 ref 0 00000100:00100000:3.0:1789762888.174155:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762888.174189:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140780672 00000100:00100000:1.0:1789762888.174198:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140780672 00000100:00100000:1.0:1789762888.174235:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292642317541 time 292642395603 state 0x0 ref 1 00000100:00100000:1.0:1789762888.174250:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292742395603 time 292642395603 state 0x1 ref 1 00000100:00100000:2.0:1789762888.269321:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292742395603 time 292742470788 state 0x0 ref 1 00000100:00100000:2.0:1789762888.269342:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140780672:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:2.0:1789762888.269386:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570482 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.269400:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762888.269403:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762888.269408:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570482 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.269420:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570482 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.272533:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570482 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.272544:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570482 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.272552:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570482 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.272558:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762888.272567:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570482 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.272575:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570482 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.272589:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570482 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.272602:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570482 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762888.272654:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140780672:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3318us (98499us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762888.272674:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 410 00000100:00100000:0.0:1789762888.272682:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292742395603 time 292742470788 state 0x2 ref 0 00000100:00100000:2.0:1789762888.274538:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762888.274577:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140780800 00000100:00100000:1.0:1789762888.274585:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140780800 00000100:00100000:1.0:1789762888.274632:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292742395603 time 292742470788 state 0x0 ref 1 00000100:00100000:1.0:1789762888.274642:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292842470788 time 292742470788 state 0x1 ref 1 00000100:00100000:1.0:1789762888.369405:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292842470788 time 292842549281 state 0x0 ref 1 00000100:00100000:1.0:1789762888.369438:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140780800:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762888.369484:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570489 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.369505:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762888.369520:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762888.369527:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570489 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.369543:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570489 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.372367:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570489 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.372390:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570489 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.372397:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570489 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.372402:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762888.372405:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570489 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.372412:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570489 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.372425:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570489 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.372430:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570489 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762888.372480:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140780800:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3056us (97942us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762888.372488:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 411 00000100:00100000:3.0:1789762888.372497:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292842470788 time 292842549281 state 0x2 ref 0 00000100:00100000:2.0:1789762888.374664:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762888.374715:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140780928 00000100:00100000:1.0:1789762888.374724:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140780928 00000100:00100000:1.0:1789762888.374781:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292842470788 time 292842549281 state 0x0 ref 1 00000100:00100000:1.0:1789762888.374796:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292942549281 time 292842549281 state 0x1 ref 1 00000100:00100000:0.0:1789762888.469487:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292942549281 time 292942636855 state 0x0 ref 1 00000100:00100000:0.0:1789762888.469511:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140780928:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762888.469553:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570490 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.469570:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762888.469575:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762888.469583:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570490 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.469608:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570490 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.472351:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570490 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.472363:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570490 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.472370:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.472376:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762888.472380:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.472386:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570490 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.472400:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570490 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.472406:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570490 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762888.472458:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140780928:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2954us (97793us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762888.472478:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 412 00000100:00100000:2.0:1789762888.472488:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292942549281 time 292942636855 state 0x2 ref 0 00000100:00100000:2.0:1789762888.474253:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762888.474304:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140781056 00000100:00100000:1.0:1789762888.474315:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140781056 00000100:00100000:1.0:1789762888.474349:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 292942549281 time 292942636855 state 0x0 ref 1 00000100:00100000:1.0:1789762888.474359:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293042636855 time 292942636855 state 0x1 ref 1 00000100:00100000:3.0:1789762888.569592:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293042636855 time 293042741548 state 0x0 ref 1 00000100:00100000:3.0:1789762888.569632:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140781056:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762888.569670:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570497 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.569684:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762888.569688:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762888.569693:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570497 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.569706:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570497 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.572662:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570497 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.572671:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570497 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.572678:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.572682:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16018b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762888.572686:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.572692:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570497 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.572713:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570497 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.572719:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570497 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762888.572785:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140781056:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3160us (98532us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762888.572792:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 413 00000100:00100000:3.0:1789762888.572800:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293042636855 time 293042741548 state 0x2 ref 0 00000100:00100000:1.0:1789762888.574543:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762888.574633:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140781184 00000100:00100000:2.0:1789762888.574642:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140781184 00000100:00100000:2.0:1789762888.574681:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293042636855 time 293042741548 state 0x0 ref 1 00000100:00100000:2.0:1789762888.574691:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293142741548 time 293042741548 state 0x1 ref 1 00000100:00100000:0.0:1789762888.669892:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293142741548 time 293143036321 state 0x0 ref 1 00000100:00100000:0.0:1789762888.669922:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140781184:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762888.669977:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fd58930/0xd08452c77c57049e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.669995:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762888.670000:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762888.670006:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fd58930/0xd08452c77c57049e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.670020:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fd58930/0xd08452c77c57049e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.673415:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fd58930/0xd08452c77c57049e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.673431:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fd58930/0xd08452c77c57049e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.673439:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fd58930/0xd08452c77c57049e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.673445:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fe600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762888.673449:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fd58930/0xd08452c77c57049e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.673455:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fd58930/0xd08452c77c57049e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.673480:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fd58930/0xd08452c77c57049e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.673486:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fd58930/0xd08452c77c57049e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762888.673542:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140781184:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3627us (98997us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762888.673553:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 414 00000100:00100000:2.0:1789762888.673564:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293142741548 time 293143036321 state 0x2 ref 0 00000100:00100000:1.0:1789762888.675546:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762888.675582:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140781312 00000100:00100000:2.0:1789762888.675590:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140781312 00000100:00100000:2.0:1789762888.675628:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293142741548 time 293143036321 state 0x0 ref 1 00000100:00100000:2.0:1789762888.675639:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293243036321 time 293143036321 state 0x1 ref 1 00010000:00010000:2.0:1789762888.742966:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762888.769973:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293243036321 time 293243120688 state 0x0 ref 1 00000100:00100000:3.0:1789762888.770004:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140781312:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762888.770046:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704a5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.770059:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762888.770064:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762888.770070:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.770084:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.772884:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.772894:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.772900:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.772906:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16018b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762888.772909:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.772915:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.772927:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.772932:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762888.772986:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140781312:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2994us (97440us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762888.772997:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 415 00000100:00100000:3.0:1789762888.773015:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293243036321 time 293243120688 state 0x2 ref 0 00000100:00100000:0.0:1789762888.774856:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762888.774905:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140781440 00000100:00100000:2.0:1789762888.774912:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140781440 00000100:00100000:2.0:1789762888.774947:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293243036321 time 293243120688 state 0x0 ref 1 00000100:00100000:2.0:1789762888.774958:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293343120688 time 293243120688 state 0x1 ref 1 00000100:00100000:2.0:1789762888.870017:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293343120688 time 293343166118 state 0x0 ref 1 00000100:00100000:2.0:1789762888.870060:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140781440:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:2.0:1789762888.870097:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5704ac lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.870111:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762888.870115:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762888.870120:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5704ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.870130:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5704ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.873123:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5704ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.873137:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5704ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.873145:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5704ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.873151:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148cc4e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762888.873155:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5704ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.873162:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5704ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.873178:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5704ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.873184:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d3ffce/0xd08452c77c5704ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762888.873244:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140781440:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3193us (98405us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762888.873256:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 416 00000100:00100000:3.0:1789762888.873275:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293343120688 time 293343166118 state 0x2 ref 0 00000100:00100000:0.0:1789762888.875266:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762888.875305:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140781568 00000100:00100000:2.0:1789762888.875314:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140781568 00000100:00100000:2.0:1789762888.875361:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293343120688 time 293343166118 state 0x0 ref 1 00000100:00100000:2.0:1789762888.875375:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293443166118 time 293343166118 state 0x1 ref 1 00000001:00080000:1.0:1789762888.880088:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967791 is committed 00000100:00100000:1.0:1789762888.970062:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293443166118 time 293443214326 state 0x0 ref 1 00000100:00100000:1.0:1789762888.970086:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140781568:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762888.970135:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c5704b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.970149:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762888.970154:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762888.970159:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c5704b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.970190:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c5704b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.973151:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c5704b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.973166:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c5704b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.973189:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c5704b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.973198:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882f000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762888.973203:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c5704b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.973213:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c5704b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.973232:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c5704b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.973241:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c5704b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762888.973300:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140781568:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3221us (98031us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762888.973310:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 417 00000100:00100000:0.0:1789762888.973320:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293443166118 time 293443214326 state 0x2 ref 0 00000100:00100000:0.0:1789762888.975102:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762888.975135:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140781696 00000100:00100000:0.0:1789762888.975143:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140781696 00000100:00100000:0.0:1789762888.975186:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293443166118 time 293443214326 state 0x0 ref 1 00000100:00100000:0.0:1789762888.975208:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293543214326 time 293443214326 state 0x1 ref 1 00000100:00100000:3.0:1789762889.070153:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293543214326 time 293543302801 state 0x0 ref 1 00000100:00100000:3.0:1789762889.070194:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140781696:12345-192.168.203.31@tcp:3:dd.0 00000100:00080000:1.0:1789762889.070233:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762889.070247:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704ba lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.070266:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762889.070271:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762889.070279:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.070295:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.073019:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.073029:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.073036:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.073042:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16018b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762889.073053:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.073060:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.073079:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.073088:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762889.073153:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140781696:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2984us (98055us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762889.073162:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 418 00000100:00100000:3.0:1789762889.073170:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293543214326 time 293543302801 state 0x2 ref 0 00000100:00100000:0.0:1789762889.074919:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762889.074952:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140781824 00000100:00100000:3.0:1789762889.074959:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140781824 00000100:00100000:3.0:1789762889.074994:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293543214326 time 293543302801 state 0x0 ref 1 00000100:00100000:3.0:1789762889.075004:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293643302801 time 293543302801 state 0x1 ref 1 00000100:00100000:0.0:1789762889.170269:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293643302801 time 293643418373 state 0x0 ref 1 00000100:00100000:0.0:1789762889.170293:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140781824:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762889.170332:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704c1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.170346:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762889.170349:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762889.170354:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.170366:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.173940:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.173954:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.173965:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.173990:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762889.173995:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.174006:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.174024:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.174033:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762889.174088:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140781824:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3804us (99169us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762889.174096:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 419 00000100:00100000:0.0:1789762889.174104:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293643302801 time 293643418373 state 0x2 ref 0 00000100:00100000:0.0:1789762889.175990:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762889.176066:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140781952 00000100:00100000:2.0:1789762889.176074:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140781952 00000100:00100000:2.0:1789762889.176111:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293643302801 time 293643418373 state 0x0 ref 1 00000100:00100000:2.0:1789762889.176121:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293743418373 time 293643418373 state 0x1 ref 1 00000100:00100000:3.0:1789762889.270363:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293743418373 time 293743508531 state 0x0 ref 1 00000100:00100000:3.0:1789762889.270391:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140781952:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762889.270439:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704c8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.270453:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762889.270457:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762889.270461:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.270472:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.274102:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.274118:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.274129:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.274136:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16018b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762889.274140:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.274147:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.274171:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.274180:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762889.274242:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140781952:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3860us (98250us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762889.274250:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 420 00000100:00100000:3.0:1789762889.274258:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293743418373 time 293743508531 state 0x2 ref 0 00000100:00100000:2.0:1789762889.276117:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762889.276158:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140782080 00000100:00100000:3.0:1789762889.276167:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140782080 00000100:00100000:3.0:1789762889.276209:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293743418373 time 293743508531 state 0x0 ref 1 00000100:00100000:3.0:1789762889.276225:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293843508531 time 293743508531 state 0x1 ref 1 00000100:00100000:0.0:1789762889.370465:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293843508531 time 293843614650 state 0x0 ref 1 00000100:00100000:0.0:1789762889.370489:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140782080:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762889.370526:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704cf lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.370556:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762889.370560:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762889.370565:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.370577:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.374704:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.374715:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.374722:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.374727:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762889.374731:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.374737:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.374767:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.374773:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c5704cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762889.374896:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140782080:12345-192.168.203.31@tcp:3:dd.0 Request processed in 4414us (98778us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762889.374905:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 421 00000100:00100000:1.0:1789762889.374914:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293843508531 time 293843614650 state 0x2 ref 0 00000100:00100000:2.0:1789762889.377586:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762889.377630:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140782208 00000100:00100000:0.0:1789762889.377638:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140782208 00000100:00100000:0.0:1789762889.377671:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293843508531 time 293843614650 state 0x0 ref 1 00000100:00100000:0.0:1789762889.377682:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293943614650 time 293843614650 state 0x1 ref 1 00000100:00100000:3.0:1789762889.470571:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293943614650 time 293943722140 state 0x0 ref 1 00000100:00100000:3.0:1789762889.470595:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140782208:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762889.470634:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704d6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.470647:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762889.470662:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762889.470667:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.470678:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.474733:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.474756:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.474764:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.474769:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16018b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762889.474772:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.474778:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.474791:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.474798:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762889.474891:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140782208:12345-192.168.203.31@tcp:3:dd.0 Request processed in 4303us (97304us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762889.474900:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 422 00000100:00100000:3.0:1789762889.474908:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293943614650 time 293943722140 state 0x2 ref 0 00000100:00100000:2.0:1789762889.477089:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762889.477121:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140782336 00000100:00100000:3.0:1789762889.477128:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140782336 00000100:00100000:3.0:1789762889.477162:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 293943614650 time 293943722140 state 0x0 ref 1 00000100:00100000:3.0:1789762889.477171:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294043722140 time 293943722140 state 0x1 ref 1 00000100:00100000:1.0:1789762889.570699:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294043722140 time 294043852375 state 0x0 ref 1 00000100:00100000:1.0:1789762889.570720:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140782336:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762889.570773:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704dd lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.570787:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762889.570790:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762889.570795:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.570806:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.573875:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.573886:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.573908:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.573914:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762889.573918:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.573924:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.573937:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.573943:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762889.573989:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140782336:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3275us (96902us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762889.573996:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 423 00000100:00100000:1.0:1789762889.574004:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294043722140 time 294043852375 state 0x2 ref 0 00000100:00100000:0.0:1789762889.576936:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762889.576979:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140782464 00000100:00100000:2.0:1789762889.576987:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140782464 00000100:00100000:2.0:1789762889.577024:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294043722140 time 294043852375 state 0x0 ref 1 00000100:00100000:2.0:1789762889.577035:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294143852375 time 294043852375 state 0x1 ref 1 00000100:00100000:3.0:1789762889.670799:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294143852375 time 294143948413 state 0x0 ref 1 00000100:00100000:3.0:1789762889.670824:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140782464:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762889.670887:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.670901:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762889.670905:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762889.670909:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.670921:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.674115:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.674125:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.674134:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.674140:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16018b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762889.674144:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.674150:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.674164:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.674170:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762889.674215:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140782464:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3401us (97279us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762889.674222:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 424 00000100:00100000:3.0:1789762889.674236:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294143852375 time 294143948413 state 0x2 ref 0 00000100:00100000:2.0:1789762889.677287:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762889.677321:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140782592 00000100:00100000:3.0:1789762889.677329:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140782592 00000100:00100000:3.0:1789762889.677363:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294143852375 time 294143948413 state 0x0 ref 1 00000100:00100000:3.0:1789762889.677374:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294243948413 time 294143948413 state 0x1 ref 1 00010000:00010000:2.0:1789762889.767017:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762889.770884:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294243948413 time 294244036708 state 0x0 ref 1 00000100:00100000:1.0:1789762889.770909:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140782592:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762889.770957:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704eb lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.770971:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762889.770974:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762889.770978:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.770988:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.774671:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.774686:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.774697:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.774705:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762889.774710:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.774718:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.774754:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.774761:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762889.774807:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140782592:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3908us (97520us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762889.774814:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 425 00000100:00100000:1.0:1789762889.774822:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294243948413 time 294244036708 state 0x2 ref 0 00000100:00100000:2.0:1789762889.777895:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762889.777948:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140782720 00000100:00100000:0.0:1789762889.777957:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140782720 00000100:00100000:0.0:1789762889.777993:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294243948413 time 294244036708 state 0x0 ref 1 00000100:00100000:0.0:1789762889.778004:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294344036708 time 294244036708 state 0x1 ref 1 00000100:00100000:3.0:1789762889.871023:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294344036708 time 294344173465 state 0x0 ref 1 00000100:00100000:3.0:1789762889.871048:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140782720:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762889.871086:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.871099:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762889.871103:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762889.871107:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.871118:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.874154:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.874165:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.874182:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.874189:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16018b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762889.874193:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.874200:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.874214:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.874219:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c5704f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762889.874277:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140782720:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3239us (96382us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762889.874283:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 426 00000100:00100000:3.0:1789762889.874291:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294344036708 time 294344173465 state 0x2 ref 0 00000100:00100000:2.0:1789762889.876177:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762889.876209:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140782848 00000100:00100000:3.0:1789762889.876217:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140782848 00000100:00100000:3.0:1789762889.876251:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294344036708 time 294344173465 state 0x0 ref 1 00000100:00100000:3.0:1789762889.876271:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294444173465 time 294344173465 state 0x1 ref 1 00000100:00100000:1.0:1789762889.971127:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294444173465 time 294444275888 state 0x0 ref 1 00000100:00100000:1.0:1789762889.971163:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140782848:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762889.971207:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.971226:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762889.971231:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762889.971236:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.971248:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.973976:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.973986:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.973992:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.973998:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762889.974001:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.974008:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.974023:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.974028:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5704f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762889.974075:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140782848:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2934us (97899us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762889.974082:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 427 00000100:00100000:1.0:1789762889.974095:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294444173465 time 294444275888 state 0x2 ref 0 00000100:00100000:2.0:1789762889.975875:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762889.975921:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140782976 00000100:00100000:0.0:1789762889.975929:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140782976 00000100:00100000:0.0:1789762889.975965:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294444173465 time 294444275888 state 0x0 ref 1 00000100:00100000:0.0:1789762889.975975:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294544275888 time 294444275888 state 0x1 ref 1 00000100:00100000:3.0:1789762890.071216:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294544275888 time 294544361155 state 0x0 ref 1 00000100:00100000:3.0:1789762890.071243:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140782976:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762890.071284:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570500 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.071302:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762890.071307:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762890.071314:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570500 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.071328:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570500 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.074246:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570500 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.074258:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570500 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.074268:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570500 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.074288:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16018b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762890.074293:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570500 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.074302:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570500 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.074320:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570500 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.074328:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c570500 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762890.074385:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140782976:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3150us (98510us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762890.074396:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 428 00000100:00100000:3.0:1789762890.074407:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294544275888 time 294544361155 state 0x2 ref 0 00000100:00100000:0.0:1789762890.076260:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762890.076298:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140783104 00000100:00100000:3.0:1789762890.076307:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140783104 00000100:00100000:3.0:1789762890.076349:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294544275888 time 294544361155 state 0x0 ref 1 00000100:00100000:3.0:1789762890.076364:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294644361155 time 294544361155 state 0x1 ref 1 00000100:00100000:1.0:1789762890.171306:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294644361155 time 294644455027 state 0x0 ref 1 00000100:00100000:1.0:1789762890.171335:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140783104:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762890.171373:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570507 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.171386:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762890.171390:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762890.171395:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570507 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.171405:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570507 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.174249:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570507 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.174260:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570507 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.174266:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.174271:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762890.174281:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.174288:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570507 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.174301:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570507 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.174307:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570507 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762890.174361:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140783104:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3037us (98100us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762890.174370:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 429 00000100:00100000:1.0:1789762890.174378:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294644361155 time 294644455027 state 0x2 ref 0 00000100:00100000:0.0:1789762890.176214:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762890.176257:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140783232 00000100:00100000:2.0:1789762890.176265:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140783232 00000100:00100000:2.0:1789762890.176306:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294644361155 time 294644455027 state 0x0 ref 1 00000100:00100000:2.0:1789762890.176321:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294744455027 time 294644455027 state 0x1 ref 1 00000100:00100000:3.0:1789762890.271444:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294744455027 time 294744587977 state 0x0 ref 1 00000100:00100000:3.0:1789762890.271484:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140783232:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762890.271529:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57050e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.271547:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762890.271551:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762890.271558:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57050e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.271573:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57050e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.274541:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57050e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.274554:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57050e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.274563:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57050e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.274571:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16018b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762890.274576:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57050e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.274585:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57050e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.274611:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57050e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.274619:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57050e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762890.274677:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140783232:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3200us (98463us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762890.274688:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 430 00000100:00100000:3.0:1789762890.274698:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294744455027 time 294744587977 state 0x2 ref 0 00000100:00100000:2.0:1789762890.276621:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762890.276661:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140783360 00000100:00100000:3.0:1789762890.276669:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140783360 00000100:00100000:3.0:1789762890.276704:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294744455027 time 294744587977 state 0x0 ref 1 00000100:00100000:3.0:1789762890.276714:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294844587977 time 294744587977 state 0x1 ref 1 00000100:00100000:1.0:1789762890.371520:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294844587977 time 294844671610 state 0x0 ref 1 00000100:00100000:1.0:1789762890.371544:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140783360:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762890.371579:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570515 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.371593:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762890.371597:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762890.371602:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570515 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.371626:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570515 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.374446:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570515 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.374463:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570515 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.374474:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.374481:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762890.374485:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.374492:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.374507:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570515 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.374513:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570515 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762890.374571:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140783360:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3036us (97950us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762890.374579:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 431 00000100:00100000:1.0:1789762890.374587:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294844587977 time 294844671610 state 0x2 ref 0 00000100:00100000:0.0:1789762890.376412:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762890.376457:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140783488 00000100:00100000:2.0:1789762890.376465:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140783488 00000100:00100000:2.0:1789762890.376499:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294844587977 time 294844671610 state 0x0 ref 1 00000100:00100000:2.0:1789762890.376508:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294944671610 time 294844671610 state 0x1 ref 1 00000100:00100000:3.0:1789762890.406981:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789762890.406992:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1461e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149033600:0@lo:400:kworker.0 00000100:00100000:3.0:1789762890.407001:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149033984:0@lo:400:kworker.0 00000100:00100000:1.0:1789762890.407010:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149034112:0@lo:400:kworker.0 00000100:00100000:2.0:1789762890.407032:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149033856:0@lo:400:kworker.0 00000100:00100000:0.0:1789762890.407076:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762890.407078:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762890.407083:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762890.407123:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149034112 00000100:00100000:2.0:1789762890.407132:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149034112 00000100:00100000:0.0:1789762890.407136:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149034240:0@lo:400:kworker.0 00000100:00100000:3.0:1789762890.407137:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d152258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149033728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762890.407158:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149033600 00000100:00100000:1.0:1789762890.407163:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149033600 00000100:00100000:3.0:1789762890.407183:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762890.407192:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762890.407205:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789762890.407210:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789762890.407220:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149034112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762890.407222:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149033600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762890.407231:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149033984 00000100:00100000:3.0:1789762890.407236:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149033984 00000100:00100000:0.0:1789762890.407255:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149034240 00000100:00100000:0.0:1789762890.407260:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149034240 00000100:00100000:3.0:1789762890.407288:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789762890.407293:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149034112:12345-0@lo:400:kworker.0 Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762890.407298:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149033600:12345-0@lo:400:kworker.0 Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762890.407311:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789762890.407317:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789762890.407318:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789762890.407318:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149033984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762890.407329:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149034240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762890.407363:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967791 gen 2 00000004:00080000:2.0:1789762890.407369:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d160034000, transno 4294967791 00000100:00100000:1.0:1789762890.407374:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1461e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149033600:0@lo:400:kworker.0 00000100:00100000:3.0:1789762890.407383:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149033984:12345-0@lo:400:kworker.0 Request processed in 74us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762890.407386:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149034112:0@lo:400:kworker.0 00000100:00100000:0.0:1789762890.407392:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149034240:12345-0@lo:400:kworker.0 Request processed in 66us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762890.407401:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149034240:0@lo:400:kworker.0 00000100:00100000:3.0:1789762890.407406:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789762890.407414:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:0.0:1789762890.407440:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762890.407442:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149033728 00000100:00080000:0.0:1789762890.407445:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762890.407447:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149033728 00000100:00100000:1.0:1789762890.407469:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789762890.407475:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762890.407494:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789762890.407498:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149033856 00000100:00100000:1.0:1789762890.407498:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149034368:0@lo:400:kworker.0 00000100:00100000:0.0:1789762890.407505:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149033856 00000100:00100000:3.0:1789762890.407506:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149033728:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762890.407532:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789762890.407532:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 13631488 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762890.407538:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789762890.407548:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149033856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762890.407576:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149033728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762890.407577:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149034368 00000100:00100000:1.0:1789762890.407583:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149034368 00000100:00100000:3.0:1789762890.407584:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789762890.407599:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149033856:12345-0@lo:400:kworker.0 Request processed in 53us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762890.407606:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789762890.407624:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789762890.407635:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149034368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762890.407650:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149033984:0@lo:400:kworker.0 00000100:00100000:0.0:1789762890.407655:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149033856:0@lo:400:kworker.0 00000100:00100000:3.0:1789762890.407667:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967380 gen 2 00000004:00080000:3.0:1789762890.407673:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d173d24000, transno 4294967380 00000100:00100000:3.0:1789762890.407692:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d152258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149033728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762890.407698:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149034368:12345-0@lo:400:kworker.0 Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762890.407708:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149034368:0@lo:400:kworker.0 00000100:00100000:1.0:1789762890.407711:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789762890.471592:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294944671610 time 294944740845 state 0x0 ref 1 00000100:00100000:3.0:1789762890.471618:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140783488:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762890.471662:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57051c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.471677:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762890.471680:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762890.471684:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57051c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.471710:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57051c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.474658:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57051c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.474669:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57051c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.474676:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57051c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.474681:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16018b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762890.474684:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57051c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.474691:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57051c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.474702:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57051c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.474707:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57051c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762890.474788:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140783488:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3179us (98376us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762890.474799:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 432 00000100:00100000:3.0:1789762890.474809:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294944671610 time 294944740845 state 0x2 ref 0 00000100:00100000:0.0:1789762890.476710:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762890.476753:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140783616 00000100:00100000:3.0:1789762890.476761:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140783616 00000100:00100000:3.0:1789762890.476795:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 294944671610 time 294944740845 state 0x0 ref 1 00000100:00100000:3.0:1789762890.476806:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295044740845 time 294944740845 state 0x1 ref 1 00000100:00100000:1.0:1789762890.571668:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295044740845 time 295044817428 state 0x0 ref 1 00000100:00100000:1.0:1789762890.571694:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140783616:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762890.571729:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570523 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.571757:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762890.571760:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762890.571766:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570523 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.571779:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570523 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.574666:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570523 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.574676:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570523 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.574682:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570523 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.574701:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762890.574705:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570523 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.574712:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570523 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.574726:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570523 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.574732:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570523 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762890.574801:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140783616:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3119us (98091us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762890.574808:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 433 00000100:00100000:1.0:1789762890.574815:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295044740845 time 295044817428 state 0x2 ref 0 00000100:00100000:2.0:1789762890.577256:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762890.577301:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140783744 00000100:00100000:0.0:1789762890.577309:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140783744 00000100:00100000:0.0:1789762890.577346:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295044740845 time 295044817428 state 0x0 ref 1 00000100:00100000:0.0:1789762890.577357:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295144817428 time 295044817428 state 0x1 ref 1 00000100:00100000:0.0:1789762890.612390:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762890.612422:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762890.612437:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140783872 00000100:00100000:0.0:1789762890.612443:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762890.612448:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140783872 00000100:00100000:0.0:1789762890.612479:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762890.612491:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140784000 00000100:00100000:2.0:1789762890.612499:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140784000 00000100:00100000:3.0:1789762890.612511:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 287 00000100:00100000:0.0:1789762890.612523:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140784256 00000100:00100000:3.0:1789762890.612529:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140783872:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762890.612530:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140784256 00000100:00080000:1.0:1789762890.612541:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762890.612565:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:0.0:1789762890.612574:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:2.0:1789762890.612580:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140784000:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762890.612588:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140784256:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762890.612602:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140783872:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762890.612622:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 287 00000100:00100000:1.0:1789762890.612623:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140784128 00000100:00100000:1.0:1789762890.612630:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140784128 00000100:00100000:2.0:1789762890.612646:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140784000:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 69us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762890.612651:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140784256:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 66us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762890.612660:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:0.0:1789762890.612674:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:1.0:1789762890.612683:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:1.0:1789762890.612693:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16fbfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140784128:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:0.0:1789762890.612710:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762890.612727:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16fbfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140784128:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 37us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762890.612778:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:3.0:1789762890.671812:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295144817428 time 295144957928 state 0x0 ref 1 00000100:00100000:3.0:1789762890.671865:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140783744:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762890.671901:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57052a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.671930:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762890.671933:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762890.671938:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57052a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.671949:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57052a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.674684:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57052a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.674698:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57052a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.674708:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57052a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.674730:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16018b800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762890.674746:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57052a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.674758:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57052a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.674784:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57052a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.674799:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e6c056/0xd08452c77c57052a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762890.674881:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140783744:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3048us (97624us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762890.674891:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 434 00000100:00100000:2.0:1789762890.674902:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295144817428 time 295144957928 state 0x2 ref 0 00000100:00100000:3.0:1789762890.677007:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762890.677048:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140784384 00000100:00100000:0.0:1789762890.677056:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140784384 00000100:00100000:0.0:1789762890.677093:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295144817428 time 295144957928 state 0x0 ref 1 00000100:00100000:0.0:1789762890.677104:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295244957928 time 295144957928 state 0x1 ref 1 00000100:00100000:1.0:1789762890.771896:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295244957928 time 295245045965 state 0x0 ref 1 00000100:00100000:1.0:1789762890.771925:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140784384:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762890.771963:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570531 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.771977:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762890.771980:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762890.771985:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570531 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.771996:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570531 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.774916:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570531 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.774932:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570531 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.774940:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570531 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.774945:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762890.774958:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570531 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.774976:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570531 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.774995:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570531 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.775004:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570531 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762890.775055:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140784384:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3142us (98047us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762890.775062:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 435 00000100:00100000:1.0:1789762890.775070:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295244957928 time 295245045965 state 0x2 ref 0 00000100:00100000:3.0:1789762890.777171:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762890.777226:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140784512 00000100:00100000:0.0:1789762890.777235:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140784512 00000100:00100000:0.0:1789762890.777272:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295244957928 time 295245045965 state 0x0 ref 1 00000100:00100000:0.0:1789762890.777283:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295345045965 time 295245045965 state 0x1 ref 1 00010000:00010000:3.0:1789762890.790973:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762890.871987:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295345045965 time 295345137337 state 0x0 ref 1 00000100:00100000:2.0:1789762890.872011:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140784512:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:2.0:1789762890.872055:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570538 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.872085:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762890.872089:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762890.872094:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570538 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.872105:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570538 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.874873:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570538 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.874888:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570538 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.874899:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570538 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.874909:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762890.874914:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570538 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.874924:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570538 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.874941:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570538 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.874964:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570538 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762890.875021:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140784512:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3017us (97849us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762890.875032:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 436 00000100:00100000:2.0:1789762890.875043:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295345045965 time 295345137337 state 0x2 ref 0 00000100:00100000:0.0:1789762890.877250:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762890.877300:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140784640 00000100:00100000:3.0:1789762890.877308:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140784640 00000100:00100000:3.0:1789762890.877343:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295345045965 time 295345137337 state 0x0 ref 1 00000100:00100000:3.0:1789762890.877354:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295445137337 time 295345137337 state 0x1 ref 1 00000100:00100000:0.0:1789762890.918993:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d15225a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149034496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762890.919059:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762890.919098:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149034496 00000100:00100000:3.0:1789762890.919106:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149034496 00000100:00100000:3.0:1789762890.919148:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789762890.919156:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149034496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762890.919197:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526712832 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789762890.919249:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149034496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762890.919258:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789762890.919299:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d15225a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149034496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762890.972108:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295445137337 time 295445258359 state 0x0 ref 1 00000100:00100000:1.0:1789762890.972134:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140784640:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762890.972170:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57053f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.972184:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762890.972188:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762890.972192:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57053f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.972218:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57053f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.974995:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57053f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.975011:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57053f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.975021:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57053f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.975027:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762890.975031:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57053f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.975038:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57053f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.975053:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57053f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.975059:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57053f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762890.975126:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140784640:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3001us (97874us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762890.975137:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 437 00000100:00100000:1.0:1789762890.975148:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295445137337 time 295445258359 state 0x2 ref 0 00000100:00100000:0.0:1789762890.977099:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762890.977147:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140784768 00000100:00100000:2.0:1789762890.977156:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140784768 00000100:00100000:2.0:1789762890.977200:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295445137337 time 295445258359 state 0x0 ref 1 00000100:00100000:2.0:1789762890.977219:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295545258359 time 295445258359 state 0x1 ref 1 00000100:00100000:2.0:1789762891.072159:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295545258359 time 295545308379 state 0x0 ref 1 00000100:00100000:2.0:1789762891.072197:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140784768:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:2.0:1789762891.072233:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570546 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.072247:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762891.072251:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762891.072256:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570546 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789762891.072263:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762891.072285:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570546 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.075138:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570546 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.075155:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570546 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.075162:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570546 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.075167:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762891.075171:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570546 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.075177:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570546 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.075190:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570546 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.075195:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570546 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762891.075243:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140784768:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3068us (98145us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762891.075250:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 438 00000100:00100000:3.0:1789762891.075258:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295545258359 time 295545308379 state 0x2 ref 0 00000100:00100000:0.0:1789762891.077108:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762891.077135:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140784896 00000100:00100000:3.0:1789762891.077149:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140784896 00000100:00100000:3.0:1789762891.077183:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295545258359 time 295545308379 state 0x0 ref 1 00000100:00100000:3.0:1789762891.077194:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295645308379 time 295545308379 state 0x1 ref 1 00000100:00100000:1.0:1789762891.172254:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295645308379 time 295645400329 state 0x0 ref 1 00000100:00100000:1.0:1789762891.172286:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140784896:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762891.172336:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57054d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.172351:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762891.172354:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762891.172359:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57054d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.172369:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57054d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.175143:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57054d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.175154:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57054d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.175172:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57054d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.175178:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762891.175182:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57054d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.175189:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57054d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.175204:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57054d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.175210:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57054d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762891.175261:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140784896:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2987us (98151us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762891.175272:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 439 00000100:00100000:1.0:1789762891.175282:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295645308379 time 295645400329 state 0x2 ref 0 00000100:00100000:2.0:1789762891.177006:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762891.177053:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140785024 00000100:00100000:0.0:1789762891.177062:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140785024 00000100:00100000:0.0:1789762891.177099:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295645308379 time 295645400329 state 0x0 ref 1 00000100:00100000:0.0:1789762891.177110:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295745400329 time 295645400329 state 0x1 ref 1 00000100:00100000:3.0:1789762891.272348:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295745400329 time 295745498285 state 0x0 ref 1 00000100:00100000:3.0:1789762891.272370:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140785024:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:3.0:1789762891.272409:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c570554 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.272423:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762891.272427:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762891.272432:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c570554 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.272443:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c570554 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.275104:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c570554 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.275119:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c570554 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.275130:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c570554 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.275137:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15043a600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762891.275140:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c570554 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.275151:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c570554 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.275170:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c570554 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.275179:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce3c5014/0xd08452c77c570554 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762891.275243:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140785024:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2880us (98237us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762891.275250:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 440 00000100:00100000:2.0:1789762891.275257:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295745400329 time 295745498285 state 0x2 ref 0 00000100:00100000:2.0:1789762891.276981:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762891.277017:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140785152 00000100:00100000:3.0:1789762891.277025:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140785152 00000100:00100000:3.0:1789762891.277058:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295745400329 time 295745498285 state 0x0 ref 1 00000100:00100000:3.0:1789762891.277068:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295845498285 time 295745498285 state 0x1 ref 1 00000100:00100000:1.0:1789762891.372467:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295845498285 time 295845603360 state 0x0 ref 1 00000100:00100000:1.0:1789762891.372501:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140785152:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762891.372558:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57055b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.372575:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762891.372579:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762891.372585:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57055b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.372599:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57055b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.375922:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57055b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.375933:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57055b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.375941:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57055b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.375947:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762891.375951:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57055b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.375957:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57055b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.375982:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57055b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.375989:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c57055b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762891.376034:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140785152:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3548us (99052us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762891.376042:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 441 00000100:00100000:1.0:1789762891.376050:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295845498285 time 295845603360 state 0x2 ref 0 00000100:00100000:2.0:1789762891.377864:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762891.377914:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140785280 00000100:00100000:0.0:1789762891.377920:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140785280 00000100:00100000:0.0:1789762891.377955:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295845498285 time 295845603360 state 0x0 ref 1 00000100:00100000:0.0:1789762891.377966:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295945603360 time 295845603360 state 0x1 ref 1 00000100:00100000:2.0:1789762891.472537:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295945603360 time 295945686675 state 0x0 ref 1 00000100:00100000:2.0:1789762891.472563:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140785280:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:2.0:1789762891.472599:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000acc6223f/0xd08452c77c570562 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.472614:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762891.472617:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762891.472622:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acc6223f/0xd08452c77c570562 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.472633:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acc6223f/0xd08452c77c570562 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.475277:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000acc6223f/0xd08452c77c570562 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.475294:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acc6223f/0xd08452c77c570562 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.475304:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acc6223f/0xd08452c77c570562 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.475313:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d15829a400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762891.475318:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acc6223f/0xd08452c77c570562 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.475329:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acc6223f/0xd08452c77c570562 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.475345:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acc6223f/0xd08452c77c570562 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.475351:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acc6223f/0xd08452c77c570562 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762891.475406:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140785280:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2853us (97543us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762891.475414:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 442 00000100:00100000:0.0:1789762891.475422:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295945603360 time 295945686675 state 0x2 ref 0 00000100:00100000:2.0:1789762891.477141:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762891.477186:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140785408 00000100:00100000:3.0:1789762891.477201:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140785408 00000100:00100000:3.0:1789762891.477237:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 295945603360 time 295945686675 state 0x0 ref 1 00000100:00100000:3.0:1789762891.477248:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296045686675 time 295945686675 state 0x1 ref 1 00000100:00100000:1.0:1789762891.572651:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296045686675 time 296045800079 state 0x0 ref 1 00000100:00100000:1.0:1789762891.572678:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140785408:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762891.572715:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570569 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.572744:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762891.572748:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762891.572753:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570569 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.572766:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570569 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.575557:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570569 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.575572:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570569 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.575582:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570569 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.575591:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762891.575597:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570569 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.575606:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570569 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.575624:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570569 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.575633:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570569 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762891.575687:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140785408:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3017us (98543us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762891.575697:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 443 00000100:00100000:1.0:1789762891.575716:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296045686675 time 296045800079 state 0x2 ref 0 00000100:00100000:2.0:1789762891.577478:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762891.577524:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140785536 00000100:00100000:0.0:1789762891.577531:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140785536 00000100:00100000:0.0:1789762891.577568:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296045686675 time 296045800079 state 0x0 ref 1 00000100:00100000:0.0:1789762891.577578:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296145800079 time 296045800079 state 0x1 ref 1 00000100:00100000:0.0:1789762891.672719:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296145800079 time 296145868052 state 0x0 ref 1 00000100:00100000:0.0:1789762891.672763:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140785536:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762891.672805:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570570 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.672819:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762891.672822:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762891.672827:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570570 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.672875:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570570 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.675561:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570570 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.675572:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570570 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.675589:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570570 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.675595:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762891.675599:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570570 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.675605:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570570 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.675617:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570570 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.675623:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570570 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762891.675668:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140785536:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2918us (98190us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762891.675676:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 444 00000100:00100000:0.0:1789762891.675684:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296145800079 time 296145868052 state 0x2 ref 0 00000100:00100000:3.0:1789762891.677428:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762891.677461:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140785664 00000100:00100000:0.0:1789762891.677468:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140785664 00000100:00100000:0.0:1789762891.677500:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296145800079 time 296145868052 state 0x0 ref 1 00000100:00100000:0.0:1789762891.677518:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296245868052 time 296145868052 state 0x1 ref 1 00000100:00100000:1.0:1789762891.772827:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296245868052 time 296245976872 state 0x0 ref 1 00000100:00100000:1.0:1789762891.772871:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140785664:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762891.772908:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570577 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.772922:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762891.772925:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762891.772929:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570577 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.772940:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570577 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.775708:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570577 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.775721:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570577 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.775744:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570577 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.775754:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762891.775767:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570577 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.775779:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570577 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.775798:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570577 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.775807:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570577 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762891.775892:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140785664:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3030us (98462us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762891.775903:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 445 00000100:00100000:1.0:1789762891.775914:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296245868052 time 296245976872 state 0x2 ref 0 00000100:00100000:3.0:1789762891.777644:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762891.777694:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140785792 00000100:00100000:0.0:1789762891.777702:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140785792 00000100:00100000:0.0:1789762891.777748:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296245868052 time 296245976872 state 0x0 ref 1 00000100:00100000:0.0:1789762891.777760:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296345976872 time 296245976872 state 0x1 ref 1 00010000:00010000:0.0:1789762891.814960:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762891.872889:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296345976872 time 296346039087 state 0x0 ref 1 00000100:00100000:0.0:1789762891.872914:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140785792:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762891.872952:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57057e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.872966:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762891.872970:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762891.872975:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57057e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.872985:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57057e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.875598:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57057e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.875619:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57057e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.875626:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57057e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.875631:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762891.875634:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57057e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.875642:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57057e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.875655:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57057e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.875659:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57057e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762891.875708:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140785792:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2804us (98065us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762891.875716:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 446 00000100:00100000:0.0:1789762891.875736:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296345976872 time 296346039087 state 0x2 ref 0 00000100:00100000:3.0:1789762891.877584:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762891.877618:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140785920 00000100:00100000:0.0:1789762891.877631:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140785920 00000100:00100000:0.0:1789762891.877663:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296345976872 time 296346039087 state 0x0 ref 1 00000100:00100000:0.0:1789762891.877673:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296446039087 time 296346039087 state 0x1 ref 1 00000100:00100000:1.0:1789762891.973037:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296446039087 time 296446185947 state 0x0 ref 1 00000100:00100000:1.0:1789762891.973076:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140785920:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762891.973113:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570585 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.973127:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762891.973130:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762891.973147:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570585 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.973171:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570585 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.976159:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570585 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.976170:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570585 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.976178:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570585 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.976184:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762891.976188:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570585 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.976194:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570585 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.976210:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570585 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.976219:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570585 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762891.976286:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140785920:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3233us (98702us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762891.976295:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 447 00000100:00100000:1.0:1789762891.976303:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296446039087 time 296446185947 state 0x2 ref 0 00000100:00100000:3.0:1789762891.978051:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762891.978096:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140786048 00000100:00100000:0.0:1789762891.978104:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140786048 00000100:00100000:0.0:1789762891.978152:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296446039087 time 296446185947 state 0x0 ref 1 00000100:00100000:0.0:1789762891.978163:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296546185947 time 296446185947 state 0x1 ref 1 00000100:00100000:0.0:1789762892.073085:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296546185947 time 296546234640 state 0x0 ref 1 00000100:00100000:0.0:1789762892.073108:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140786048:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762892.073160:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57058c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.073176:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762892.073180:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762892.073185:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57058c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.073196:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57058c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.076154:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57058c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.076175:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57058c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.076181:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57058c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.076186:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762892.076189:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57058c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.076196:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57058c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.076218:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57058c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.076223:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57058c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762892.076278:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140786048:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3175us (98226us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762892.076288:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 448 00000100:00100000:0.0:1789762892.076299:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296546185947 time 296546234640 state 0x2 ref 0 00000100:00100000:3.0:1789762892.078344:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762892.078379:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140786176 00000100:00100000:0.0:1789762892.078394:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140786176 00000100:00100000:0.0:1789762892.078444:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296546185947 time 296546234640 state 0x0 ref 1 00000100:00100000:0.0:1789762892.078454:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296646234640 time 296546234640 state 0x1 ref 1 00000100:00100000:1.0:1789762892.173198:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296646234640 time 296646336534 state 0x0 ref 1 00000100:00100000:1.0:1789762892.173221:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140786176:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762892.173269:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570593 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.173283:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762892.173287:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762892.173292:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570593 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.173303:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570593 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.175918:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570593 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.175927:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570593 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.175960:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570593 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.175966:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762892.175970:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570593 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.175977:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570593 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.175990:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570593 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.175996:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c570593 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762892.176039:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140786176:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2827us (97696us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762892.176046:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 449 00000100:00100000:1.0:1789762892.176054:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296646234640 time 296646336534 state 0x2 ref 0 00000100:00100000:3.0:1789762892.177913:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762892.177965:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140786304 00000100:00100000:0.0:1789762892.177976:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140786304 00000100:00100000:0.0:1789762892.178016:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296646234640 time 296646336534 state 0x0 ref 1 00000100:00100000:0.0:1789762892.178027:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296746336534 time 296646336534 state 0x1 ref 1 00000100:00100000:0.0:1789762892.273232:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296746336534 time 296746381542 state 0x0 ref 1 00000100:00100000:0.0:1789762892.273253:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140786304:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762892.273288:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57059a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.273301:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762892.273305:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762892.273309:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57059a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.273320:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57059a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.276010:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57059a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.276032:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57059a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.276039:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57059a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.276044:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762892.276047:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57059a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.276054:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57059a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.276067:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57059a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.276072:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57059a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762892.276121:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140786304:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2872us (98206us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762892.276131:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 450 00000100:00100000:0.0:1789762892.276141:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296746336534 time 296746381542 state 0x2 ref 0 00000100:00100000:2.0:1789762892.277908:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762892.277946:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140786432 00000100:00100000:0.0:1789762892.277960:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140786432 00000100:00100000:0.0:1789762892.277990:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296746336534 time 296746381542 state 0x0 ref 1 00000100:00100000:0.0:1789762892.278000:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296846381542 time 296746381542 state 0x1 ref 1 00000100:00100000:1.0:1789762892.373324:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296846381542 time 296846474127 state 0x0 ref 1 00000100:00100000:1.0:1789762892.373348:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140786432:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762892.373397:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705a1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.373420:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762892.373424:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762892.373428:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.373439:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.376217:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.376226:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.376233:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.376239:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762892.376243:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.376249:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.376281:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.376290:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762892.376348:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140786432:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3007us (98438us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762892.376358:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 451 00000100:00100000:1.0:1789762892.376369:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296846381542 time 296846474127 state 0x2 ref 0 00000100:00100000:2.0:1789762892.378567:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762892.378611:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140786560 00000100:00100000:1.0:1789762892.378620:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140786560 00000100:00100000:1.0:1789762892.378673:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296846381542 time 296846474127 state 0x0 ref 1 00000100:00100000:1.0:1789762892.378688:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296946474127 time 296846474127 state 0x1 ref 1 00000100:00100000:0.0:1789762892.473455:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296946474127 time 296946604936 state 0x0 ref 1 00000100:00100000:0.0:1789762892.473481:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140786560:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762892.473518:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705a8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.473531:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762892.473535:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762892.473540:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.473552:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.476804:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.476819:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.476828:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.476862:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762892.476867:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.476877:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.476896:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.476905:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762892.476967:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140786560:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3494us (98398us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762892.476977:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 452 00000100:00100000:0.0:1789762892.476989:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296946474127 time 296946604936 state 0x2 ref 0 00000100:00100000:3.0:1789762892.479051:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762892.479095:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140786688 00000100:00100000:0.0:1789762892.479103:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140786688 00000100:00100000:0.0:1789762892.479146:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 296946474127 time 296946604936 state 0x0 ref 1 00000100:00100000:0.0:1789762892.479161:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297046604936 time 296946604936 state 0x1 ref 1 00000100:00100000:1.0:1789762892.573556:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297046604936 time 297046706336 state 0x0 ref 1 00000100:00100000:1.0:1789762892.573580:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140786688:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762892.573617:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705af lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.573631:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762892.573653:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762892.573658:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.573672:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.576545:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.576558:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.576565:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.576571:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762892.576574:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.576581:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.576595:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705af lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.576600:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705af lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762892.576659:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140786688:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3087us (97609us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762892.576667:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 453 00000100:00100000:1.0:1789762892.576676:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297046604936 time 297046706336 state 0x2 ref 0 00000100:00100000:3.0:1789762892.578624:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762892.578657:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140786816 00000100:00100000:1.0:1789762892.578665:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140786816 00000100:00100000:1.0:1789762892.578700:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297046604936 time 297046706336 state 0x0 ref 1 00000100:00100000:1.0:1789762892.578711:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297146706336 time 297046706336 state 0x1 ref 1 00000100:00100000:0.0:1789762892.673705:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297146706336 time 297146849787 state 0x0 ref 1 00000100:00100000:0.0:1789762892.673765:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140786816:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762892.673827:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705b6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.673878:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762892.673884:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762892.673891:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.673907:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.676893:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.676905:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.676912:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.676917:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762892.676921:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.676927:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.676947:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.676953:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762892.677000:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140786816:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3245us (98376us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762892.677006:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 454 00000100:00100000:0.0:1789762892.677016:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297146706336 time 297146849787 state 0x2 ref 0 00000100:00100000:2.0:1789762892.679128:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762892.679161:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140786944 00000100:00100000:0.0:1789762892.679168:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140786944 00000100:00100000:0.0:1789762892.679209:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297146706336 time 297146849787 state 0x0 ref 1 00000100:00100000:0.0:1789762892.679220:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297246849787 time 297146849787 state 0x1 ref 1 00000100:00100000:1.0:1789762892.773813:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297246849787 time 297246963297 state 0x0 ref 1 00000100:00100000:1.0:1789762892.773865:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140786944:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762892.773901:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705bd lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.773916:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762892.773919:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762892.773924:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705bd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.773934:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705bd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.776516:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705bd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.776527:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.776535:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.776540:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762892.776544:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.776551:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.776564:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.776569:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762892.776615:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140786944:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2786us (97487us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762892.776623:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 455 00000100:00100000:1.0:1789762892.776638:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297246849787 time 297246963297 state 0x2 ref 0 00000100:00100000:3.0:1789762892.778449:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762892.778516:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140787072 00000100:00100000:1.0:1789762892.778524:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140787072 00000100:00100000:1.0:1789762892.778559:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297246849787 time 297246963297 state 0x0 ref 1 00000100:00100000:1.0:1789762892.778570:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297346963297 time 297246963297 state 0x1 ref 1 00010000:00010000:2.0:1789762892.838987:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762892.873921:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297346963297 time 297347071891 state 0x0 ref 1 00000100:00100000:0.0:1789762892.873948:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140787072:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762892.873985:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705c4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.873999:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762892.874015:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762892.874020:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.874031:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.876949:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.876960:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.876966:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.876971:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762892.876975:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.876981:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.876993:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.876998:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762892.877058:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140787072:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3120us (98610us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762892.877067:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 456 00000100:00100000:0.0:1789762892.877075:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297346963297 time 297347071891 state 0x2 ref 0 00000100:00100000:3.0:1789762892.878982:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762892.879014:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140787200 00000100:00100000:0.0:1789762892.879023:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140787200 00000100:00100000:0.0:1789762892.879059:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297346963297 time 297347071891 state 0x0 ref 1 00000100:00100000:0.0:1789762892.879070:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297447071891 time 297347071891 state 0x1 ref 1 00000100:00100000:1.0:1789762892.974034:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297447071891 time 297447179747 state 0x0 ref 1 00000100:00100000:1.0:1789762892.974063:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140787200:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762892.974105:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705cb lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.974123:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762892.974127:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762892.974134:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.974149:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.976890:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.976903:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.976927:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.976936:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762892.976941:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.976952:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.976969:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.976978:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762892.977043:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140787200:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2991us (98061us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762892.977054:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 457 00000100:00100000:1.0:1789762892.977065:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297447071891 time 297447179747 state 0x2 ref 0 00000100:00100000:3.0:1789762892.979350:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762892.979392:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140787328 00000100:00100000:1.0:1789762892.979401:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140787328 00000100:00100000:1.0:1789762892.979441:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297447071891 time 297447179747 state 0x0 ref 1 00000100:00100000:1.0:1789762892.979465:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297547179747 time 297447179747 state 0x1 ref 1 00000100:00100000:0.0:1789762893.074149:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297547179747 time 297547298721 state 0x0 ref 1 00000100:00100000:0.0:1789762893.074196:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140787328:12345-192.168.203.31@tcp:3:dd.0 00000100:00080000:1.0:1789762893.074223:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762893.074239:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705d2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.074254:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762893.074258:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762893.074263:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.074273:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.076818:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.076847:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.076855:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.076860:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762893.076864:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.076870:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.076882:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.076887:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762893.076932:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140787328:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2766us (97583us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762893.076941:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 458 00000100:00100000:0.0:1789762893.076960:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297547179747 time 297547298721 state 0x2 ref 0 00000100:00100000:2.0:1789762893.078873:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762893.078905:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140787456 00000100:00100000:0.0:1789762893.078914:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140787456 00000100:00100000:0.0:1789762893.078949:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297547179747 time 297547298721 state 0x0 ref 1 00000100:00100000:0.0:1789762893.078959:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297647298721 time 297547298721 state 0x1 ref 1 00000100:00100000:1.0:1789762893.174224:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297647298721 time 297647374124 state 0x0 ref 1 00000100:00100000:1.0:1789762893.174244:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140787456:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762893.174278:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705d9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.174294:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762893.174299:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762893.174305:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.174320:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.176798:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.176807:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.176814:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.176859:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762893.176863:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.176871:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.176885:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.176890:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762893.176932:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140787456:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2694us (98060us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762893.176941:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 459 00000100:00100000:1.0:1789762893.176949:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297647298721 time 297647374124 state 0x2 ref 0 00000100:00100000:3.0:1789762893.178864:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762893.178893:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140787584 00000100:00100000:1.0:1789762893.178900:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140787584 00000100:00100000:1.0:1789762893.178935:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297647298721 time 297647374124 state 0x0 ref 1 00000100:00100000:1.0:1789762893.178944:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297747374124 time 297647374124 state 0x1 ref 1 00000100:00100000:0.0:1789762893.274298:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297747374124 time 297747448196 state 0x0 ref 1 00000100:00100000:0.0:1789762893.274318:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140787584:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762893.274352:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705e0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.274365:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762893.274369:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762893.274373:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.274384:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.276743:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.276752:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.276765:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.276770:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762893.276773:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.276780:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.276792:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.276798:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762893.276865:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140787584:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2551us (98002us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762893.276873:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 460 00000100:00100000:0.0:1789762893.276881:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297747374124 time 297747448196 state 0x2 ref 0 00000100:00100000:3.0:1789762893.278825:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762893.278889:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140787712 00000100:00100000:0.0:1789762893.278898:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140787712 00000100:00100000:0.0:1789762893.278933:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297747374124 time 297747448196 state 0x0 ref 1 00000100:00100000:0.0:1789762893.278952:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297847448196 time 297747448196 state 0x1 ref 1 00000100:00100000:1.0:1789762893.374414:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297847448196 time 297847558204 state 0x0 ref 1 00000100:00100000:1.0:1789762893.374455:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140787712:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762893.374492:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705e7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.374506:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762893.374509:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762893.374514:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705e7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.374526:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705e7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.377515:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705e7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.377529:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.377540:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.377548:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762893.377553:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.377577:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.377595:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.377602:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762893.377649:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140787712:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3202us (98825us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762893.377656:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 461 00000100:00100000:1.0:1789762893.377663:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297847448196 time 297847558204 state 0x2 ref 0 00000100:00100000:3.0:1789762893.379821:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762893.379884:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140787840 00000100:00100000:1.0:1789762893.379893:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140787840 00000100:00100000:1.0:1789762893.379945:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297847448196 time 297847558204 state 0x0 ref 1 00000100:00100000:1.0:1789762893.379961:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297947558204 time 297847558204 state 0x1 ref 1 00000100:00100000:0.0:1789762893.474496:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297947558204 time 297947645557 state 0x0 ref 1 00000100:00100000:0.0:1789762893.474522:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140787840:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:0.0:1789762893.474560:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705ee lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.474574:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762893.474578:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762893.474582:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.474593:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.477451:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.477462:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.477469:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.477485:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762893.477489:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.477496:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.477508:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.477514:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5705ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762893.477563:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140787840:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3051us (97742us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762893.477570:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 462 00000100:00100000:0.0:1789762893.477578:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297947558204 time 297947645557 state 0x2 ref 0 00000100:00100000:3.0:1789762893.479686:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762893.479759:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140787968 00000100:00100000:0.0:1789762893.479768:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140787968 00000100:00100000:0.0:1789762893.479804:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 297947558204 time 297947645557 state 0x0 ref 1 00000100:00100000:0.0:1789762893.479815:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 298047645557 time 297947645557 state 0x1 ref 1 00000100:00100000:1.0:1789762893.574600:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 298047645557 time 298047750627 state 0x0 ref 1 00000100:00100000:1.0:1789762893.574626:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140787968:12345-192.168.203.31@tcp:3:dd.0 00010000:00010000:1.0:1789762893.574666:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705f5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.574708:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762893.574727:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762893.574733:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.574747:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.577378:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.577389:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.577397:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.577414:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762893.577418:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.577424:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.577439:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.577454:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948928a7/0xd08452c77c5705f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762893.577509:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140787968:12345-192.168.203.31@tcp:3:dd.0 Request processed in 2892us (97823us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762893.577517:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 463 00000100:00100000:1.0:1789762893.577525:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 298047645557 time 298047750627 state 0x2 ref 0 00000100:00100000:3.0:1789762893.602962:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762893.603018:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140788096 00000100:00100000:0.0:1789762893.603040:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140788096 00000100:00100000:0.0:1789762893.603095:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1789762893.603103:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+6:10500:x1876702140788096:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762893.603115:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762893.603149:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c57032b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9b7 expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.603191:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762893.603246:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+5:10500:x1876702140788096:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 142us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762893.603253:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:2.0:1789762893.615393:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762893.615440:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140788224 00000100:00100000:3.0:1789762893.615448:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140788224 00000100:00100000:3.0:1789762893.615499:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00080000:1.0:1789762893.615507:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762893.615514:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+9:11955:x1876702140788224:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1789762893.615534:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762893.615549:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c5705fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9be expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.615611:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ee00/0xd08452c77c570603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.615621:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ee00/0xd08452c77c570603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.615631:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ee00/0xd08452c77c570603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762893.615669:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 16384 00000004:00200000:3.0:1789762893.615672:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762893.615685:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ee00/0xd08452c77c570603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.615702:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c5705fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9be expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.615732:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ee00/0xd08452c77c570603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9be expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.615749:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:3.0:1789762893.615751:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762893.615753:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003ee00, rc 0) 00000100:00100000:3.0:1789762893.615794:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+10:11955:x1876702140788224:12345-192.168.203.31@tcp:101:bash.0 Request processed in 288us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762893.615799:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:2.0:1789762893.621661:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762893.621796:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140788480 00000100:00100000:1.0:1789762893.621802:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140788480 00000100:00100000:1.0:1789762893.621858:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:1.0:1789762893.621867:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+10:12889:x1876702140788480:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:1.0:1789762893.621876:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762893.621885:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882ee00/0xd08452c77c57060a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9c5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762893.621930:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 16384 00010000:00010000:1.0:1789762893.622108:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882ee00/0xd08452c77c57060a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9c5 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.622118:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90d00) 00010000:00010000:1.0:1789762893.622120:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789762893.622123:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882ee00/0xd08452c77c57060a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9c5 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.622142:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d14882ee00, rc 0) 00000100:00100000:1.0:1789762893.622173:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+11:12889:x1876702140788480:12345-192.168.203.31@tcp:101:rm.0 Request processed in 309us (515us total) trans 4294967481 rc 301/301 00000100:00100000:1.0:1789762893.622178:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:0.0:1789762893.623802:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762893.623855:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140788608 00000100:00100000:1.0:1789762893.623860:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140788608 00000100:00100000:1.0:1789762893.623887:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:1.0:1789762893.623893:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+11:12889:x1876702140788608:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:1.0:1789762893.625876:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+11:12889:x1876702140788608:12345-192.168.203.31@tcp:37:rm.0 Request processed in 1982us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762893.625882:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1789762893.627155:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762893.627234:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140788864 00000100:00100000:0.0:1789762893.627239:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140788864 00000100:00100000:0.0:1789762893.627267:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1789762893.627274:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+11:12889:x1876702140788864:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:0.0:1789762893.627370:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+12:12889:x1876702140788864:12345-192.168.203.31@tcp:35:rm.0 Request processed in 97us (217us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789762893.627375:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1789762893.628309:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762893.628363:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140789120 00000100:00100000:2.0:1789762893.628369:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140789120 00000100:00100000:2.0:1789762893.628404:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:2.0:1789762893.628414:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+12:12889:x1876702140789120:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789762893.628426:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762893.628436:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894c00/0xd08452c77c570618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9cc expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.628482:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895a00/0xd08452c77c57061f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.628493:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895a00/0xd08452c77c57061f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.628503:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895a00/0xd08452c77c57061f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762893.628512:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 16384 00010000:00010000:2.0:1789762893.628572:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894c00/0xd08452c77c570618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9cc expref: 15 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.628588:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895a00/0xd08452c77c57061f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9cc expref: 14 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.628609:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:2.0:1789762893.628612:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789762893.628615:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a895a00, rc 0) 00000100:00100000:2.0:1789762893.628651:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+14:12889:x1876702140789120:12345-192.168.203.31@tcp:101:rm.0 Request processed in 238us (341us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789762893.628658:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:2.0:1789762893.629581:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762893.629621:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140789248 00000100:00100000:0.0:1789762893.629626:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140789248 00000100:00100000:0.0:1789762893.629652:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:0.0:1789762893.629659:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+14:12889:x1876702140789248:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:0.0:1789762893.629689:0:7603:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7614758912 avail 7596933120 00000100:00100000:0.0:1789762893.629735:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+14:12889:x1876702140789248:12345-192.168.203.31@tcp:41:rm.0 Request processed in 77us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762893.629748:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:0.0:1789762893.630509:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762893.630554:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140789504 00000100:00100000:1.0:1789762893.630560:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140789504 00000100:00100000:1.0:1789762893.630591:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:1.0:1789762893.630601:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+14:12889:x1876702140789504:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:1.0:1789762893.630771:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+15:12889:x1876702140789504:12345-192.168.203.31@tcp:35:rm.0 Request processed in 172us (262us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789762893.630777:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1789762893.631404:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762893.631441:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140789760 00000100:00100000:0.0:1789762893.631446:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140789760 00000100:00100000:0.0:1789762893.631467:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:0.0:1789762893.631473:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+15:12889:x1876702140789760:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:0.0:1789762893.631495:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789762893.631508:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043b200/0xd08452c77c57031d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9b0 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.631522:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829bc00/0xd08452c77c57003e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9a9 expref: 14 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.631530:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:0.0:1789762893.631539:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ee00/0xd08452c77c570603 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9be expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.631545:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:0.0:1789762893.631547:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762893.631556:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638c00/0xd08452c77c57062d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.631563:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638c00/0xd08452c77c57062d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.631568:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638c00/0xd08452c77c57062d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.631586:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570634 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.631591:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.631596:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.631882:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639200/0xd08452c77c57063b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.631889:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639200/0xd08452c77c57063b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.631894:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639200/0xd08452c77c57063b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789762893.632550:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 64 off9088 00000004:00080000:0.0:1789762893.632558:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 298105724075ns, next at 299105722560ns, rc = 0 00010000:00010000:0.0:1789762893.632592:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639600/0xd08452c77c570642 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632599:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639600/0xd08452c77c570642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632605:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639600/0xd08452c77c570642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632610:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639600/0xd08452c77c570642 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632624:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639600/0xd08452c77c570642 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632628:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639600/0xd08452c77c570642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632643:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762893.632652:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639200/0xd08452c77c57063b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632656:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639200/0xd08452c77c57063b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632661:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639200/0xd08452c77c57063b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632665:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762893.632669:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639200/0xd08452c77c57063b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.632671:0:6671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762893.632675:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639200/0xd08452c77c57063b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.632680:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639600/0xd08452c77c570642 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632683:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff95d151e90a00) 00010000:00010000:0.0:1789762893.632690:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789762893.632694:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639200/0xd08452c77c57063b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.632696:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762893.632704:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639600/0xd08452c77c570642 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632705:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639200/0xd08452c77c57063b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.632738:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639600/0xd08452c77c570642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632739:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638c00/0xd08452c77c57062d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632751:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638c00/0xd08452c77c57062d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.632753:0:6671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff95d151e90a00) 00010000:00010000:0.0:1789762893.632757:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638c00/0xd08452c77c57062d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.632758:0:6671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789762893.632765:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762893.632775:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639600/0xd08452c77c570642 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632776:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638c00/0xd08452c77c57062d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632799:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638c00/0xd08452c77c57062d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.632799:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639600/0xd08452c77c570642 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.632821:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:0.0:1789762893.632824:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762893.632827:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638c00/0xd08452c77c57062d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.632830:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762893.632846:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638c00/0xd08452c77c57062d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.632857:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1789762893.632858:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000917b6da8 reply state 0000000042468505 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762893.632876:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789762893.632879:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762893.632914:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+14:12889:x1876702140789760:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1440us (1510us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789762893.632919:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 226 00010000:00010000:3.0:1789762893.633402:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.633416:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570634 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.633421:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570634 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.633425:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762893.633428:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570634 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.633432:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570634 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.633439:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4009f790 (ffff95d151e90100) 00010000:00010000:3.0:1789762893.633441:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762893.633443:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570634 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.633447:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570634 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762893.633849:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762893.633899:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140790016 00000100:00100000:0.0:1789762893.633906:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140790016 00000100:00100000:0.0:1789762893.633953:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:0.0:1789762893.633963:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+13:12889:x1876702140790016:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:0.0:1789762893.634055:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+14:12889:x1876702140790016:12345-192.168.203.31@tcp:35:rm.0 Request processed in 94us (224us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789762893.634060:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:2.0:1789762893.634864:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762893.634892:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140790272 00000100:00100000:0.0:1789762893.634897:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140790272 00000100:00100000:0.0:1789762893.634922:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:0.0:1789762893.634928:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+14:12889:x1876702140790272:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:0.0:1789762893.634947:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789762893.634957:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895a00/0xd08452c77c57061f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9cc expref: 14 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.634969:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15043ba00/0xd08452c77c570022 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9a2 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.634976:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff95d14abf2900) 00010000:00010000:0.0:1789762893.634984:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d15829b800/0xd08452c77c56ffc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e98d expref: 12 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.634990:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90d00) 00010000:00010000:0.0:1789762893.634995:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762893.635004:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570649 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635010:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570649 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635024:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570649 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635032:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c570650 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635037:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c570650 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635042:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c570650 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635227:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570657 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635233:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635238:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762893.635545:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 16384 00010000:00010000:0.0:1789762893.635553:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635558:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570657 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635562:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570657 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635566:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762893.635572:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570657 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635576:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570657 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635583:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff95d151e90b00) 00010000:00010000:0.0:1789762893.635584:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789762893.635586:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570657 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635590:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570657 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635600:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570649 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635604:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570649 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635608:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570649 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635612:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762893.635613:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570649 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635617:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570649 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635621:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90300) 00010000:00010000:0.0:1789762893.635622:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762893.635627:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570649 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.635632:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570649 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762893.635639:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c3496cc reply state 000000000c23185e transno 4294967487 ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c570650 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762893.635643:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762893.635675:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+13:12889:x1876702140790272:12345-192.168.203.31@tcp:36:rm.0 Request processed in 748us (844us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1789762893.635681:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 227 00010000:00010000:0.0:1789762893.636162:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c570650 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.636168:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c570650 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.636173:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c570650 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.636176:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762893.636178:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c570650 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.636193:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c570650 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.636199:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d151e90400) 00010000:00010000:0.0:1789762893.636201:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762893.636203:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c570650 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.636212:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c570650 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.862933:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789762894.500045:0:14099:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 298973209626ns, next at 299105722560ns, rc = 0 00000001:00080000:3.0:1789762894.509128:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967487 is committed 00000004:00080000:3.0:1789762894.509141:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000004:00080000:3.0:1789762894.509175:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000100:00100000:0.0:1789762894.509275:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789762894.509293:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149034624:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789762894.509348:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762894.509378:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149034624 00000100:00100000:1.0:1789762894.509385:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149034624 00000100:00080000:0.0:1789762894.509432:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762894.509450:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789762894.509461:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149034624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789762894.509481:0:6655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:14 count 1 00002000:00010000:1.0:1789762894.509505:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 104857600, mtime: 0x6aad9d43, atime: 0x0, ctime: 0x6aad9d43, blocks: 0x3200b 00010000:00010000:1.0:1789762894.509517:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056bec43c/0xd08452c77c57065e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.509530:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=298s v=(0 0) 00010000:00010000:1.0:1789762894.509533:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762894.509538:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056bec43c/0xd08452c77c57065e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.509548:0:6655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056bec43c/0xd08452c77c57065e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.509555:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056bec43c/0xd08452c77c57065e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.509561:0:6655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056bec43c/0xd08452c77c57065e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.509573:0:6655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762894.509609:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762894.509618:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056bec43c/0xd08452c77c57065e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.509627:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882e400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762894.509631:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056bec43c/0xd08452c77c57065e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.509639:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056bec43c/0xd08452c77c57065e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.509654:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056bec43c/0xd08452c77c57065e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.509660:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056bec43c/0xd08452c77c57065e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.509673:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762894.509686:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762894.509687:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762894.510046:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149034624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 587us (696us total) trans 4294967792 rc 0/0 00000100:00100000:1.0:1789762894.510054:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000004:00080000:0.0:1789762894.510077:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d16ffe1880/2, rc 0, transno 4294967792 00000100:00100000:0.0:1789762894.510090:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149034624:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789762894.510195:0:14099:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 298983360230ns, next at 285640138390ns, rc = 0 00000004:00080000:2.0:1789762894.511022:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00010000:00010000:3.0:1789762894.886917:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762895.526986:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149034752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762895.526986:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d160034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149035008:0@lo:400:kworker.0 00000100:00100000:0.0:1789762895.526988:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149034880:0@lo:400:kworker.0 00000100:00100000:2.0:1789762895.527019:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149035136:0@lo:400:kworker.0 00000100:00100000:0.0:1789762895.527066:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762895.527073:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762895.527077:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762895.527107:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149034880 00000100:00100000:2.0:1789762895.527113:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149034880 00000100:00100000:1.0:1789762895.527130:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149035264:0@lo:400:kworker.0 00000100:00100000:0.0:1789762895.527131:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702149035392:0@lo:400:kworker.0 00000100:00100000:3.0:1789762895.527132:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149035520:0@lo:400:kworker.0 00000100:00100000:2.0:1789762895.527156:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789762895.527165:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149034880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762895.527179:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762895.527186:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762895.527197:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149034752 00000100:00100000:3.0:1789762895.527203:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149034752 00000100:00100000:2.0:1789762895.527228:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149034880:12345-0@lo:400:kworker.0 Request processed in 62us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762895.527236:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789762895.527239:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149034880:0@lo:400:kworker.0 00000100:00100000:1.0:1789762895.527239:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149035264 00000100:00100000:1.0:1789762895.527245:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149035264 00000100:00100000:3.0:1789762895.527267:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789762895.527281:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149035008 00000100:00100000:3.0:1789762895.527282:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149034752:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762895.527285:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149035008 00000100:00100000:1.0:1789762895.527294:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789762895.527294:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149035392 00000100:00100000:2.0:1789762895.527300:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149035392 00000100:00100000:1.0:1789762895.527308:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149035264:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789762895.527318:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 13631488 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762895.527326:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789762895.527338:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789762895.527340:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149035008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762895.527350:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702149035392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762895.527356:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149035264:12345-0@lo:400:kworker.0 Request processed in 52us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762895.527361:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789762895.527397:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149034752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762895.527399:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149035008:12345-0@lo:400:kworker.0 Request processed in 65us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762895.527405:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149035264:0@lo:400:kworker.0 00000100:00100000:2.0:1789762895.527411:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702149035392:12345-0@lo:400:kworker.0 Request processed in 63us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762895.527416:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789762895.527424:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789762895.527431:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149034752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762895.527435:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1789762895.527449:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762895.527455:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762895.527468:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762895.527471:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702149035392:0@lo:400:kworker.0 00000100:00100000:1.0:1789762895.527483:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762895.527507:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149035136 00000100:00100000:2.0:1789762895.527511:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149035136 00000100:00100000:1.0:1789762895.527524:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d160034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149035008:0@lo:400:kworker.0 00000100:00100000:3.0:1789762895.527538:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149035520 00000100:00100000:3.0:1789762895.527543:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149035520 00000100:00080000:0.0:1789762895.527554:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762895.527554:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789762895.527566:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149035136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762895.527585:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789762895.527597:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149035520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762895.527610:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149035136:12345-0@lo:400:kworker.0 Request processed in 47us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762895.527616:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789762895.527638:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149035136:0@lo:400:kworker.0 00000100:00100000:3.0:1789762895.527656:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149035520:12345-0@lo:400:kworker.0 Request processed in 63us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762895.527664:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789762895.527684:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149035520:0@lo:400:kworker.0 00000100:00100000:2.0:1789762895.732368:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762895.732396:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762895.732426:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762895.732442:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140790400 00000100:00100000:3.0:1789762895.732453:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140790400 00000100:00100000:2.0:1789762895.732464:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762895.732467:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140790528 00000100:00100000:1.0:1789762895.732473:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140790528 00000100:00100000:0.0:1789762895.732487:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140790784 00000100:00100000:0.0:1789762895.732493:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140790784 00000100:00100000:3.0:1789762895.732504:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 289 00000100:00100000:2.0:1789762895.732510:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762895.732519:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140790400:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762895.732533:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140790656 00000100:00100000:0.0:1789762895.732537:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140790656 00000100:00100000:1.0:1789762895.732538:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140790912 00000100:00100000:1.0:1789762895.732544:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140790912 00000100:00100000:2.0:1789762895.732563:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:0.0:1789762895.732574:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:2.0:1789762895.732577:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140790528:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762895.732586:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140790400:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762895.732592:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140790784:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762895.732592:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:3.0:1789762895.732601:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 289 00000100:00100000:1.0:1789762895.732609:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140790912:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762895.732639:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140790528:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 66us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762895.732649:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140790784:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 64us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762895.732651:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:1.0:1789762895.732658:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140790912:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 53us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762895.732676:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:0.0:1789762895.732677:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00080000:2.0:1789762895.732680:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789762895.732687:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789762895.732715:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762895.732725:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:0.0:1789762895.732737:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140790656:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762895.732765:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140790656:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 33us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762895.732772:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00010000:00010000:3.0:1789762895.911024:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762896.038949:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789762896.038968:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149035648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762896.039036:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762896.039070:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149035648 00000100:00100000:0.0:1789762896.039089:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149035648 00000100:00080000:2.0:1789762896.039131:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762896.039143:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789762896.039153:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149035648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762896.039187:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526712832 pending 0 free 3754950656 avail 3752853504 00000100:00100000:0.0:1789762896.039242:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149035648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762896.039252:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789762896.039275:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149035648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762896.934973:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762897.958995:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762898.982964:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789762899.126266:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967792 is committed 00010000:00010000:3.0:1789762900.007027:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762900.646994:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149035776:0@lo:400:kworker.0 00000100:00100000:0.0:1789762900.647017:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149036032:0@lo:400:kworker.0 00000100:00100000:3.0:1789762900.647028:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149036160:0@lo:400:kworker.0 00000100:00100000:1.0:1789762900.647052:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149036288:0@lo:400:kworker.0 00000100:00100000:2.0:1789762900.647074:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762900.647075:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762900.647111:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762900.647117:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762900.647135:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149035904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762900.647145:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149036544:0@lo:400:kworker.0 00000100:00100000:1.0:1789762900.647175:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149036288 00000100:00100000:2.0:1789762900.647177:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762900.647182:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149035776 00000100:00100000:1.0:1789762900.647184:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149036288 00000100:00100000:0.0:1789762900.647185:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762900.647189:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149035776 00000100:00100000:2.0:1789762900.647212:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149036416:0@lo:400:kworker.0 00000100:00100000:0.0:1789762900.647232:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149036032 00000100:00100000:0.0:1789762900.647237:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149036032 00000100:00100000:3.0:1789762900.647237:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789762900.647245:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762900.647249:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149036544 00000100:00100000:3.0:1789762900.647253:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149035776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762900.647265:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149036544 00000100:00100000:0.0:1789762900.647281:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149036160 00000100:00100000:2.0:1789762900.647285:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149036416 00000100:00100000:0.0:1789762900.647287:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149036160 00000100:00100000:2.0:1789762900.647290:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149036416 00000100:00100000:1.0:1789762900.647315:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789762900.647315:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149035776:12345-0@lo:400:kworker.0 Request processed in 64us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762900.647323:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789762900.647331:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789762900.647334:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149036288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762900.647335:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789762900.647337:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149036032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762900.647349:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149036160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762900.647385:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789762900.647394:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149036544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762900.647407:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149036288:12345-0@lo:400:kworker.0 Request processed in 78us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762900.647417:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789762900.647422:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149036032:12345-0@lo:400:kworker.0 Request processed in 90us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762900.647429:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149036160:12345-0@lo:400:kworker.0 Request processed in 81us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762900.647432:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789762900.647438:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149036544:12345-0@lo:400:kworker.0 Request processed in 44us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762900.647454:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789762900.647455:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789762900.647465:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789762900.647469:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967792 gen 2 00000100:00100000:0.0:1789762900.647470:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149036416:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1789762900.647479:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d16ffe1880, transno 4294967792 00000100:00080000:3.0:1789762900.647483:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762900.647489:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762900.647492:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762900.647498:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149036288:0@lo:400:kworker.0 00000100:00100000:3.0:1789762900.647509:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149035904 00000100:00100000:0.0:1789762900.647511:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149036416:12345-0@lo:400:kworker.0 Request processed in 45us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762900.647514:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149035904 00000100:00100000:0.0:1789762900.647519:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789762900.647556:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149036544:0@lo:400:kworker.0 00000100:00100000:3.0:1789762900.647563:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789762900.647571:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149036032:0@lo:400:kworker.0 00000100:00100000:3.0:1789762900.647582:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149035904:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762900.647584:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149036160:0@lo:400:kworker.0 00002000:00000024:3.0:1789762900.647608:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 13631488 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762900.647637:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149035904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762900.647645:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789762900.647706:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149036416:0@lo:400:kworker.0 00000100:00100000:3.0:1789762900.647717:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149035776:0@lo:400:kworker.0 00000100:00100000:3.0:1789762900.647731:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149035904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762900.852656:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762900.852710:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762900.852751:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762900.852757:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140791040 00000100:00100000:1.0:1789762900.852770:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140791040 00000100:00100000:0.0:1789762900.852771:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140791296 00000100:00100000:0.0:1789762900.852778:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140791296 00000100:00100000:3.0:1789762900.852809:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140791168 00000100:00100000:3.0:1789762900.852816:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140791168 00000100:00080000:2.0:1789762900.852827:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789762900.852861:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762900.852877:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:1.0:1789762900.852883:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 291 00000100:00100000:0.0:1789762900.852893:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140791296:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762900.852901:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140791040:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762900.852903:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:3.0:1789762900.852920:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140791168:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762900.852963:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140791296:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 75us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762900.852966:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140791040:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 71us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762900.852969:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140791168:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 51us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762900.852979:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:1.0:1789762900.852990:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 291 00000100:00100000:3.0:1789762900.852991:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:3.0:1789762900.854913:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762900.854936:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762900.854951:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140791552 00000100:00100000:2.0:1789762900.854956:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140791552 00000100:00100000:1.0:1789762900.854988:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140791424 00000100:00080000:3.0:1789762900.854990:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762900.854996:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140791424 00000100:00100000:2.0:1789762900.855000:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:2.0:1789762900.855012:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140791552:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:3.0:1789762900.855033:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762900.855049:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140791552:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 41us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762900.855054:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:1.0:1789762900.855064:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:1.0:1789762900.855076:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2341:x1876702140791424:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:1.0:1789762900.855099:0:8803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd08452c77c56fe54 00000100:00080000:1.0:1789762900.855108:0:8803:0:(import.c:65:import_set_state_nolock()) ffff95d14722e800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789762900.855142:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789762900.855149:0:8803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967380 00000100:00100000:1.0:1789762900.855380:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+2:2341:x1876702140791424:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 305us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762900.855409:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 129 00010000:00010000:0.0:1789762901.030957:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762901.159009:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789762901.159029:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149036672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762901.159087:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762901.159138:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149036672 00000100:00100000:0.0:1789762901.159148:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149036672 00000100:00100000:0.0:1789762901.159199:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789762901.159210:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149036672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762901.159246:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526712832 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762901.159300:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149036672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762901.159324:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789762901.159371:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149036672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762902.054974:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789762902.703762:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:1.0:1789762902.703768:0:7606:0:(genops.c:885:class_export_put()) final put ffff95d147228000/77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:3.0:1789762902.703803:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d147228000/77777931-b235-4c03-82d2-4b1d12553008 for lustre-OST0001 00000020:00000080:3.0:1789762902.703865:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d14722e800 for lustre-OST0001 00010000:00010000:3.0:1789762903.078964:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762904.102942:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762905.127004:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762905.767015:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149037184:0@lo:400:kworker.0 00000100:00100000:1.0:1789762905.767016:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149036928:0@lo:400:kworker.0 00000100:00100000:2.0:1789762905.767016:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149036800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762905.767053:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149037056:0@lo:400:kworker.0 00000100:00100000:3.0:1789762905.767099:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762905.767112:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762905.767112:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762905.767162:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789762905.767170:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149037312:0@lo:400:kworker.0 00000100:00100000:1.0:1789762905.767177:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149037440:0@lo:400:kworker.0 00000100:00100000:3.0:1789762905.767203:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762905.767204:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149036928 00000100:00100000:2.0:1789762905.767211:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149036928 00000100:00100000:1.0:1789762905.767219:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762905.767247:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149036800 00000100:00100000:3.0:1789762905.767252:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149036800 00000100:00100000:2.0:1789762905.767260:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789762905.767268:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149037184 00000100:00100000:2.0:1789762905.767273:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149036928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762905.767275:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149037184 00000100:00100000:3.0:1789762905.767304:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789762905.767314:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149036800:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762905.767322:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149037440 00000100:00100000:0.0:1789762905.767329:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149037440 00000100:00100000:2.0:1789762905.767330:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149036928:12345-0@lo:400:kworker.0 Request processed in 59us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762905.767332:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00002000:00000024:3.0:1789762905.767341:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762905.767345:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789762905.767351:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149037184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762905.767378:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1789762905.767392:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762905.767393:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149037440:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789762905.767397:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762905.767406:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149037184:12345-0@lo:400:kworker.0 Request processed in 61us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762905.767417:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789762905.767427:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149037312 00000100:00100000:2.0:1789762905.767432:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149037312 00000100:00100000:0.0:1789762905.767460:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149037440:12345-0@lo:400:kworker.0 Request processed in 69us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762905.767469:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149037440:0@lo:400:kworker.0 00000100:00100000:0.0:1789762905.767475:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789762905.767476:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789762905.767484:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149036928:0@lo:400:kworker.0 00000100:00100000:2.0:1789762905.767491:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149037312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762905.767517:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762905.767529:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149037312:12345-0@lo:400:kworker.0 Request processed in 42us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762905.767536:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149037056 00000100:00100000:2.0:1789762905.767537:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789762905.767542:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149037056 00000100:00100000:0.0:1789762905.767552:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149037568:0@lo:400:kworker.0 00000100:00100000:3.0:1789762905.767560:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149036800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 248us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762905.767578:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789762905.767587:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149037056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762905.767594:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762905.767636:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789762905.767649:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149037056:12345-0@lo:400:kworker.0 Request processed in 62us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762905.767656:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789762905.767675:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149037568 00000100:00100000:2.0:1789762905.767680:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149037568 00000100:00100000:3.0:1789762905.767687:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149037312:0@lo:400:kworker.0 00000100:00100000:1.0:1789762905.767707:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149036800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762905.767710:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149037056:0@lo:400:kworker.0 00000100:00100000:3.0:1789762905.767712:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149037184:0@lo:400:kworker.0 00000100:00100000:2.0:1789762905.767714:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789762905.767729:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149037568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762905.767780:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149037568:12345-0@lo:400:kworker.0 Request processed in 54us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762905.767786:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789762905.767808:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149037568:0@lo:400:kworker.0 00000100:00080000:2.0:1789762905.767811:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762905.972299:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762905.972330:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762905.972359:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762905.972396:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140791680 00000100:00100000:3.0:1789762905.972401:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762905.972404:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140791808 00000100:00100000:1.0:1789762905.972407:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140791680 00000100:00100000:0.0:1789762905.972412:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140791808 00000100:00100000:2.0:1789762905.972414:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140791936 00000100:00100000:2.0:1789762905.972428:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140791936 00000100:00100000:3.0:1789762905.972433:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140792064 00000100:00100000:3.0:1789762905.972439:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140792064 00000100:00100000:1.0:1789762905.972472:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 293 00000100:00100000:2.0:1789762905.972483:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:1.0:1789762905.972490:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140791680:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762905.972491:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:2.0:1789762905.972499:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140791936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762905.972505:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:0.0:1789762905.972511:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140791808:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762905.972520:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140792064:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762905.972562:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140791680:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762905.972564:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140791936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762905.972572:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140791808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 64us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762905.972576:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140792064:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 58us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762905.972584:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 293 00000100:00100000:2.0:1789762905.972585:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:0.0:1789762905.972595:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:3.0:1789762905.972604:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00080000:3.0:1789762905.972675:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762905.972680:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789762906.150948:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762906.278981:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789762906.279002:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149037696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762906.279061:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762906.279099:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149037696 00000100:00100000:0.0:1789762906.279108:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149037696 00000100:00100000:0.0:1789762906.279164:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789762906.279173:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149037696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762906.279203:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526712832 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762906.279247:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149037696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762906.279253:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789762906.279289:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149037696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762907.174943:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762908.198961:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762909.222938:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762910.246984:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762910.887005:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149037824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762910.887009:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149038080:0@lo:400:kworker.0 00000100:00100000:2.0:1789762910.887014:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149038208:0@lo:400:kworker.0 00000100:00100000:1.0:1789762910.887086:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762910.887090:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762910.887094:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149037952:0@lo:400:kworker.0 00000100:00100000:3.0:1789762910.887146:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149037824 00000100:00100000:3.0:1789762910.887154:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149037824 00000100:00100000:0.0:1789762910.887162:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762910.887169:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149038464:0@lo:400:kworker.0 00000100:00100000:2.0:1789762910.887186:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149038208 00000100:00100000:2.0:1789762910.887192:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149038208 00000100:00100000:1.0:1789762910.887212:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762910.887217:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149038336:0@lo:400:kworker.0 00000100:00100000:3.0:1789762910.887219:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789762910.887234:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149037824:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762910.887241:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762910.887248:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149038592:0@lo:400:kworker.0 00000100:00100000:2.0:1789762910.887255:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149038464 00000100:00100000:2.0:1789762910.887259:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149038464 00000100:00100000:0.0:1789762910.887265:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789762910.887267:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762910.887292:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789762910.887300:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789762910.887304:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149038208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762910.887315:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149038464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762910.887321:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149037824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762910.887329:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789762910.887332:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149037952 00000100:00100000:0.0:1789762910.887339:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149037952 00000100:00100000:2.0:1789762910.887357:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149038208:12345-0@lo:400:kworker.0 Request processed in 56us (272us total) trans 0 rc 0/0 00000100:00080000:3.0:1789762910.887365:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762910.887369:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:3.0:1789762910.887372:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762910.887377:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149038464:12345-0@lo:400:kworker.0 Request processed in 56us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762910.887387:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789762910.887391:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789762910.887398:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762910.887409:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149037952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762910.887411:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149038080 00000100:00100000:1.0:1789762910.887416:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149038080 00000100:00100000:2.0:1789762910.887421:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149038208:0@lo:400:kworker.0 00000100:00100000:3.0:1789762910.887464:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149038336 00000100:00100000:1.0:1789762910.887468:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789762910.887471:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149038336 00000100:00100000:0.0:1789762910.887474:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149037952:12345-0@lo:400:kworker.0 Request processed in 71us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762910.887481:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149038080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762910.887491:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789762910.887501:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762910.887515:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149038592 00000100:00100000:3.0:1789762910.887519:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149038592 00000100:00100000:1.0:1789762910.887538:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149038080:12345-0@lo:400:kworker.0 Request processed in 59us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762910.887543:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149038464:0@lo:400:kworker.0 00000100:00100000:1.0:1789762910.887552:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789762910.887554:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149037952:0@lo:400:kworker.0 00000100:00100000:3.0:1789762910.887559:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789762910.887570:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149037824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762910.887577:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149038336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762910.887611:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789762910.887631:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149038592:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789762910.887652:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762910.887658:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149038336:12345-0@lo:400:kworker.0 Request processed in 87us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762910.887670:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149038080:0@lo:400:kworker.0 00000100:00100000:3.0:1789762910.887677:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789762910.887713:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149038592:12345-0@lo:400:kworker.0 Request processed in 83us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762910.887723:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789762910.887728:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149038336:0@lo:400:kworker.0 00000100:00100000:2.0:1789762910.887741:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149038592:0@lo:400:kworker.0 00000100:00100000:2.0:1789762911.092362:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762911.092394:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762911.092415:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762911.092444:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762911.092460:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140792320 00000100:00100000:3.0:1789762911.092460:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140792192 00000100:00100000:1.0:1789762911.092467:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140792448 00000100:00100000:0.0:1789762911.092472:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140792320 00000100:00100000:3.0:1789762911.092472:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140792192 00000100:00100000:2.0:1789762911.092473:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140792576 00000100:00100000:1.0:1789762911.092474:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140792448 00000100:00100000:2.0:1789762911.092481:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140792576 00000100:00100000:3.0:1789762911.092530:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 295 00000100:00100000:3.0:1789762911.092543:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140792192:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762911.092550:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:0.0:1789762911.092552:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:2.0:1789762911.092561:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:1.0:1789762911.092572:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140792448:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762911.092573:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140792320:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762911.092573:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140792576:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762911.092628:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140792192:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762911.092638:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 295 00000100:00100000:2.0:1789762911.092641:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140792576:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 69us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762911.092645:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140792448:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762911.092653:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:1.0:1789762911.092658:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:0.0:1789762911.092665:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140792320:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 100us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762911.092676:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00080000:2.0:1789762911.092680:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789762911.092692:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789762911.271033:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762911.399037:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16ffe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149038720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762911.399110:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762911.399159:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149038720 00000100:00100000:0.0:1789762911.399169:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149038720 00000100:00100000:0.0:1789762911.399241:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789762911.399252:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149038720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762911.399287:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526712832 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762911.399343:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149038720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762911.399351:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789762911.399388:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16ffe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149038720:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762912.295040:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762913.155447:0:14614:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.31@tcp 00000100:00100000:1.0:1789762913.155468:0:14614:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:1.0:1789762913.155477:0:14614:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:1.0:1789762913.155486:0:14614:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.31@tcp 00000100:00100000:1.0:1789762913.155494:0:14614:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:1.0:1789762913.155498:0:14614:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d17b1a3d00 rate 20 gen 0 00000100:00100000:1.0:1789762913.155502:0:14614:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:1.0:1789762913.155506:0:14614:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.31@tcp 00000100:00100000:1.0:1789762913.155516:0:14614:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:1.0:1789762913.155519:0:14614:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d17b1a3f00 rate 20 gen 0 00000100:00100000:0.0:1789762913.166451:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.166490:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140792704 00000100:00100000:2.0:1789762913.166500:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140792704 00000100:00080000:0.0:1789762913.166531:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762913.166558:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 228 00000100:00100000:2.0:1789762913.166583:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+5:13367:x1876702140792704:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:2.0:1789762913.166599:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762913.166618:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894c00/0xd08452c77c570665 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9d3 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.166669:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894200/0xd08452c77c57066c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.166681:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894200/0xd08452c77c57066c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.166691:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894200/0xd08452c77c57066c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762913.166719:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762913.166722:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762913.166735:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894200/0xd08452c77c57066c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.166752:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894c00/0xd08452c77c570665 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9d3 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.166765:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894200/0xd08452c77c57066c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9d3 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.166778:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:2.0:1789762913.166781:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762913.166784:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a894200, rc 0) 00000100:00100000:2.0:1789762913.166854:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+6:13367:x1876702140792704:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 268us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762913.166860:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 228 00000100:00100000:0.0:1789762913.168488:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.168529:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.168548:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140792832 00000100:00100000:2.0:1789762913.168556:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140792832 00000100:00100000:1.0:1789762913.168580:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140793088 00000100:00100000:1.0:1789762913.168590:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140793088 00000100:00100000:2.0:1789762913.168608:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:2.0:1789762913.168620:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+7:2345:x1876702140792832:12345-192.168.203.31@tcp:41:mkdir.0 00000100:00100000:1.0:1789762913.168644:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 230 00000004:00000024:2.0:1789762913.168649:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261254144 avail 2259156992 00000100:00100000:1.0:1789762913.168659:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+7:13367:x1876702140793088:12345-192.168.203.31@tcp:36:mkdir.0 00000100:00100000:2.0:1789762913.168691:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+7:2345:x1876702140792832:12345-192.168.203.31@tcp:41:mkdir.0 Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762913.168700:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 229 00010000:00010000:1.0:1789762913.168713:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762913.168748:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894200/0xd08452c77c57066c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9d3 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.168768:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:1.0:1789762913.168781:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762913.169085:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570673 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.169096:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570673 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.169104:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570673 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.169121:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c57067a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.169130:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c57067a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.169140:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c57067a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762913.170410:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00010000:1.0:1789762913.170422:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570673 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.170438:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570673 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.170443:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570673 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.170449:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882f000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762913.170453:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570673 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.170459:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570673 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.170471:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2c00) 00010000:00010000:1.0:1789762913.170473:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762913.170476:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570673 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.170481:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570673 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762913.170493:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cea8abca reply state 00000000ddf160f5 transno 4294967488 ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c57067a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762913.170499:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762913.170580:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+7:13367:x1876702140793088:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 1916us (2038us total) trans 4294967488 rc 0/0 00000100:00100000:1.0:1789762913.170587:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 230 00010000:00010000:1.0:1789762913.171008:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c57067a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.171025:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c57067a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.171030:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c57067a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.171033:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882f400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762913.171036:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c57067a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.171041:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c57067a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.171050:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d14abf2e00) 00010000:00010000:1.0:1789762913.171052:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762913.171054:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c57067a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.171058:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c57067a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762913.176731:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.176766:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140793216 00000100:00100000:1.0:1789762913.176771:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140793216 00000100:00100000:1.0:1789762913.176808:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:1.0:1789762913.176819:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+6:13368:x1876702140793216:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789762913.176858:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762913.176874:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570681 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9da expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.176938:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882e400/0xd08452c77c570688 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.176950:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882e400/0xd08452c77c570688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.176960:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882e400/0xd08452c77c570688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762913.176982:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789762913.176985:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762913.176999:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882e400/0xd08452c77c570688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.177019:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9da expref: 8 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.177037:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882e400/0xd08452c77c570688 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9da expref: 7 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.177043:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2c00) 00010000:00010000:1.0:1789762913.177045:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762913.177048:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d14882e400, rc 0) 00000100:00100000:1.0:1789762913.177077:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+7:13368:x1876702140793216:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 263us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762913.177084:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:0.0:1789762913.178084:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.178125:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140793472 00000100:00100000:3.0:1789762913.178134:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140793472 00000100:00100000:3.0:1789762913.178186:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 232 00000100:00100000:3.0:1789762913.178199:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+7:13368:x1876702140793472:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762913.178212:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762913.178215:0:13232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789762913.178235:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882e400/0xd08452c77c570688 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9da expref: 7 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178250:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2c00) 00010000:00010000:3.0:1789762913.178259:0:13232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762913.178274:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57068f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9e1 expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178390:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570696 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178407:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178413:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178423:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57069d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178428:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57069d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178432:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57069d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178479:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c5706a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178485:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c5706a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178490:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c5706a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762913.178497:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00010000:3.0:1789762913.178505:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c5706a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178510:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c5706a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178514:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c5706a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178528:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762913.178532:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c5706a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178540:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c5706a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178550:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d15055db00) 00010000:00010000:3.0:1789762913.178553:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762913.178557:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c5706a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178564:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c5706a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178595:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178600:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570696 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178604:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570696 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178608:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762913.178609:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570696 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178614:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570696 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178629:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d400) 00010000:00010000:3.0:1789762913.178630:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762913.178633:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570696 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178637:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570696 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178644:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57069d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178647:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57069d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178651:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57069d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178655:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762913.178657:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57069d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178661:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57069d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178666:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055dd00) 00010000:00010000:3.0:1789762913.178668:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762913.178670:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57069d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178673:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57069d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178703:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57068f lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9e1 expref: 7 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178709:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d400) 00010000:00010000:3.0:1789762913.178711:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762913.178714:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57068f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9e1 expref: 7 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.178721:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003f800, rc 0) 00000100:00100000:3.0:1789762913.178757:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+6:13368:x1876702140793472:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 562us (673us total) trans 0 rc 301/301 00000100:00100000:3.0:1789762913.178762:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 232 00000100:00100000:2.0:1789762913.179583:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.179630:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140793600 00000100:00100000:3.0:1789762913.179636:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140793600 00000100:00100000:3.0:1789762913.179668:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:3.0:1789762913.179682:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+6:13368:x1876702140793600:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762913.179690:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762913.179699:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c5706ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9e8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.179729:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e800/0xd08452c77c5706b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.179736:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e800/0xd08452c77c5706b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.179743:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e800/0xd08452c77c5706b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762913.179767:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789762913.179769:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762913.179782:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e800/0xd08452c77c5706b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.179798:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c5706ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9e8 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.179812:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e800/0xd08452c77c5706b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9e8 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.179819:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055da00) 00010000:00010000:3.0:1789762913.179822:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762913.179824:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003e800, rc 0) 00000100:00100000:3.0:1789762913.179896:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+7:13368:x1876702140793600:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 217us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762913.179908:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:2.0:1789762913.180787:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.180818:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140793856 00000100:00100000:3.0:1789762913.180823:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140793856 00000100:00100000:3.0:1789762913.180896:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:3.0:1789762913.180909:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+7:13368:x1876702140793856:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762913.180917:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762913.180924:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c5706b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9ef expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.180950:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5706c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.180970:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5706c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.180980:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5706c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.180995:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5706c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181008:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5706c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181018:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5706c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762913.181063:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00010000:3.0:1789762913.181129:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5706c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181134:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5706c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181138:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5706c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181142:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fe00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762913.181144:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5706c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181148:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5706c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181164:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055da00) 00010000:00010000:3.0:1789762913.181166:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762913.181168:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5706c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181172:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5706c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181179:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5706c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181183:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5706c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181187:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5706c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181191:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fc00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762913.181194:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5706c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181198:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5706c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181203:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055d200) 00010000:00010000:3.0:1789762913.181205:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762913.181207:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5706c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181211:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5706c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181241:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c5706b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9ef expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181247:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055da00) 00010000:00010000:3.0:1789762913.181249:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762913.181251:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c5706b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9ef expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.181257:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003fa00, rc 0) 00000100:00100000:3.0:1789762913.181288:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+8:13368:x1876702140793856:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 386us (501us total) trans 4294967489 rc 301/301 00000100:00100000:3.0:1789762913.181294:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:2.0:1789762913.182218:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.182273:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140794112 00000100:00100000:1.0:1789762913.182282:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140794112 00000100:00100000:1.0:1789762913.182339:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:1.0:1789762913.182351:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+8:13368:x1876702140794112:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:1.0:1789762913.182401:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c5706d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.182410:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c5706d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.182417:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c5706d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762913.182529:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da29b68c reply state 00000000da0419df transno 4294967490 ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c5706d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762913.182535:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789762913.182541:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000100:00100000:1.0:1789762913.182609:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+10:13368:x1876702140794112:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 261us (391us total) trans 4294967490 rc 0/0 00000100:00100000:1.0:1789762913.182616:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 235 00010000:00010000:3.0:1789762913.183036:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c5706d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.183044:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c5706d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.183049:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c5706d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.183053:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882f400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762913.183055:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c5706d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.183059:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c5706d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.183069:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d14abf2e00) 00010000:00010000:3.0:1789762913.183077:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789762913.183079:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c5706d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.183132:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f400/0xd08452c77c5706d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762913.183188:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.183210:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140794368 00000100:00100000:3.0:1789762913.183244:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140794368 00000100:00100000:3.0:1789762913.183275:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:3.0:1789762913.183282:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15177cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+9:13368:x1876702140794368:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1789762913.183410:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15177cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+10:13368:x1876702140794368:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 128us (222us total) trans 4294967491 rc 0/0 00000100:00100000:3.0:1789762913.183417:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:2.0:1789762913.187401:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.187439:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140794496 00000100:00100000:1.0:1789762913.187445:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140794496 00000100:00100000:1.0:1789762913.187476:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00100000:1.0:1789762913.187484:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+10:13369:x1876702140794496:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:1.0:1789762913.187495:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762913.187504:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c5706dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9f6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187533:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c5706e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187551:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c5706e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187557:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c5706e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187578:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fc00/0xd08452c77c5706ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187585:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fc00/0xd08452c77c5706ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187590:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fc00/0xd08452c77c5706ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187647:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882ea00/0xd08452c77c5706f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187653:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882ea00/0xd08452c77c5706f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187658:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882ea00/0xd08452c77c5706f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762913.187673:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:1.0:1789762913.187676:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762913.187687:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882ea00/0xd08452c77c5706f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187694:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c5706e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187706:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c5706e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187711:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c5706e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187715:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882fe00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762913.187718:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c5706e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187724:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c5706e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187732:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055da00) 00010000:00010000:1.0:1789762913.187735:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762913.187737:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c5706e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187741:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c5706e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187749:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fc00/0xd08452c77c5706ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187753:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fc00/0xd08452c77c5706ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187757:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fc00/0xd08452c77c5706ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187760:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14882fc00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762913.187767:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fc00/0xd08452c77c5706ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187771:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fc00/0xd08452c77c5706ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187777:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d14abf2500) 00010000:00010000:1.0:1789762913.187780:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762913.187781:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fc00/0xd08452c77c5706ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187785:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fc00/0xd08452c77c5706ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187805:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c5706dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9f6 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187815:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882ea00/0xd08452c77c5706f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9f6 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.187819:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:1.0:1789762913.187821:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762913.187822:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d14882ea00, rc 0) 00000100:00100000:1.0:1789762913.187902:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+11:13369:x1876702140794496:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 418us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762913.187912:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00100000:2.0:1789762913.188975:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.189041:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140794752 00000100:00100000:2.0:1789762913.189046:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140794752 00000100:00100000:2.0:1789762913.189089:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 237 00000100:00100000:2.0:1789762913.189102:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+11:13369:x1876702140794752:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:2.0:1789762913.189142:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762913.189158:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882ea00/0xd08452c77c5706f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9f6 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.189171:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:2.0:1789762913.189177:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762913.189190:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895200/0xd08452c77c5706f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.189197:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895200/0xd08452c77c5706f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.189204:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895200/0xd08452c77c5706f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762913.189328:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b42062c reply state 000000006b461437 transno 4294967492 ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895200/0xd08452c77c5706f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762913.189335:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762913.189340:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000100:00100000:2.0:1789762913.189383:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+12:13369:x1876702140794752:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 287us (416us total) trans 4294967492 rc 0/0 00000100:00100000:2.0:1789762913.189390:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 237 00010000:00010000:3.0:1789762913.189885:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895200/0xd08452c77c5706f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.189892:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895200/0xd08452c77c5706f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.189897:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895200/0xd08452c77c5706f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.189902:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762913.189905:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895200/0xd08452c77c5706f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.189910:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895200/0xd08452c77c5706f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.189917:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d142a04c00) 00010000:00010000:3.0:1789762913.189925:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789762913.189928:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895200/0xd08452c77c5706f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.189933:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895200/0xd08452c77c5706f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762913.204383:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.204457:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140794880 00000100:00100000:3.0:1789762913.204465:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140794880 00000100:00100000:3.0:1789762913.204507:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 238 00000100:00100000:3.0:1789762913.204517:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+11:13373:x1876702140794880:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:3.0:1789762913.204539:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762913.204557:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c5706ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7e9fd expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204633:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570706 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204645:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570706 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204653:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570706 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204667:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c57070d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204673:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c57070d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204678:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c57070d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204789:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c570714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204795:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c570714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204803:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c570714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762913.204823:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:3.0:1789762913.204826:0:13232:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762913.204881:0:13232:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c570714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204889:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570706 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204894:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570706 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204900:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570706 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204904:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fc00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762913.204907:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570706 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204912:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570706 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204925:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055da00) 00010000:00010000:3.0:1789762913.204934:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762913.204939:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570706 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204945:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204958:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c57070d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204965:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c57070d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204975:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c57070d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204984:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fe00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762913.204988:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c57070d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.204997:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c57070d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.205008:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055d200) 00010000:00010000:3.0:1789762913.205012:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762913.205017:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c57070d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.205023:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c57070d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.205057:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c5706ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9fd expref: 13 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.205099:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c570714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9fd expref: 12 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.205109:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d15055d400) 00010000:00010000:3.0:1789762913.205112:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789762913.205116:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003e400, rc 0) 00000100:00100000:3.0:1789762913.205166:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+12:13373:x1876702140794880:12345-192.168.203.31@tcp:101:dd.500 Request processed in 650us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762913.205176:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 238 00000100:00100000:2.0:1789762913.206397:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.206436:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140795136 00000100:00100000:3.0:1789762913.206444:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140795136 00000100:00100000:3.0:1789762913.206503:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 239 00000100:00100000:3.0:1789762913.206517:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+12:13373:x1876702140795136:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:3.0:1789762913.206528:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762913.206545:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57071b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea04 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.206658:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570722 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.206667:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570722 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.206675:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570722 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.206687:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570729 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.206698:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.206705:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762913.207489:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf:0x0], index 0: 0 00000004:00080000:3.0:1789762913.207506:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa:0x0], index 1: 0 00010000:00010000:3.0:1789762913.207721:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c570730 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.207729:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c570730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.207736:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c570730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.207760:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570722 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.207764:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570722 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.207769:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570722 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.207773:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762913.207777:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570722 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.207783:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570722 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.207800:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d15055d400) 00010000:00010000:3.0:1789762913.207803:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762913.207806:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570722 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.207810:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570722 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762913.207821:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017fc624f reply state 000000005093d794 transno 4294967493 ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762913.207827:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789762913.208029:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57071b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea04 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.208050:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c570730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea04 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.208057:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff95d15055db00) 00010000:00010000:3.0:1789762913.208060:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762913.208063:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003f600, rc 0) 00000100:00100000:3.0:1789762913.208117:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+15:13373:x1876702140795136:12345-192.168.203.31@tcp:101:dd.500 Request processed in 1604us (1722us total) trans 4294967493 rc 0/0 00000100:00100000:3.0:1789762913.208125:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 239 00010000:00010000:3.0:1789762913.208751:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.208758:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570729 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.208769:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570729 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.208777:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762913.208780:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570729 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.208787:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570729 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.208802:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xf4d4877e (ffff95d15055dd00) 00010000:00010000:3.0:1789762913.208804:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762913.208806:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570729 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.208810:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570729 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762913.211209:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.211277:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140795264 00000100:00100000:0.0:1789762913.211283:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140795264 00000100:00080000:2.0:1789762913.211331:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762913.211337:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:0.0:1789762913.211349:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:13373:x1876702140795264:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762913.211359:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762913.211372:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c57073e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea0b expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762913.211389:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789762913.211401:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=317s v=(0 0) 00010000:00010000:0.0:1789762913.211410:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762913.211417:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c57073e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea0b expref: 6 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762913.211429:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c57073e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea0b expref: 6 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762913.211436:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d174638a00, rc 0) 00000100:00100000:0.0:1789762913.211464:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+6:13373:x1876702140795264:12345-192.168.203.31@tcp:101:dd.500 Request processed in 119us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762913.211469:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:2.0:1789762913.221565:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.221622:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140795392 00000100:00100000:0.0:1789762913.221628:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140795392 00002000:00100000:0.0:1789762913.221655:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xf:0x0] (0->1048575) req@ffff95d042633800 x1876702140795392/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762913.221663:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042633800 with x1876702140795392 ext(0->1048575) 00002000:00010000:0.0:1789762913.221667:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d042633800 00000100:00100000:0.0:1789762913.221681:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252291996587 time 252292040754 state 0x0 ref 1 00000100:00100000:0.0:1789762913.221691:0:11723:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x1, head sequence 6: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75a00 gen 0 rate 20 depth 3 token 0 deadline 252291996587 time 252292040754 state 0x0 ref 1 00000100:00100000:0.0:1789762913.221719:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 3 deadline 317744876705 time 317694876705 state 0x1 ref 1 00000100:00100000:0.0:1789762913.221749:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 2 deadline 317744876705 time 317694910350 state 0x0 ref 1 00000100:00100000:0.0:1789762913.221768:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140795392:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762913.227377:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140795392:12345-192.168.203.31@tcp:4:dd.500 Request processed in 5603us (5806us total) trans 4294967793 rc 0/0 00000100:00100000:1.0:1789762913.227388:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 464 00000100:00100000:1.0:1789762913.227411:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 2 deadline 317744876705 time 317694910350 state 0x2 ref 0 00002000:00100000:1.0:1789762913.227430:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xf:0x0] (0->1048575) req@ffff95d042633800 x1876702140795392/t4294967793(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.227443:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042633800 with x1876702140795392 ext(0->1048575) 00002000:00010000:1.0:1789762913.227451:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d042633800 00000100:00100000:0.0:1789762913.231390:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.231426:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140795520 00000100:00100000:3.0:1789762913.231434:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140795520 00002000:00100000:3.0:1789762913.231464:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xf:0x0] (1048576->2097151) req@ffff95d1526dfb80 x1876702140795520/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762913.231472:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dfb80 with x1876702140795520 ext(1048576->2097151) 00002000:00010000:3.0:1789762913.231476:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526dfb80 00000100:00100000:3.0:1789762913.231488:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 2 deadline 317744876705 time 317694910350 state 0x0 ref 1 00000100:00100000:3.0:1789762913.231496:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 2 deadline 317744910350 time 317694910350 state 0x1 ref 1 00000100:00100000:3.0:1789762913.231530:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 1 deadline 317744910350 time 317704690751 state 0x0 ref 1 00000100:00100000:3.0:1789762913.231544:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140795520:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:3.0:1789762913.233885:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+10:2345:x1876702140795520:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2342us (2496us total) trans 4294967794 rc 0/0 00000100:00100000:3.0:1789762913.233893:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 465 00000100:00100000:3.0:1789762913.233901:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 1 deadline 317744910350 time 317704690751 state 0x2 ref 0 00002000:00100000:3.0:1789762913.233910:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xf:0x0] (1048576->2097151) req@ffff95d1526dfb80 x1876702140795520/t4294967794(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762913.233917:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dfb80 with x1876702140795520 ext(1048576->2097151) 00002000:00010000:3.0:1789762913.233921:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526dfb80 00000100:00100000:2.0:1789762913.238686:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.238743:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140795648 00000100:00100000:1.0:1789762913.238754:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140795648 00002000:00100000:1.0:1789762913.238794:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (2097152->3145727) req@ffff95d174124000 x1876702140795648/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.238803:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174124000 with x1876702140795648 ext(2097152->3145727) 00002000:00010000:1.0:1789762913.238808:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d174124000 00000100:00100000:1.0:1789762913.238821:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 1 deadline 317744910350 time 317704690751 state 0x0 ref 1 00000100:00100000:1.0:1789762913.238863:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 1 deadline 317754690751 time 317704690751 state 0x1 ref 1 00000100:00100000:1.0:1789762913.238903:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317754690751 time 317712062747 state 0x0 ref 1 00000100:00100000:1.0:1789762913.238921:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+10:2344:x1876702140795648:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762913.241180:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+12:2344:x1876702140795648:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2262us (2494us total) trans 4294967795 rc 0/0 00000100:00100000:1.0:1789762913.241187:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 466 00000100:00100000:1.0:1789762913.241194:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317754690751 time 317712062747 state 0x2 ref 0 00002000:00100000:1.0:1789762913.241214:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (2097152->3145727) req@ffff95d174124000 x1876702140795648/t4294967795(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.241221:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174124000 with x1876702140795648 ext(2097152->3145727) 00002000:00010000:1.0:1789762913.241225:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d174124000 00000100:00100000:0.0:1789762913.246141:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.246288:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140795776 00000100:00100000:2.0:1789762913.246299:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140795776 00002000:00100000:2.0:1789762913.246359:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xf:0x0] (3145728->4194303) req@ffff95d1526df100 x1876702140795776/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762913.246372:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526df100 with x1876702140795776 ext(3145728->4194303) 00002000:00010000:2.0:1789762913.246378:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526df100 00000100:00100000:2.0:1789762913.246399:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317754690751 time 317712062747 state 0x0 ref 1 00000100:00100000:2.0:1789762913.246416:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317762062747 time 317712062747 state 0x1 ref 1 00000100:00100000:2.0:1789762913.247060:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.247114:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140795904 00000100:00100000:1.0:1789762913.247128:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140795904 00000100:00100000:1.0:1789762913.247186:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:1.0:1789762913.247196:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1876702140795904:12345-192.168.203.31@tcp:8:dd.500 00010000:00080000:1.0:1789762913.247236:0:6656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:1.0:1789762913.247288:0:6656:0:(genops.c:1385:class_connect()) connect: client 77777931-b235-4c03-82d2-4b1d12553008, cookie 0xd08452c77c570745 00002000:00100000:1.0:1789762913.247304:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 77777931-b235-4c03-82d2-4b1d12553008/ffff95d042aa0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 30670848 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789762913.247342:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789762913.247612:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789762913.247645:0:6656:0:(import.c:65:import_set_state_nolock()) ffff95d042aa0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789762913.247708:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2341:x1876702140795904:12345-192.168.203.31@tcp:8:dd.500 Request processed in 513us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762913.247717:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:0.0:1789762913.248537:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.248590:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140796032 00000100:00100000:2.0:1789762913.248598:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140796032 00000100:00080000:0.0:1789762913.248644:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762913.248649:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:2.0:1789762913.248659:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+6:13373:x1876702140796032:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:2.0:1789762913.248671:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762913.248687:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aa888c6/0xd08452c77c57074c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea12 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762913.248708:0:10283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789762913.248722:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=317s v=(0 0) 00010000:00010000:2.0:1789762913.248726:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762913.248733:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aa888c6/0xd08452c77c57074c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea12 expref: 7 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.248745:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000aa888c6/0xd08452c77c57074c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea12 expref: 7 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.248765:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a895c00, rc 0) 00000100:00100000:2.0:1789762913.248807:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+7:13373:x1876702140796032:12345-192.168.203.31@tcp:101:dd.500 Request processed in 151us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762913.248813:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:0.0:1789762913.255984:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.256041:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140796160 00000100:00100000:2.0:1789762913.256048:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140796160 00002000:00100000:2.0:1789762913.256082:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xa:0x0] (0->1048575) req@ffff95d1526dce00 x1876702140796160/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762913.256094:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dce00 with x1876702140796160 ext(0->1048575) 00002000:00010000:2.0:1789762913.256099:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526dce00 00000100:00100000:2.0:1789762913.256116:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317762062747 time 317712062747 state 0x1 ref 2 00000100:00100000:0.0:1789762913.262201:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.262257:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140796288 00000100:00100000:1.0:1789762913.262264:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140796288 00002000:00100000:1.0:1789762913.262295:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa:0x0] (1048576->2097151) req@ffff95d1526dc380 x1876702140796288/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.262304:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dc380 with x1876702140796288 ext(1048576->2097151) 00002000:00010000:1.0:1789762913.262309:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526dc380 00000100:00100000:1.0:1789762913.262323:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317762062747 time 317712062747 state 0x1 ref 3 00000100:00100000:2.0:1789762913.288971:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317812125490 time 317762125490 state 0x1 ref 3 00000100:00100000:2.0:1789762913.288987:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140795776:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:3.0:1789762913.291743:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+14:2345:x1876702140795776:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2758us (45608us total) trans 4294967796 rc 0/0 00000100:00100000:3.0:1789762913.291752:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 467 00002000:00100000:3.0:1789762913.291760:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xf:0x0] (3145728->4194303) req@ffff95d1526df100 x1876702140795776/t4294967796(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762913.291768:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526df100 with x1876702140795776 ext(3145728->4194303) 00002000:00010000:3.0:1789762913.291773:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526df100 00010000:00010000:0.0:1789762913.319110:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762913.339120:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317862263332 time 317812263332 state 0x1 ref 2 00000100:00100000:1.0:1789762913.339154:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140796160:12345-192.168.203.31@tcp:4:dd.500 00000001:00100000:1.0:1789762913.354324:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000001:00080000:1.0:1789762913.366635:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967381 is committed 00000100:00100000:0.0:1789762913.366689:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+7:2345:x1876702140796160:12345-192.168.203.31@tcp:4:dd.500 Request processed in 27545us (110701us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1789762913.366701:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 468 00002000:00100000:0.0:1789762913.366713:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xa:0x0] (0->1048575) req@ffff95d1526dce00 x1876702140796160/t4294967381(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762913.366721:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dce00 with x1876702140796160 ext(0->1048575) 00002000:00010000:0.0:1789762913.366726:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526dce00 00000100:00100000:2.0:1789762913.368885:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.368939:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140796416 00000100:00100000:0.0:1789762913.368947:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140796416 00002000:00100000:0.0:1789762913.368978:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xa:0x0] (2097152->3145727) req@ffff95d174124a80 x1876702140796416/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762913.368986:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174124a80 with x1876702140796416 ext(2097152->3145727) 00002000:00010000:0.0:1789762913.368989:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174124a80 00000100:00100000:0.0:1789762913.369005:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317862263332 time 317812263332 state 0x1 ref 2 00000100:00100000:0.0:1789762913.374919:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.374981:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140796544 00000100:00100000:1.0:1789762913.374991:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140796544 00002000:00100000:1.0:1789762913.375034:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa:0x0] (3145728->4194303) req@ffff95d1526df480 x1876702140796544/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.375043:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526df480 with x1876702140796544 ext(3145728->4194303) 00002000:00010000:1.0:1789762913.375048:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526df480 00000100:00100000:1.0:1789762913.375064:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317862263332 time 317812263332 state 0x1 ref 3 00000100:00100000:2.0:1789762913.381037:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.381081:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140796672 00000100:00100000:3.0:1789762913.381088:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140796672 00002000:00100000:3.0:1789762913.381117:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xf:0x0] (4194304->5242879) req@ffff95d17463c000 x1876702140796672/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762913.381139:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463c000 with x1876702140796672 ext(4194304->5242879) 00002000:00010000:3.0:1789762913.381143:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463c000 00000100:00100000:3.0:1789762913.381156:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317862263332 time 317812263332 state 0x1 ref 4 00000100:00100000:2.0:1789762913.387099:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.387149:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140796800 00000100:00100000:0.0:1789762913.387155:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140796800 00002000:00100000:0.0:1789762913.387176:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xf:0x0] (5242880->6291455) req@ffff95d17463ea00 x1876702140796800/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762913.387184:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463ea00 with x1876702140796800 ext(5242880->6291455) 00002000:00010000:0.0:1789762913.387188:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463ea00 00000100:00100000:0.0:1789762913.387197:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317862263332 time 317812263332 state 0x1 ref 5 00000100:00100000:1.0:1789762913.389214:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317912370905 time 317862370905 state 0x1 ref 5 00000100:00100000:1.0:1789762913.389232:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140796288:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762913.392099:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+10:2345:x1876702140796288:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2870us (129896us total) trans 4294967382 rc 0/0 00000100:00100000:1.0:1789762913.392108:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 469 00002000:00100000:1.0:1789762913.392117:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa:0x0] (1048576->2097151) req@ffff95d1526dc380 x1876702140796288/t4294967382(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.392124:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dc380 with x1876702140796288 ext(1048576->2097151) 00002000:00010000:1.0:1789762913.392138:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526dc380 00000100:00100000:0.0:1789762913.393653:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.393705:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140796928 00000100:00100000:1.0:1789762913.393713:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140796928 00002000:00100000:1.0:1789762913.393737:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (6291456->7340031) req@ffff95d1526dca80 x1876702140796928/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.393747:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dca80 with x1876702140796928 ext(6291456->7340031) 00002000:00010000:1.0:1789762913.393750:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526dca80 00000100:00100000:1.0:1789762913.393761:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317912370905 time 317862370905 state 0x1 ref 5 00000100:00100000:2.0:1789762913.399739:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.399786:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140797056 00000100:00100000:0.0:1789762913.399794:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140797056 00002000:00100000:0.0:1789762913.399827:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xf:0x0] (7340032->8388607) req@ffff95d16ffe4000 x1876702140797056/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762913.399859:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe4000 with x1876702140797056 ext(7340032->8388607) 00002000:00010000:0.0:1789762913.399863:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffe4000 00000100:00100000:0.0:1789762913.399877:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317912370905 time 317862370905 state 0x1 ref 6 00000100:00100000:2.0:1789762913.406474:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.406514:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140797184 00000100:00100000:3.0:1789762913.406520:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140797184 00002000:00100000:3.0:1789762913.406542:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xa:0x0] (4194304->5242879) req@ffff95d16ffe6680 x1876702140797184/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762913.406550:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe6680 with x1876702140797184 ext(4194304->5242879) 00002000:00010000:3.0:1789762913.406553:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe6680 00000100:00100000:3.0:1789762913.406562:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317912370905 time 317862370905 state 0x1 ref 7 00000100:00100000:0.0:1789762913.414698:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.414755:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140797312 00000100:00100000:1.0:1789762913.414765:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140797312 00002000:00100000:1.0:1789762913.414803:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa:0x0] (5242880->6291455) req@ffff95d1526dc000 x1876702140797312/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.414813:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dc000 with x1876702140797312 ext(5242880->6291455) 00002000:00010000:1.0:1789762913.414817:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526dc000 00000100:00100000:1.0:1789762913.414854:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317912370905 time 317862370905 state 0x1 ref 8 00000100:00100000:0.0:1789762913.439325:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317962476173 time 317912476173 state 0x1 ref 8 00000100:00100000:0.0:1789762913.439350:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+11:2344:x1876702140796416:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762913.442204:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+13:2344:x1876702140796416:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2856us (73310us total) trans 4294967383 rc 0/0 00000100:00100000:1.0:1789762913.442215:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 470 00002000:00100000:1.0:1789762913.442230:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xa:0x0] (2097152->3145727) req@ffff95d174124a80 x1876702140796416/t4294967383(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.442240:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174124a80 with x1876702140796416 ext(2097152->3145727) 00002000:00010000:1.0:1789762913.442248:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174124a80 00000100:00100000:0.0:1789762913.444171:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.444224:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140797440 00000100:00100000:2.0:1789762913.444233:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140797440 00002000:00100000:2.0:1789762913.444267:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xa:0x0] (6291456->7340031) req@ffff95d148880a80 x1876702140797440/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762913.444286:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148880a80 with x1876702140797440 ext(6291456->7340031) 00002000:00010000:2.0:1789762913.444291:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148880a80 00000100:00100000:2.0:1789762913.444307:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317962476173 time 317912476173 state 0x1 ref 8 00000100:00100000:2.0:1789762913.450830:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.450894:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.450930:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140797824 00000100:00100000:3.0:1789762913.450937:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140797824 00000100:00100000:1.0:1789762913.450953:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140797568 00000100:00100000:1.0:1789762913.450976:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140797568 00000100:00100000:3.0:1789762913.450982:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1789762913.450995:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+14:13373:x1876702140797824:12345-192.168.203.31@tcp:35:dd.500 00002000:00100000:1.0:1789762913.451025:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa:0x0] (7340032->8388607) req@ffff95d16ffe4700 x1876702140797568/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.451035:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe4700 with x1876702140797568 ext(7340032->8388607) 00002000:00010000:1.0:1789762913.451039:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe4700 00000100:00100000:1.0:1789762913.451055:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 317962476173 time 317912476173 state 0x1 ref 9 00000100:00100000:3.0:1789762913.451278:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+15:13373:x1876702140797824:12345-192.168.203.31@tcp:35:dd.500 Request processed in 285us (381us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1789762913.451286:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:0.0:1789762913.477334:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.477382:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140798080 00000100:00100000:3.0:1789762913.477391:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140798080 00000100:00100000:3.0:1789762913.477434:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 240 00000100:00100000:3.0:1789762913.477442:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+15:13384:x1876702140798080:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762913.477463:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762913.477487:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570753 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea19 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.477594:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57075a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.477606:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57075a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.477614:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57075a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.477625:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570761 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.477630:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.477634:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762913.478013:0:6681:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb:0x0], index 1: 0 00000004:00080000:3.0:1789762913.478022:0:6681:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10:0x0], index 0: 0 00010000:00010000:3.0:1789762913.478154:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c570768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.478161:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c570768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.478167:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c570768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.478199:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57075a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.478214:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57075a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.478222:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57075a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.478227:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762913.478231:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57075a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.478237:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57075a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.478247:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d15055d400) 00010000:00010000:3.0:1789762913.478249:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762913.478252:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57075a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.478256:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c57075a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762913.478265:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5ab74c5 reply state 00000000e46d0c51 transno 4294967495 ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762913.478271:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789762913.478291:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e000/0xd08452c77c570753 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea19 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.478301:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c570768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea19 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.478315:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff95d15055dd00) 00010000:00010000:3.0:1789762913.478317:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762913.478319:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003fa00, rc 0) 00000100:00100000:3.0:1789762913.478379:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+18:13384:x1876702140798080:12345-192.168.203.31@tcp:101:dd.0 Request processed in 937us (1052us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1789762913.478384:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 240 00010000:00010000:3.0:1789762913.478985:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.478995:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570761 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.479002:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570761 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.479008:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762913.479012:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570761 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.479020:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570761 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.479029:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x636661f9 (ffff95d15055d200) 00010000:00010000:3.0:1789762913.479031:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762913.479033:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570761 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.479037:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570761 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762913.483103:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.483150:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140798208 00000100:00100000:2.0:1789762913.483157:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140798208 00000100:00100000:2.0:1789762913.483205:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:2.0:1789762913.483216:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+15:13387:x1876702140798208:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789762913.483230:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762913.483247:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063e66ef4/0xd08452c77c570776 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea20 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762913.483266:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789762913.483283:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=317s v=(0 0) 00010000:00010000:2.0:1789762913.483287:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762913.483294:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063e66ef4/0xd08452c77c570776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea20 expref: 16 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.483305:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063e66ef4/0xd08452c77c570776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea20 expref: 16 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.483314:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a894600, rc 0) 00000100:00100000:2.0:1789762913.483349:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+16:13387:x1876702140798208:12345-192.168.203.31@tcp:101:dd.0 Request processed in 136us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762913.483361:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:3.0:1789762913.489407:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318012561008 time 317962561008 state 0x1 ref 9 00000100:00100000:3.0:1789762913.489423:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+15:2344:x1876702140796544:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:3.0:1789762913.492148:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+17:2344:x1876702140796544:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2727us (117228us total) trans 4294967384 rc 0/0 00000100:00100000:3.0:1789762913.492155:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 471 00002000:00100000:3.0:1789762913.492165:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa:0x0] (3145728->4194303) req@ffff95d1526df480 x1876702140796544/t4294967384(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762913.492176:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526df480 with x1876702140796544 ext(3145728->4194303) 00002000:00010000:3.0:1789762913.492184:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526df480 00000100:00100000:0.0:1789762913.494139:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.494250:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140798336 00000100:00100000:1.0:1789762913.494268:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140798336 00000100:00100000:1.0:1789762913.494332:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:1.0:1789762913.494345:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+18:13388:x1876702140798336:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762913.494364:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762913.494386:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c57077d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea27 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762913.494418:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789762913.494444:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=317s v=(0 0) 00010000:00010000:1.0:1789762913.494451:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762913.494461:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c57077d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea27 expref: 19 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.494477:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c57077d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea27 expref: 19 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.494491:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d14882f000, rc 0) 00000100:00100000:1.0:1789762913.494580:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+19:13388:x1876702140798336:12345-192.168.203.31@tcp:101:dd.0 Request processed in 226us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762913.494602:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:0.0:1789762913.520975:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.521077:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140798464 00000100:00100000:1.0:1789762913.521093:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140798464 00002000:00100000:1.0:1789762913.521154:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xb:0x0] (3145728->4194303) req@ffff95d042b45500 x1876702140798464/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762913.521165:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b45500 with x1876702140798464 ext(3145728->4194303) 00002000:00010000:1.0:1789762913.521171:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042b45500 00000100:00100000:1.0:1789762913.521191:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288199480610 time 288199636921 state 0x0 ref 1 00000100:00100000:1.0:1789762913.521206:0:11723:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x1, head sequence 6: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015b00 gen 0 rate 20 depth 3 token 0 deadline 288199480610 time 288199636921 state 0x0 ref 1 00000100:00100000:1.0:1789762913.521259:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 3 deadline 317994503493 time 317994403493 state 0x1 ref 1 00000100:00100000:3.0:1789762913.521431:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 317994503493 time 317994581320 state 0x0 ref 1 00000100:00100000:3.0:1789762913.521457:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+17:2342:x1876702140798464:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762913.527744:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+19:2342:x1876702140798464:12345-192.168.203.31@tcp:4:dd.0 Request processed in 6290us (6772us total) trans 4294967385 rc 0/0 00000100:00100000:3.0:1789762913.527759:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 480 00000100:00100000:3.0:1789762913.527771:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 317994503493 time 317994581320 state 0x2 ref 0 00002000:00100000:3.0:1789762913.527788:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xb:0x0] (3145728->4194303) req@ffff95d042b45500 x1876702140798464/t4294967385(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762913.527801:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b45500 with x1876702140798464 ext(3145728->4194303) 00002000:00010000:3.0:1789762913.527816:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042b45500 00000100:00100000:0.0:1789762913.533334:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.533401:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140798592 00000100:00100000:1.0:1789762913.533410:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140798592 00002000:00100000:1.0:1789762913.533450:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xb:0x0] (0->1048575) req@ffff95d042b47800 x1876702140798592/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762913.533459:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b47800 with x1876702140798592 ext(0->1048575) 00002000:00010000:1.0:1789762913.533464:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042b47800 00000100:00100000:1.0:1789762913.533478:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 317994503493 time 317994581320 state 0x0 ref 1 00000100:00100000:1.0:1789762913.533522:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 317994681320 time 317994581320 state 0x1 ref 1 00000100:00100000:1.0:1789762913.533553:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 317994681320 time 318006713275 state 0x0 ref 1 00000100:00100000:1.0:1789762913.533598:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+19:2343:x1876702140798592:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762913.536547:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+21:2343:x1876702140798592:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2954us (3216us total) trans 4294967386 rc 0/0 00000100:00100000:1.0:1789762913.536555:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 481 00000100:00100000:1.0:1789762913.536563:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 317994681320 time 318006713275 state 0x2 ref 0 00002000:00100000:1.0:1789762913.536586:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xb:0x0] (0->1048575) req@ffff95d042b47800 x1876702140798592/t4294967386(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762913.536597:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b47800 with x1876702140798592 ext(0->1048575) 00002000:00010000:1.0:1789762913.536601:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042b47800 00000100:00100000:1.0:1789762913.539468:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318062627106 time 318012627106 state 0x1 ref 8 00000100:00100000:1.0:1789762913.539483:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+18:2344:x1876702140796672:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762913.541995:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+20:2344:x1876702140796672:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2516us (160960us total) trans 4294967797 rc 0/0 00000100:00100000:1.0:1789762913.542004:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 472 00002000:00100000:1.0:1789762913.542014:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xf:0x0] (4194304->5242879) req@ffff95d17463c000 x1876702140796672/t4294967797(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.542024:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463c000 with x1876702140796672 ext(4194304->5242879) 00002000:00010000:1.0:1789762913.542029:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463c000 00000100:00100000:0.0:1789762913.544248:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.544299:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140798720 00000100:00100000:2.0:1789762913.544309:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140798720 00002000:00100000:2.0:1789762913.544353:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xb:0x0] (2097152->3145727) req@ffff95d042b44380 x1876702140798720/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762913.544362:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b44380 with x1876702140798720 ext(2097152->3145727) 00002000:00010000:2.0:1789762913.544367:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042b44380 00000100:00100000:2.0:1789762913.544382:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 317994681320 time 318006713275 state 0x0 ref 1 00000100:00100000:2.0:1789762913.544411:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318006813275 time 318006713275 state 0x1 ref 1 00000100:00100000:2.0:1789762913.544433:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318006813275 time 318017594775 state 0x0 ref 1 00000100:00100000:2.0:1789762913.544445:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+21:2342:x1876702140798720:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762913.546634:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+23:2342:x1876702140798720:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2190us (2391us total) trans 4294967387 rc 0/0 00000100:00100000:1.0:1789762913.546650:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 482 00000100:00100000:1.0:1789762913.546657:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318006813275 time 318017594775 state 0x2 ref 0 00002000:00100000:1.0:1789762913.546667:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xb:0x0] (2097152->3145727) req@ffff95d042b44380 x1876702140798720/t4294967387(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762913.546674:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b44380 with x1876702140798720 ext(2097152->3145727) 00002000:00010000:1.0:1789762913.546679:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042b44380 00000100:00100000:0.0:1789762913.556407:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.556450:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140798848 00000100:00100000:3.0:1789762913.556458:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140798848 00002000:00100000:3.0:1789762913.556489:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (1048576->2097151) req@ffff95d042b46a00 x1876702140798848/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762913.556498:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b46a00 with x1876702140798848 ext(1048576->2097151) 00002000:00010000:3.0:1789762913.556501:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042b46a00 00000100:00100000:3.0:1789762913.556514:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318006813275 time 318017594775 state 0x0 ref 1 00000100:00100000:3.0:1789762913.556539:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318017694775 time 318017594775 state 0x1 ref 1 00000100:00100000:3.0:1789762913.556558:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318017694775 time 318029720348 state 0x0 ref 1 00000100:00100000:3.0:1789762913.556584:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+23:2344:x1876702140798848:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762913.558649:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+25:2344:x1876702140798848:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2081us (2247us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1789762913.558659:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 483 00000100:00100000:3.0:1789762913.558669:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318017694775 time 318029720348 state 0x2 ref 0 00002000:00100000:3.0:1789762913.558681:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (1048576->2097151) req@ffff95d042b46a00 x1876702140798848/t4294967388(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762913.558690:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b46a00 with x1876702140798848 ext(1048576->2097151) 00002000:00010000:3.0:1789762913.558693:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d042b46a00 00000100:00100000:0.0:1789762913.560658:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.560696:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140798976 00000100:00100000:3.0:1789762913.560708:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140798976 00002000:00100000:3.0:1789762913.560727:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x10:0x0] (0->1048575) req@ffff95d042b44a80 x1876702140798976/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762913.560735:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b44a80 with x1876702140798976 ext(0->1048575) 00002000:00010000:3.0:1789762913.560738:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d042b44a80 00000100:00100000:3.0:1789762913.560745:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318017694775 time 318029720348 state 0x0 ref 1 00000100:00100000:3.0:1789762913.560771:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318029820348 time 318029720348 state 0x1 ref 1 00000100:00100000:3.0:1789762913.560792:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318029820348 time 318033954803 state 0x0 ref 1 00000100:00100000:3.0:1789762913.560801:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+20:2345:x1876702140798976:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762913.564984:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.565037:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140799104 00000100:00100000:1.0:1789762913.565048:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140799104 00002000:00100000:1.0:1789762913.565086:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xb:0x0] (7340032->8388607) req@ffff95d160031c00 x1876702140799104/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762913.565096:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d160031c00 with x1876702140799104 ext(7340032->8388607) 00002000:00010000:1.0:1789762913.565100:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d160031c00 00000100:00100000:0.0:1789762913.565126:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.565157:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318034054803 time 318033954803 state 0x1 ref 2 00000100:00100000:2.0:1789762913.565194:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140799232 00000100:00100000:2.0:1789762913.565204:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140799232 00000100:00100000:0.0:1789762913.565216:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318034054803 time 318038369918 state 0x0 ref 2 00000100:00100000:0.0:1789762913.565242:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+25:2343:x1876702140799104:12345-192.168.203.31@tcp:4:dd.0 00002000:00100000:2.0:1789762913.565244:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x10:0x0] (1048576->2097151) req@ffff95d160030380 x1876702140799232/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762913.565257:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d160030380 with x1876702140799232 ext(1048576->2097151) 00002000:00010000:2.0:1789762913.565261:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d160030380 00000100:00100000:2.0:1789762913.565285:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318038469918 time 318038369918 state 0x1 ref 3 00000100:00100000:1.0:1789762913.565360:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318038469918 time 318038518658 state 0x0 ref 3 00000100:00100000:1.0:1789762913.565380:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+22:2342:x1876702140799232:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762913.567892:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+27:2343:x1876702140799104:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2661us (2911us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1789762913.567904:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 485 00002000:00100000:1.0:1789762913.567912:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xb:0x0] (7340032->8388607) req@ffff95d160031c00 x1876702140799104/t4294967389(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762913.567941:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d160031c00 with x1876702140799104 ext(7340032->8388607) 00002000:00010000:1.0:1789762913.567946:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d160031c00 00000100:00100000:3.0:1789762913.570097:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+24:2345:x1876702140798976:12345-192.168.203.31@tcp:4:dd.0 Request processed in 9293us (9437us total) trans 4294967798 rc 0/0 00000100:00100000:3.0:1789762913.570142:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 484 00002000:00100000:3.0:1789762913.570151:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x10:0x0] (0->1048575) req@ffff95d042b44a80 x1876702140798976/t4294967798(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762913.570158:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d042b44a80 with x1876702140798976 ext(0->1048575) 00002000:00010000:3.0:1789762913.570162:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d042b44a80 00000100:00100000:1.0:1789762913.572234:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+24:2342:x1876702140799232:12345-192.168.203.31@tcp:4:dd.0 Request processed in 6858us (7113us total) trans 4294967799 rc 0/0 00000100:00100000:1.0:1789762913.572246:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 486 00000100:00100000:1.0:1789762913.572257:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318038469918 time 318038518658 state 0x2 ref 0 00002000:00100000:1.0:1789762913.572272:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x10:0x0] (1048576->2097151) req@ffff95d160030380 x1876702140799232/t4294967799(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762913.572283:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d160030380 with x1876702140799232 ext(1048576->2097151) 00002000:00010000:1.0:1789762913.572289:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d160030380 00000100:00100000:0.0:1789762913.573161:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.573245:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140799360 00000100:00100000:1.0:1789762913.573253:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140799360 00002000:00100000:1.0:1789762913.573277:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (4194304->5242879) req@ffff95d150caed80 x1876702140799360/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762913.573286:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d150caed80 with x1876702140799360 ext(4194304->5242879) 00002000:00010000:1.0:1789762913.573289:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d150caed80 00000100:00100000:1.0:1789762913.573299:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318038469918 time 318038518658 state 0x0 ref 1 00000100:00100000:1.0:1789762913.573329:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318038618658 time 318038518658 state 0x1 ref 1 00000100:00100000:1.0:1789762913.573352:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318038618658 time 318046515360 state 0x0 ref 1 00000100:00100000:1.0:1789762913.573384:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+27:2344:x1876702140799360:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762913.575755:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+29:2344:x1876702140799360:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2375us (2594us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789762913.575762:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 487 00000100:00100000:1.0:1789762913.575769:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318038618658 time 318046515360 state 0x2 ref 0 00002000:00100000:1.0:1789762913.575781:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (4194304->5242879) req@ffff95d150caed80 x1876702140799360/t4294967390(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762913.575791:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d150caed80 with x1876702140799360 ext(4194304->5242879) 00002000:00010000:1.0:1789762913.575796:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d150caed80 00000100:00100000:2.0:1789762913.583377:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.583411:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.583429:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.583466:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140799488 00000100:00100000:1.0:1789762913.583475:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140799488 00000100:00100000:0.0:1789762913.583499:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140799744 00002000:00100000:1.0:1789762913.583512:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x10:0x0] (4194304->5242879) req@ffff95d145528e00 x1876702140799488/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1789762913.583513:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140799744 00002000:00100000:1.0:1789762913.583538:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145528e00 with x1876702140799488 ext(4194304->5242879) 00000100:00100000:2.0:1789762913.583538:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00002000:00010000:1.0:1789762913.583550:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145528e00 00000100:00100000:3.0:1789762913.583579:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140800000 00002000:00100000:0.0:1789762913.583587:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x10:0x0] (2097152->3145727) req@ffff95d14552aa00 x1876702140799744/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1789762913.583589:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318038618658 time 318046515360 state 0x0 ref 1 00000100:00100000:2.0:1789762913.583609:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.583617:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140800000 00002000:00100000:0.0:1789762913.583627:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d14552aa00 with x1876702140799744 ext(2097152->3145727) 00002000:00010000:0.0:1789762913.583634:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d14552aa00 00002000:00100000:3.0:1789762913.583649:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x10:0x0] (6291456->7340031) req@ffff95d14552b100 x1876702140800000/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789762913.583654:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140799616 00000100:00100000:2.0:1789762913.583667:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140799616 00000100:00100000:1.0:1789762913.583668:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318046615360 time 318046515360 state 0x1 ref 2 00002000:00100000:3.0:1789762913.583695:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d14552b100 with x1876702140800000 ext(6291456->7340031) 00000100:00100000:1.0:1789762913.583700:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140799872 00002000:00100000:2.0:1789762913.583703:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x10:0x0] (5242880->6291455) req@ffff95d14552bb80 x1876702140799616/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1789762913.583710:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140799872 00002000:00010000:3.0:1789762913.583712:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d14552b100 00000100:00100000:0.0:1789762913.583717:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318046615360 time 318046515360 state 0x1 ref 2 00002000:00100000:2.0:1789762913.583732:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d14552bb80 with x1876702140799616 ext(5242880->6291455) 00002000:00100000:1.0:1789762913.583738:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x10:0x0] (7340032->8388607) req@ffff95d145529f80 x1876702140799872/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00010000:2.0:1789762913.583739:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d14552bb80 00000100:00100000:3.0:1789762913.583746:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318046615360 time 318046515360 state 0x1 ref 3 00002000:00100000:1.0:1789762913.583774:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145529f80 with x1876702140799872 ext(7340032->8388607) 00000100:00100000:0.0:1789762913.583782:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318057033678 time 318056933678 state 0x1 ref 4 00002000:00010000:1.0:1789762913.583784:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145529f80 00000100:00100000:3.0:1789762913.583808:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 1 deadline 318057065554 time 318056965554 state 0x1 ref 5 00000100:00100000:0.0:1789762913.583810:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+28:2345:x1876702140799488:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762913.583828:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+28:2345:x1876702140799744:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762913.583829:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 1 deadline 318057065554 time 318056965554 state 0x1 ref 5 00000100:00100000:1.0:1789762913.583914:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 1 deadline 318057065554 time 318056965554 state 0x1 ref 5 00000100:00100000:2.0:1789762913.583929:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 1 deadline 318057190013 time 318057090013 state 0x1 ref 5 00000100:00100000:1.0:1789762913.583944:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 0 deadline 318057203671 time 318057103671 state 0x1 ref 5 00000100:00100000:2.0:1789762913.583952:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+28:2345:x1876702140800000:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762913.583963:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+28:2345:x1876702140799616:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762913.588051:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+33:2345:x1876702140799744:12345-192.168.203.31@tcp:4:dd.0 Request processed in 4228us (4636us total) trans 4294967800 rc 0/0 00000100:00100000:1.0:1789762913.588060:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 489 00002000:00100000:1.0:1789762913.588070:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x10:0x0] (2097152->3145727) req@ffff95d14552aa00 x1876702140799744/t4294967800(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762913.588078:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d14552aa00 with x1876702140799744 ext(2097152->3145727) 00002000:00010000:1.0:1789762913.588082:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d14552aa00 00000100:00100000:1.0:1789762913.588110:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318057203671 time 318061271603 state 0x0 ref 4 00000100:00100000:1.0:1789762913.588124:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+32:2345:x1876702140799872:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762913.588666:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.588755:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.588759:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140800512 00000100:00100000:0.0:1789762913.588769:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140800512 00000100:00100000:2.0:1789762913.588780:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.588803:0:6661:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:2.0:1789762913.588811:0:6661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:0.0:1789762913.588824:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1789762913.588893:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+17:13391:x1876702140800512:12345-192.168.203.31@tcp:35:dd.0 00000001:00080000:0.0:1789762913.589188:0:8160:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00000100:00100000:3.0:1789762913.589202:0:11723:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:3.0:1789762913.589212:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140800128 00000100:00100000:3.0:1789762913.589218:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140800128 00002000:00100000:3.0:1789762913.589251:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xb:0x0] (6291456->7340031) req@ffff95d173ce9180 x1876702140800128/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762913.589259:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173ce9180 with x1876702140800128 ext(6291456->7340031) 00002000:00010000:3.0:1789762913.589264:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d173ce9180 00000100:00100000:0.0:1789762913.589323:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+19:13391:x1876702140800512:12345-192.168.203.31@tcp:35:dd.0 Request processed in 433us (665us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789762913.589343:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:1.0:1789762913.589343:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+34:2345:x1876702140799488:12345-192.168.203.31@tcp:4:dd.0 Request processed in 5532us (5958us total) trans 4294967801 rc 0/0 00000020:00080000:0.0:1789762913.589355:0:8160:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789762913.589686:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140800256 00000100:00100000:2.0:1789762913.589692:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140800256 00002000:00100000:2.0:1789762913.589716:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x10:0x0] (3145728->4194303) req@ffff95d173cead80 x1876702140800256/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762913.589725:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173cead80 with x1876702140800256 ext(3145728->4194303) 00002000:00010000:2.0:1789762913.589729:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d173cead80 00000100:00100000:3.0:1789762913.589853:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318061371603 time 318061271603 state 0x1 ref 5 00000100:00100000:1.0:1789762913.589871:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 488 00000100:00100000:2.0:1789762913.589884:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318061371603 time 318061271603 state 0x1 ref 5 00002000:00100000:1.0:1789762913.589889:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x10:0x0] (4194304->5242879) req@ffff95d145528e00 x1876702140799488/t4294967801(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789762913.589936:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318063176819 time 318063076819 state 0x1 ref 5 00002000:00100000:1.0:1789762913.589951:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145528e00 with x1876702140799488 ext(4194304->5242879) 00002000:00010000:1.0:1789762913.589957:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145528e00 00000100:00100000:2.0:1789762913.589963:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+29:2345:x1876702140800128:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762913.590624:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.590762:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+35:2345:x1876702140799616:12345-192.168.203.31@tcp:4:dd.0 Request processed in 6803us (7235us total) trans 4294967802 rc 0/0 00000100:00100000:2.0:1789762913.590769:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 491 00002000:00100000:2.0:1789762913.590775:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x10:0x0] (5242880->6291455) req@ffff95d14552bb80 x1876702140799616/t4294967802(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762913.590783:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d14552bb80 with x1876702140799616 ext(5242880->6291455) 00002000:00010000:2.0:1789762913.590788:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d14552bb80 00000100:00100000:2.0:1789762913.590815:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140800640 00000100:00100000:2.0:1789762913.590817:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140800640 00002000:00100000:2.0:1789762913.590874:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xb:0x0] (5242880->6291455) req@ffff95d1461e1880 x1876702140800640/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762913.590880:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1461e1880 with x1876702140800640 ext(5242880->6291455) 00002000:00010000:2.0:1789762913.590883:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1461e1880 00000100:00100000:2.0:1789762913.590895:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318063176819 time 318063076819 state 0x1 ref 5 00000100:00100000:2.0:1789762913.590920:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318114082039 time 318064082039 state 0x1 ref 7 00000100:00100000:2.0:1789762913.590928:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+34:2344:x1876702140796800:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762913.591674:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+35:2345:x1876702140800000:12345-192.168.203.31@tcp:4:dd.0 Request processed in 7732us (8241us total) trans 4294967803 rc 0/0 00000100:00100000:2.0:1789762913.591683:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 490 00002000:00100000:2.0:1789762913.591692:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x10:0x0] (6291456->7340031) req@ffff95d14552b100 x1876702140800000/t4294967803(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762913.591703:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d14552b100 with x1876702140800000 ext(6291456->7340031) 00002000:00010000:2.0:1789762913.591709:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d14552b100 00000100:00100000:2.0:1789762913.591729:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318064991066 time 318064891066 state 0x1 ref 4 00000100:00100000:2.0:1789762913.591745:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+34:2345:x1876702140800256:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762913.591888:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318064991066 time 318065049418 state 0x0 ref 4 00000100:00100000:2.0:1789762913.591897:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1461e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+30:2344:x1876702140800640:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762913.594595:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+36:2345:x1876702140799872:12345-192.168.203.31@tcp:4:dd.0 Request processed in 6473us (10992us total) trans 4294967804 rc 0/0 00000100:00100000:0.0:1789762913.594602:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 492 00002000:00100000:0.0:1789762913.594608:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x10:0x0] (7340032->8388607) req@ffff95d145529f80 x1876702140799872/t4294967804(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762913.594615:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d145529f80 with x1876702140799872 ext(7340032->8388607) 00002000:00010000:0.0:1789762913.594618:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d145529f80 00000100:00100000:2.0:1789762913.597227:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+37:2345:x1876702140800256:12345-192.168.203.31@tcp:4:dd.0 Request processed in 5484us (8442us total) trans 4294967805 rc 0/0 00000100:00100000:2.0:1789762913.597235:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 494 00002000:00100000:2.0:1789762913.597244:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x10:0x0] (3145728->4194303) req@ffff95d173cead80 x1876702140800256/t4294967805(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762913.597253:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173cead80 with x1876702140800256 ext(3145728->4194303) 00002000:00010000:2.0:1789762913.597257:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d173cead80 00000100:00100000:0.0:1789762913.599207:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+33:2345:x1876702140800128:12345-192.168.203.31@tcp:4:dd.0 Request processed in 9248us (10453us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789762913.599214:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 493 00002000:00100000:0.0:1789762913.599222:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (6291456->7340031) req@ffff95d173ce9180 x1876702140800128/t4294967391(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762913.599229:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d173ce9180 with x1876702140800128 ext(6291456->7340031) 00002000:00010000:0.0:1789762913.599233:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d173ce9180 00000100:00100000:1.0:1789762913.599542:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+37:2344:x1876702140796800:12345-192.168.203.31@tcp:4:dd.500 Request processed in 8605us (212435us total) trans 4294967806 rc 0/0 00000100:00100000:1.0:1789762913.599560:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 473 00002000:00100000:1.0:1789762913.599589:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (5242880->6291455) req@ffff95d17463ea00 x1876702140796800/t4294967806(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.599602:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17463ea00 with x1876702140796800 ext(5242880->6291455) 00002000:00010000:1.0:1789762913.599610:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d17463ea00 00000100:00100000:0.0:1789762913.600452:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1461e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+33:2344:x1876702140800640:12345-192.168.203.31@tcp:4:dd.0 Request processed in 8553us (9826us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789762913.600459:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 495 00000100:00100000:0.0:1789762913.600469:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318064991066 time 318065049418 state 0x2 ref 0 00002000:00100000:0.0:1789762913.600487:0:14626:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xb:0x0] (5242880->6291455) req@ffff95d1461e1880 x1876702140800640/t4294967392(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762913.600498:0:14626:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1461e1880 with x1876702140800640 ext(5242880->6291455) 00002000:00010000:0.0:1789762913.600503:0:14626:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1461e1880 00000100:00100000:2.0:1789762913.641044:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318164191877 time 318114191877 state 0x1 ref 6 00000100:00100000:2.0:1789762913.641080:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+36:2344:x1876702140796928:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:3.0:1789762913.643863:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+38:2344:x1876702140796928:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2786us (250210us total) trans 4294967807 rc 0/0 00000100:00100000:3.0:1789762913.643873:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 474 00002000:00100000:3.0:1789762913.643885:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xf:0x0] (6291456->7340031) req@ffff95d1526dca80 x1876702140796928/t4294967807(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762913.643894:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dca80 with x1876702140796928 ext(6291456->7340031) 00002000:00010000:3.0:1789762913.643901:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1526dca80 00000100:00100000:1.0:1789762913.691213:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318214353034 time 318164353034 state 0x1 ref 5 00000100:00100000:1.0:1789762913.691248:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+37:2344:x1876702140797056:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762913.694729:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140797056:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3497us (294990us total) trans 4294967808 rc 0/0 00000100:00100000:1.0:1789762913.694740:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 475 00002000:00100000:1.0:1789762913.694752:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xf:0x0] (7340032->8388607) req@ffff95d16ffe4000 x1876702140797056/t4294967808(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.694761:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe4000 with x1876702140797056 ext(7340032->8388607) 00002000:00010000:1.0:1789762913.694769:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffe4000 00000100:00100000:0.0:1789762913.741314:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318264462105 time 318214462105 state 0x1 ref 4 00000100:00100000:0.0:1789762913.741338:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+32:2345:x1876702140797184:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762913.744334:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+34:2345:x1876702140797184:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3004us (337859us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1789762913.744343:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 476 00002000:00100000:0.0:1789762913.744351:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xa:0x0] (4194304->5242879) req@ffff95d16ffe6680 x1876702140797184/t4294967393(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762913.744359:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe6680 with x1876702140797184 ext(4194304->5242879) 00002000:00010000:0.0:1789762913.744365:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe6680 00000100:00100000:2.0:1789762913.791394:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318314544019 time 318264544019 state 0x1 ref 3 00000100:00100000:2.0:1789762913.791418:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+33:2345:x1876702140797312:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762913.794191:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+35:2345:x1876702140797312:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2781us (379493us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1789762913.794200:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 477 00002000:00100000:0.0:1789762913.794209:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa:0x0] (5242880->6291455) req@ffff95d1526dc000 x1876702140797312/t4294967394(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762913.794218:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1526dc000 with x1876702140797312 ext(5242880->6291455) 00002000:00010000:0.0:1789762913.794224:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1526dc000 00000100:00100000:0.0:1789762913.841471:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318364619590 time 318314619590 state 0x1 ref 2 00000100:00100000:0.0:1789762913.841510:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+34:2345:x1876702140797440:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762913.848017:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+36:2345:x1876702140797440:12345-192.168.203.31@tcp:4:dd.500 Request processed in 6513us (403846us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1789762913.848026:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 478 00002000:00100000:0.0:1789762913.848036:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa:0x0] (6291456->7340031) req@ffff95d148880a80 x1876702140797440/t4294967395(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762913.848044:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d148880a80 with x1876702140797440 ext(6291456->7340031) 00002000:00010000:0.0:1789762913.848050:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d148880a80 00000100:00100000:1.0:1789762913.891604:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318364619590 time 318364742154 state 0x0 ref 1 00000100:00100000:1.0:1789762913.891645:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+35:2345:x1876702140797568:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762913.894865:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+37:2345:x1876702140797568:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3236us (444036us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789762913.894881:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 479 00000100:00100000:1.0:1789762913.894891:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318364619590 time 318364742154 state 0x2 ref 0 00002000:00100000:1.0:1789762913.894906:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa:0x0] (7340032->8388607) req@ffff95d16ffe4700 x1876702140797568/t4294967396(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/448 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762913.894915:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffe4700 with x1876702140797568 ext(7340032->8388607) 00002000:00010000:1.0:1789762913.894922:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d16ffe4700 00000100:00100000:2.0:1789762913.928516:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.928599:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140800768 00000100:00100000:1.0:1789762913.928616:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140800768 00000100:00100000:1.0:1789762913.928722:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1789762913.928734:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+39:5571:x1876702140800768:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789762913.928747:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:1.0:1789762913.928753:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:1.0:1789762913.928778:0:5797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1789762913.928782:0:5797:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb mtime from disk: 0 -> 1789762912 00002000:00010000:1.0:1789762913.928785:0:5797:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb ctime from disk: 0 -> 1789762912 00000100:00100000:2.0:1789762913.928798:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140800896 00000100:00100000:2.0:1789762913.928810:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140800896 00010000:00010000:1.0:1789762913.928884:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c57073e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea0b expref: 39 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762913.928912:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1789762913.928926:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+37:5572:x1876702140800896:12345-192.168.203.31@tcp:103:ldlm_bl.0 00002000:00010000:1.0:1789762913.928936:0:5797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 0 -> 8388608 00010000:00010000:2.0:1789762913.928940:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:1.0:1789762913.928941:0:5797:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb mtime from disk: 0 -> 1789762913 00002000:00010000:1.0:1789762913.928944:0:5797:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb ctime from disk: 0 -> 1789762913 00002000:00010000:2.0:1789762913.928958:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb size from disk: 0 -> 8388608 00010000:00010000:1.0:1789762913.928961:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066b51a4c/0xd08452c77c57077d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea27 expref: 38 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762913.928963:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1789762912 00002000:00010000:2.0:1789762913.928973:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1789762912 00002000:00010000:2.0:1789762913.928981:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1789762913.929011:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aa888c6/0xd08452c77c57074c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea12 expref: 37 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.929061:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1789762913.929085:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:2.0:1789762913.929089:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1789762913 00002000:00010000:2.0:1789762913.929091:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1789762913 00010000:00010000:2.0:1789762913.929102:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063e66ef4/0xd08452c77c570776 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea20 expref: 36 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.929115:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762913.929152:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+37:5571:x1876702140800768:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 415us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762913.929164:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1789762913.929169:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+35:5572:x1876702140800896:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 244us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762913.929178:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1789762913.961688:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762913.961782:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140801152 00000100:00100000:1.0:1789762913.961800:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140801152 00000100:00100000:1.0:1789762913.961922:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:1.0:1789762913.961938:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+19:13420:x1876702140801152:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762913.961970:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762913.961997:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570784 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea2e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.962126:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c57078b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.962146:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c57078b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.962174:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c57078b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762913.962188:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 16777216 00010000:00010000:1.0:1789762913.962389:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882f000/0xd08452c77c570784 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea2e expref: 22 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.962414:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c57078b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea2e expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762913.962448:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff95d15055db00) 00010000:00010000:1.0:1789762913.962452:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762913.962457:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d14882fe00, rc 0) 00000100:00100000:1.0:1789762913.962583:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+21:13420:x1876702140801152:12345-192.168.203.31@tcp:101:dd.0 Request processed in 649us (900us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789762913.962592:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:0.0:1789762913.963903:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.963942:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.963976:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140801408 00000100:00100000:2.0:1789762913.963988:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140801408 00000100:00100000:3.0:1789762913.964009:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140801664 00000100:00100000:3.0:1789762913.964031:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140801664 00000100:00100000:2.0:1789762913.964058:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 242 00000100:00100000:2.0:1789762913.964083:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+22:13422:x1876702140801408:12345-192.168.203.31@tcp:101:dd.0 00000100:00100000:3.0:1789762913.964099:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 243 00010000:00010000:2.0:1789762913.964107:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789762913.964112:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+22:13421:x1876702140801664:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762913.964132:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762913.964134:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894600/0xd08452c77c570799 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea35 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.964219:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5707a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea3c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.964235:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c5707a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.964261:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c5707a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.964271:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c5707a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762913.964282:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 16777216 00010000:00010000:3.0:1789762913.964296:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5707ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.964308:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5707ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.964317:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5707ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762913.964325:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 16777216 00010000:00010000:2.0:1789762913.964403:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894600/0xd08452c77c570799 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea35 expref: 26 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.964422:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c5707a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea35 expref: 25 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.964430:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff95d15055db00) 00010000:00010000:2.0:1789762913.964443:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762913.964447:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a895c00, rc 0) 00000100:00100000:0.0:1789762913.964498:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762913.964517:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+26:13422:x1876702140801408:12345-192.168.203.31@tcp:101:dd.0 Request processed in 436us (618us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1789762913.964528:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140801792 00000100:00100000:0.0:1789762913.964534:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140801792 00000100:00100000:2.0:1789762913.964542:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 242 00000100:00100000:1.0:1789762913.964613:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.964620:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1789762913.964632:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+26:2344:x1876702140801792:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789762913.964644:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140801920 00010000:00010000:0.0:1789762913.964645:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789762913.964653:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140801920 00010000:00010000:0.0:1789762913.964668:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d14882fe00/0xd08452c77c57078b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea2e expref: 26 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762913.964683:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff95d15055db00) 00010000:00010000:0.0:1789762913.964686:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762913.964694:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5707a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea3c expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762913.964720:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+25:2344:x1876702140801792:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762913.964720:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00010000:00010000:3.0:1789762913.964729:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5707ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea3c expref: 25 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762913.964736:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1789762913.964744:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+37:13420:x1876702140801920:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762913.964761:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff95d15055db00) 00010000:00010000:2.0:1789762913.964769:0:10283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762913.964769:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762913.964780:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003fc00, rc 0) 00010000:00010000:2.0:1789762913.964790:0:10283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c5707c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea43 expref: -99 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762913.964809:0:10283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 8388608, mtime: 0x6aad9d60, atime: 0x0, ctime: 0x6aad9d60, blocks: 0x1 00010000:00010000:2.0:1789762913.964825:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=318s v=(0 0) 00010000:00010000:2.0:1789762913.964867:0:10283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762913.964876:0:10283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c5707c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea43 expref: 38 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.964889:0:10283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c5707c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea43 expref: 38 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762913.964898:0:10283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a894200, rc 0) 00000100:00100000:2.0:1789762913.964931:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+38:13420:x1876702140801920:12345-192.168.203.31@tcp:101:dd.0 Request processed in 199us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762913.964936:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:3.0:1789762913.964958:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+24:13421:x1876702140801664:12345-192.168.203.31@tcp:101:dd.0 Request processed in 717us (882us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789762913.964973:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:1.0:1789762913.965733:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.965778:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140802176 00000100:00100000:3.0:1789762913.965785:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140802176 00000100:00100000:0.0:1789762913.965894:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:0.0:1789762913.965907:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+24:13422:x1876702140802176:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:2.0:1789762913.966054:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.966071:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+25:13422:x1876702140802176:12345-192.168.203.31@tcp:35:dd.0 Request processed in 167us (337us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1789762913.966080:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:3.0:1789762913.966135:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140802432 00000100:00100000:3.0:1789762913.966141:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140802432 00000100:00100000:0.0:1789762913.966214:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1789762913.966215:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.966230:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+25:2345:x1876702140802432:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762913.966243:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789762913.966248:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140802304 00000100:00100000:3.0:1789762913.966255:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140802304 00010000:00010000:0.0:1789762913.966263:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5707ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea3c expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762913.966279:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff95d15055db00) 00010000:00010000:0.0:1789762913.966282:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762913.966303:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:3.0:1789762913.966321:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+25:2345:x1876702140802304:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789762913.966323:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+25:2345:x1876702140802432:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 93us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762913.966337:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00010000:00010000:3.0:1789762913.966337:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762913.966356:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c5707a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea35 expref: 24 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.966373:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff95d15055db00) 00010000:00010000:3.0:1789762913.966378:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762913.966467:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+23:2345:x1876702140802304:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 152us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762913.966478:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1789762913.966751:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.966786:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140802688 00000100:00100000:0.0:1789762913.966791:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140802688 00000100:00100000:0.0:1789762913.966817:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:0.0:1789762913.966823:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+23:13421:x1876702140802688:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:0.0:1789762913.966953:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+24:13421:x1876702140802688:12345-192.168.203.31@tcp:35:dd.0 Request processed in 128us (201us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789762913.966961:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:2.0:1789762913.970331:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.970377:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140802816 00000100:00100000:0.0:1789762913.970388:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140802816 00002000:00100000:0.0:1789762913.970450:0:14626:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0xf:0x0] (0->1048575) req@ffff95d043c3a680 x1876702140802816/t0(0) o3->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/0 e 0 to 0 dl 1789762924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762913.970460:0:14626:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d043c3a680 with x1876702140802816 ext(0->1048575) 00002000:00010000:0.0:1789762913.970466:0:14626:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d043c3a680 00000100:00100000:0.0:1789762913.970492:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 298047645557 time 298047750627 state 0x0 ref 1 00000100:00100000:0.0:1789762913.970499:0:14626:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x1, head sequence 6: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015300 gen 0 rate 10 depth 3 token 0 deadline 298047645557 time 298047750627 state 0x0 ref 1 00000100:00100000:0.0:1789762913.970531:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 3 deadline 318443789825 time 318443689825 state 0x1 ref 1 00000100:00100000:0.0:1789762913.970554:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318443789825 time 318443716332 state 0x0 ref 1 00000100:00100000:0.0:1789762913.970578:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+38:2344:x1876702140802816:12345-192.168.203.31@tcp:3:dd.0 00000100:00100000:0.0:1789762913.974495:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+38:2344:x1876702140802816:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3931us (4165us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762913.974504:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 496 00000100:00100000:0.0:1789762913.974512:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318443789825 time 318443716332 state 0x2 ref 0 00002000:00100000:0.0:1789762913.974523:0:14626:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0xf:0x0] (0->1048575) req@ffff95d043c3a680 x1876702140802816/t0(0) o3->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:694/0 lens 488/440 e 0 to 0 dl 1789762924 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762913.974534:0:14626:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d043c3a680 with x1876702140802816 ext(0->1048575) 00002000:00010000:0.0:1789762913.974538:0:14626:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d043c3a680 00000100:00100000:2.0:1789762913.998453:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762913.998510:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140803072 00000100:00100000:0.0:1789762913.998541:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140803072 00000100:00100000:0.0:1789762913.998610:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:0.0:1789762913.998620:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+24:13424:x1876702140803072:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:0.0:1789762913.998896:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+25:13424:x1876702140803072:12345-192.168.203.31@tcp:35:dd.0 Request processed in 276us (449us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1789762913.998908:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:1.0:1789762913.999201:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762913.999249:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140803328 00000100:00100000:3.0:1789762913.999258:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140803328 00000100:00100000:3.0:1789762913.999305:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 244 00000100:00100000:3.0:1789762913.999315:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+25:13432:x1876702140803328:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762913.999332:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762913.999348:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5707ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea4a expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.999424:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5707d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.999435:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5707d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.999456:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5707d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762913.999466:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 16777216 00010000:00010000:3.0:1789762913.999583:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c5707ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea4a expref: 28 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.999598:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5707d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea4a expref: 27 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762913.999605:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff95d15055db00) 00010000:00010000:3.0:1789762913.999608:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789762913.999610:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003fe00, rc 0) 00000100:00100000:3.0:1789762913.999656:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+27:13432:x1876702140803328:12345-192.168.203.31@tcp:101:dd.0 Request processed in 344us (458us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789762913.999662:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 244 00000100:00100000:1.0:1789762914.010338:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762914.010428:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140803456 00000100:00100000:2.0:1789762914.010435:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140803456 00000100:00100000:2.0:1789762914.010471:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00100000:2.0:1789762914.010479:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+27:13436:x1876702140803456:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789762914.010494:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762914.010505:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894800/0xd08452c77c5707df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea51 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.010539:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895a00/0xd08452c77c5707e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.010547:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895a00/0xd08452c77c5707e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.010553:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895a00/0xd08452c77c5707e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762914.010584:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:2.0:1789762914.010587:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762914.010597:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895a00/0xd08452c77c5707e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.010612:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894800/0xd08452c77c5707df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea51 expref: 29 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.010624:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895a00/0xd08452c77c5707e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea51 expref: 28 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.010641:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d15055d400) 00010000:00010000:2.0:1789762914.010644:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762914.010646:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a895a00, rc 0) 00000100:00100000:2.0:1789762914.010688:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+28:13436:x1876702140803456:12345-192.168.203.31@tcp:101:rm.0 Request processed in 205us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762914.010694:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00100000:2.0:1789762914.011621:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762914.011678:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140803712 00000100:00100000:1.0:1789762914.011686:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140803712 00000100:00100000:1.0:1789762914.011724:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 246 00000100:00100000:1.0:1789762914.011732:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+28:13436:x1876702140803712:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:1.0:1789762914.011744:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762914.011760:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5707ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea58 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762914.011818:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00010000:1.0:1789762914.011911:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5707ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea58 expref: 30 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.011924:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055da00) 00010000:00010000:1.0:1789762914.011934:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789762914.011939:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5707ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea58 expref: 30 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.011950:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d141524000, rc 0) 00000100:00100000:1.0:1789762914.011986:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+29:13436:x1876702140803712:12345-192.168.203.31@tcp:101:rm.0 Request processed in 256us (366us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1789762914.011992:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 246 00000100:00100000:0.0:1789762914.013457:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762914.013533:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140803840 00000100:00100000:2.0:1789762914.013540:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140803840 00000100:00100000:2.0:1789762914.013585:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:2.0:1789762914.013592:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15177fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+29:13436:x1876702140803840:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:2.0:1789762914.015280:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15177fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+29:13436:x1876702140803840:12345-192.168.203.31@tcp:37:rm.0 Request processed in 1687us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762914.015288:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:1.0:1789762914.016495:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762914.016539:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140804096 00000100:00100000:0.0:1789762914.016545:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140804096 00000100:00100000:0.0:1789762914.016589:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:0.0:1789762914.016601:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+29:13436:x1876702140804096:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:0.0:1789762914.016718:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+30:13436:x1876702140804096:12345-192.168.203.31@tcp:35:rm.0 Request processed in 120us (224us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789762914.016726:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:0.0:1789762914.017491:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762914.017533:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140804352 00000100:00100000:1.0:1789762914.017540:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140804352 00000100:00100000:1.0:1789762914.017592:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 247 00000100:00100000:1.0:1789762914.017599:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+30:13436:x1876702140804352:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:1.0:1789762914.017610:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762914.017621:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524a00/0xd08452c77c5707fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea5f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.017664:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525c00/0xd08452c77c570802 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.017675:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525c00/0xd08452c77c570802 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.017684:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525c00/0xd08452c77c570802 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762914.017691:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00010000:1.0:1789762914.017734:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524a00/0xd08452c77c5707fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea5f expref: 33 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.017760:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525c00/0xd08452c77c570802 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea5f expref: 32 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.017766:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d15055d400) 00010000:00010000:1.0:1789762914.017768:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789762914.017770:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d141525c00, rc 0) 00000100:00100000:1.0:1789762914.017800:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+32:13436:x1876702140804352:12345-192.168.203.31@tcp:101:rm.0 Request processed in 203us (310us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789762914.017805:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 247 00000100:00100000:3.0:1789762914.018745:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762914.018790:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140804480 00000100:00100000:0.0:1789762914.018795:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140804480 00000100:00100000:0.0:1789762914.018824:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 248 00000100:00100000:0.0:1789762914.018830:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+32:13436:x1876702140804480:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:0.0:1789762914.018918:0:6681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789762914.018963:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+32:13436:x1876702140804480:12345-192.168.203.31@tcp:41:rm.0 Request processed in 133us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762914.018970:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 248 00000100:00100000:2.0:1789762914.019889:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762914.019933:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140804736 00000100:00100000:3.0:1789762914.019939:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140804736 00000100:00100000:3.0:1789762914.019970:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 249 00000100:00100000:3.0:1789762914.019976:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+32:13436:x1876702140804736:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:3.0:1789762914.020003:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789762914.020018:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fa00/0xd08452c77c570768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea19 expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.020034:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff95d15055dd00) 00010000:00010000:3.0:1789762914.020061:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895a00/0xd08452c77c5707e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea51 expref: 31 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.020073:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d15055d400) 00010000:00010000:3.0:1789762914.020077:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762914.020089:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570810 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.020097:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570810 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.020103:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570810 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.020112:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c570817 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.020116:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c570817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.020121:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c570817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.020183:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c57081e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.020188:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c57081e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.020192:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c57081e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789762914.020827:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].10, 64 off8832 00000004:00080000:3.0:1789762914.020895:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 318494060755ns, next at 319494058955ns, rc = 0 00000040:00080000:3.0:1789762914.020968:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 64 off9152 00000004:00080000:3.0:1789762914.020976:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 318494142508ns, next at 319494141076ns, rc = 0 00010000:00010000:3.0:1789762914.021046:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c570825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021058:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c570825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021069:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c570825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021079:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c570825 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021089:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c570825 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021097:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c570825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021124:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762914.021139:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c57081e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021147:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c57081e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.021155:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762914.021157:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c57081e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.021163:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c570825 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021168:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762914.021172:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ec00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762914.021177:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c57081e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.021178:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c570825 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.021185:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c570825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.021201:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff95d15055d900) 00010000:00010000:2.0:1789762914.021212:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762914.021216:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c570825 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021218:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c57081e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.021222:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003ec00/0xd08452c77c570825 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.021241:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762914.021244:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762914.021245:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762914.021249:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff95d15055d900) 00010000:00010000:3.0:1789762914.021255:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789762914.021260:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c57081e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021268:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f200/0xd08452c77c57081e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021287:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570810 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021294:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570810 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021301:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570810 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021306:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fc00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762914.021309:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570810 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021316:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570810 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021323:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d15055d400) 00010000:00010000:3.0:1789762914.021325:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762914.021328:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570810 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.021344:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fc00/0xd08452c77c570810 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762914.021353:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcb1e145 reply state 00000000a678d4b9 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c570817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762914.021361:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762914.021410:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+32:13436:x1876702140804736:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1433us (1526us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789762914.021418:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 249 00010000:00010000:3.0:1789762914.022021:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c570817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.022030:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c570817 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.022037:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c570817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.022043:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762914.022046:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c570817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.022054:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c570817 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.022064:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x636661f9 (ffff95d15055d200) 00010000:00010000:3.0:1789762914.022067:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762914.022070:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c570817 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.022085:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c570817 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762914.022484:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762914.022525:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140804992 00000100:00100000:0.0:1789762914.022531:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140804992 00000100:00100000:0.0:1789762914.022559:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:0.0:1789762914.022588:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+31:13436:x1876702140804992:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:0.0:1789762914.022717:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+32:13436:x1876702140804992:12345-192.168.203.31@tcp:35:rm.0 Request processed in 131us (235us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1789762914.022723:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:1.0:1789762914.023377:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762914.023415:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140805248 00000100:00100000:3.0:1789762914.023420:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140805248 00000100:00100000:3.0:1789762914.023449:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 250 00000100:00100000:3.0:1789762914.023455:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+32:13436:x1876702140805248:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:3.0:1789762914.023478:0:13232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789762914.023488:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5707d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea4a expref: 32 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.023500:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c570730 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea04 expref: 31 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.023506:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff95d15055db00) 00010000:00010000:3.0:1789762914.023512:0:13232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762914.023519:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57082c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.023526:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57082c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.023531:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57082c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.023538:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570833 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.023543:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.023554:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.023615:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57083a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.023624:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57083a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.023630:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57083a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789762914.023936:0:13232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 64 off9216 00000040:00080000:3.0:1789762914.023967:0:13232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].11, 64 off8896 00010000:00010000:3.0:1789762914.024001:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c570841 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024008:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c570841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024014:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c570841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024018:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c570841 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024022:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c570841 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024029:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c570841 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024059:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762914.024071:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57083a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024079:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57083a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024085:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57083a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.024090:0:6671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762914.024090:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762914.024094:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57083a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.024098:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c570841 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024101:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57083a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.024115:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762914.024119:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff95d15055d800) 00010000:00010000:3.0:1789762914.024122:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789762914.024124:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57083a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.024128:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c570841 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024129:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c57083a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.024146:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c570841 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024152:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57082c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.024158:0:6671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff95d15055d800) 00010000:00010000:3.0:1789762914.024159:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57082c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.024163:0:6671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762914.024168:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c570841 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.024180:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f800/0xd08452c77c570841 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024184:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57082c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024190:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762914.024193:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57082c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.024195:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762914.024199:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762914.024200:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57082c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024208:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d15055d400) 00010000:00010000:2.0:1789762914.024209:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762914.024213:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762914.024215:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57082c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024220:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57082c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762914.024227:0:13232:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091f3c337 reply state 0000000012a99fe7 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762914.024232:0:13232:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762914.024269:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+32:13436:x1876702140805248:12345-192.168.203.31@tcp:36:rm.0 Request processed in 814us (895us total) trans 4294967510 rc 0/0 00000100:00100000:3.0:1789762914.024274:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 250 00010000:00010000:3.0:1789762914.024892:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024899:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570833 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024912:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570833 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024915:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762914.024918:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570833 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024922:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570833 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024928:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xf4d4877e (ffff95d15055de00) 00010000:00010000:3.0:1789762914.024930:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762914.024932:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570833 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.024937:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570833 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762914.026240:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762914.026301:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140805504 00000100:00100000:0.0:1789762914.026307:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140805504 00000100:00100000:0.0:1789762914.026338:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:0.0:1789762914.026346:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+31:13436:x1876702140805504:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:0.0:1789762914.026458:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+32:13436:x1876702140805504:12345-192.168.203.31@tcp:35:rm.0 Request processed in 114us (223us total) trans 4294967511 rc 0/0 00000100:00100000:0.0:1789762914.026465:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:1.0:1789762914.027265:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762914.027310:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140805760 00000100:00100000:2.0:1789762914.027317:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140805760 00000100:00100000:2.0:1789762914.027349:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:2.0:1789762914.027356:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+32:13436:x1876702140805760:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762914.027382:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762914.027394:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525c00/0xd08452c77c570802 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea5f expref: 32 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027408:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e400/0xd08452c77c570714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9fd expref: 31 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027416:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d15055d400) 00010000:00010000:2.0:1789762914.027424:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e800/0xd08452c77c5706b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7e9e8 expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027430:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055da00) 00010000:00010000:2.0:1789762914.027434:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762914.027445:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c570848 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027451:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c570848 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027456:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c570848 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027462:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c57084f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027477:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c57084f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027482:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c57084f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027525:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c570856 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027531:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c570856 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027536:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c570856 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762914.027823:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00010000:2.0:1789762914.027870:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c570856 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027876:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c570856 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027881:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c570856 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027885:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762914.027887:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c570856 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027892:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c570856 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027907:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff95d142a04200) 00010000:00010000:2.0:1789762914.027909:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762914.027911:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c570856 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027915:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c570856 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027927:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c570848 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027931:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c570848 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027935:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c570848 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027947:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762914.027949:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c570848 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027954:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c570848 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027958:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04100) 00010000:00010000:2.0:1789762914.027959:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762914.027961:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c570848 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.027965:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c570848 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762914.027979:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000648b7915 reply state 000000002f19a1b0 transno 4294967512 ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c57084f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762914.027984:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762914.028023:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+31:13436:x1876702140805760:12345-192.168.203.31@tcp:36:rm.0 Request processed in 668us (759us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1789762914.028029:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 251 00010000:00010000:3.0:1789762914.028560:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c57084f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.028580:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c57084f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.028587:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c57084f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.028594:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762914.028597:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c57084f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.028616:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c57084f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.028624:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d142a04800) 00010000:00010000:3.0:1789762914.028626:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762914.028628:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c57084f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.028632:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c57084f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762914.334263:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762914.334311:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140805888 00000100:00100000:1.0:1789762914.334322:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140805888 00000100:00100000:1.0:1789762914.334376:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00100000:1.0:1789762914.334387:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+30:13447:x1876702140805888:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:1.0:1789762914.334408:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762914.334426:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c57085d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea66 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.334478:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525000/0xd08452c77c570864 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.334490:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525000/0xd08452c77c570864 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.334499:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525000/0xd08452c77c570864 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762914.334535:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789762914.334537:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762914.334552:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525000/0xd08452c77c570864 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.334593:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c57085d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea66 expref: 32 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.334607:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525000/0xd08452c77c570864 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea66 expref: 31 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.334614:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2500) 00010000:00010000:1.0:1789762914.334618:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762914.334622:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d141525000, rc 0) 00000100:00100000:1.0:1789762914.334695:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+31:13447:x1876702140805888:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 311us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762914.334701:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00100000:3.0:1789762914.335819:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762914.335882:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140806144 00000100:00100000:1.0:1789762914.335887:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140806144 00000100:00100000:1.0:1789762914.335932:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:1.0:1789762914.335939:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+31:13447:x1876702140806144:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:1.0:1789762914.335994:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762914.336007:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525000/0xd08452c77c570864 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea66 expref: 31 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.336018:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2500) 00010000:00010000:1.0:1789762914.336033:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762914.336101:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525e00/0xd08452c77c57086b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.336109:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525e00/0xd08452c77c57086b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.336114:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525e00/0xd08452c77c57086b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.336124:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524a00/0xd08452c77c570872 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.336129:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524a00/0xd08452c77c570872 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.336135:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524a00/0xd08452c77c570872 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762914.336785:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 16384 00010000:00010000:1.0:1789762914.336794:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525e00/0xd08452c77c57086b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.336799:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525e00/0xd08452c77c57086b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.336805:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525e00/0xd08452c77c57086b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.336810:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762914.336814:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525e00/0xd08452c77c57086b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.336828:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525e00/0xd08452c77c57086b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.337125:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2100) 00010000:00010000:1.0:1789762914.337126:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762914.337130:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525e00/0xd08452c77c57086b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.337134:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d141525e00/0xd08452c77c57086b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762914.337144:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e2860c5 reply state 000000000c5af118 transno 4294967513 ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524a00/0xd08452c77c570872 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762914.337151:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762914.337194:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+32:13447:x1876702140806144:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 1255us (1376us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1789762914.337201:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 253 00010000:00010000:3.0:1789762914.337826:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524a00/0xd08452c77c570872 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.337862:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524a00/0xd08452c77c570872 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.337868:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524a00/0xd08452c77c570872 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.337873:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762914.337876:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524a00/0xd08452c77c570872 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.337885:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524a00/0xd08452c77c570872 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.337898:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d14abf2700) 00010000:00010000:3.0:1789762914.337902:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762914.337917:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524a00/0xd08452c77c570872 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.337925:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524a00/0xd08452c77c570872 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762914.342546:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762914.342611:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140806272 00000100:00100000:0.0:1789762914.342623:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140806272 00000100:00100000:0.0:1789762914.342704:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00100000:0.0:1789762914.342733:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+31:13448:x1876702140806272:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789762914.342758:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762914.342785:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570879 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea6d expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.342886:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570880 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.342902:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570880 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.342917:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570880 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.342917:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:0.0:1789762914.342982:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789762914.342987:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762914.343011:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570880 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.343041:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570879 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea6d expref: 33 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.343061:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570880 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea6d expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.343071:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90700) 00010000:00010000:0.0:1789762914.343075:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762914.343079:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d174638000, rc 0) 00000100:00100000:0.0:1789762914.343149:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+32:13448:x1876702140806272:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 434us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762914.343162:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00100000:0.0:1789762914.344241:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762914.344280:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140806528 00000100:00100000:3.0:1789762914.344288:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140806528 00000100:00100000:3.0:1789762914.344327:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 255 00000100:00100000:3.0:1789762914.344336:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+32:13448:x1876702140806528:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762914.344349:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762914.344352:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789762914.344368:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570880 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea6d expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344379:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90700) 00010000:00010000:3.0:1789762914.344386:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762914.344394:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570887 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea74 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344480:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57088e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344489:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57088e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344496:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57088e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344515:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570895 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344521:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570895 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344535:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570895 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344602:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c57089c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344609:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c57089c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344614:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c57089c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762914.344619:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 16384 00010000:00010000:3.0:1789762914.344628:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c57089c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344633:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c57089c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344638:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c57089c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344641:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762914.344644:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c57089c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344658:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c57089c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344665:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff95d15055d200) 00010000:00010000:3.0:1789762914.344675:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762914.344679:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c57089c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344686:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f600/0xd08452c77c57089c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344698:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57088e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344702:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57088e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344707:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57088e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344726:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762914.344728:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57088e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344732:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57088e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344739:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055db00) 00010000:00010000:3.0:1789762914.344740:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762914.344744:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57088e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344756:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c57088e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344762:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570895 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344766:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570895 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344770:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570895 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344775:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762914.344778:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570895 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344784:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570895 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344792:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d15055de00) 00010000:00010000:3.0:1789762914.344793:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762914.344795:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570895 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344799:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570895 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344825:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570887 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea74 expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344844:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055db00) 00010000:00010000:3.0:1789762914.344871:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762914.344877:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c570887 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea74 expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.344903:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003e600, rc 0) 00000100:00100000:3.0:1789762914.344967:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+31:13448:x1876702140806528:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 633us (729us total) trans 0 rc 301/301 00000100:00100000:3.0:1789762914.344973:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 255 00000100:00100000:0.0:1789762914.345698:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762914.345750:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140806656 00000100:00100000:3.0:1789762914.345755:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140806656 00000100:00100000:3.0:1789762914.345785:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 256 00000100:00100000:3.0:1789762914.345793:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+31:13448:x1876702140806656:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789762914.345801:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762914.345811:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5708a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea7b expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.345887:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c5708aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.345895:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c5708aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.345902:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c5708aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762914.345916:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789762914.345925:0:13232:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762914.345956:0:13232:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c5708aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.345970:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c5708a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea7b expref: 33 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.345980:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c5708aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea7b expref: 32 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.345985:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d900) 00010000:00010000:3.0:1789762914.345987:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762914.345988:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003f400, rc 0) 00000100:00100000:3.0:1789762914.346020:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+32:13448:x1876702140806656:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 229us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762914.346025:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 256 00000100:00100000:0.0:1789762914.346967:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762914.347001:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140806912 00000100:00100000:2.0:1789762914.347007:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140806912 00000100:00100000:2.0:1789762914.347036:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 257 00000100:00100000:2.0:1789762914.347050:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+32:13448:x1876702140806912:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762914.347058:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762914.347066:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c5708b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea82 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347098:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347106:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347113:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347123:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347128:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347143:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762914.347188:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 16384 00010000:00010000:2.0:1789762914.347243:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347251:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347258:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347264:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762914.347268:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347275:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347287:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d900) 00010000:00010000:2.0:1789762914.347290:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762914.347294:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347299:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347307:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347320:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347325:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347328:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762914.347331:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347335:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347341:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d142a04100) 00010000:00010000:2.0:1789762914.347342:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762914.347344:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347348:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347368:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c5708b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea82 expref: 34 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347374:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d900) 00010000:00010000:2.0:1789762914.347376:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789762914.347378:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c5708b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea82 expref: 34 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.347384:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a894a00, rc 0) 00000100:00100000:2.0:1789762914.347420:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+33:13448:x1876702140806912:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 376us (456us total) trans 4294967514 rc 301/301 00000100:00100000:2.0:1789762914.347427:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 257 00000100:00100000:0.0:1789762914.348466:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762914.348517:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140807168 00000100:00100000:2.0:1789762914.348523:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140807168 00000100:00100000:2.0:1789762914.348580:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 258 00000100:00100000:2.0:1789762914.348590:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+33:13448:x1876702140807168:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:2.0:1789762914.348622:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c5708cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.348630:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c5708cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.348637:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c5708cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762914.348770:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c0240ac reply state 00000000bc73a070 transno 4294967515 ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c5708cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762914.348779:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762914.348784:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 16384 00000100:00100000:2.0:1789762914.348893:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+35:13448:x1876702140807168:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 302us (430us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789762914.348899:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 258 00010000:00010000:3.0:1789762914.349402:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c5708cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.349411:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c5708cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.349417:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c5708cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.349421:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762914.349424:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c5708cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.349429:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c5708cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.349500:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff95d142a04200) 00010000:00010000:3.0:1789762914.349502:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789762914.349506:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c5708cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.349512:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c5708cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762914.349550:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762914.349610:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140807424 00000100:00100000:2.0:1789762914.349617:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140807424 00000100:00100000:2.0:1789762914.349666:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:2.0:1789762914.349679:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d144cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+34:13448:x1876702140807424:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1789762914.349823:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d144cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+35:13448:x1876702140807424:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 147us (272us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789762914.350086:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:1.0:1789762914.354272:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762914.354321:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140807552 00000100:00100000:2.0:1789762914.354329:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140807552 00000100:00100000:2.0:1789762914.354383:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 259 00000100:00100000:2.0:1789762914.354394:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+35:13449:x1876702140807552:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:2.0:1789762914.354408:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762914.354421:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c5708d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea89 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354465:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354477:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354487:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354510:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354520:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354529:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354611:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c5708e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354636:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c5708e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354646:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c5708e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762914.354669:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 16384 00000004:00200000:2.0:1789762914.354672:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762914.354688:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c5708e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354699:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354706:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354713:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354721:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762914.354725:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354733:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354745:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d900) 00010000:00010000:2.0:1789762914.354748:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762914.354752:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354773:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c5708db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354793:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354801:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354808:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354814:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762914.354820:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354828:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354871:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d142a04100) 00010000:00010000:2.0:1789762914.354876:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762914.354881:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354888:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c5708e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354921:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c5708d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea89 expref: 37 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354938:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c5708e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea89 expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.354954:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff95d142a04900) 00010000:00010000:2.0:1789762914.354957:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762914.354960:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a894e00, rc 0) 00000100:00100000:2.0:1789762914.355005:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+36:13449:x1876702140807552:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 611us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762914.355018:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 259 00000100:00100000:3.0:1789762914.356020:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762914.356056:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140807808 00000100:00100000:1.0:1789762914.356062:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140807808 00000100:00100000:1.0:1789762914.356095:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 260 00000100:00100000:1.0:1789762914.356103:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+36:13449:x1876702140807808:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:1.0:1789762914.356126:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762914.356137:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c5708e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea89 expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.356160:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff95d142a04900) 00010000:00010000:1.0:1789762914.356166:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762914.356178:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5708f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.356184:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5708f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.356190:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5708f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762914.356296:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3067581 reply state 0000000045fcb01a transno 4294967517 ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5708f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762914.356302:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789762914.356305:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 16384 00000100:00100000:1.0:1789762914.356348:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+37:13449:x1876702140807808:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 245us (329us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789762914.356353:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 260 00010000:00010000:3.0:1789762914.357021:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5708f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.357032:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5708f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.357041:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5708f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.357047:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762914.357051:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5708f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.357059:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5708f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.357071:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff95d14abf2100) 00010000:00010000:3.0:1789762914.357073:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789762914.357076:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5708f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.357080:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d141524000/0xd08452c77c5708f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762914.376353:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762914.376412:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140807936 00000100:00100000:0.0:1789762914.376424:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140807936 00000100:00100000:0.0:1789762914.376500:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 261 00000100:00100000:0.0:1789762914.376514:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+36:13455:x1876702140807936:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762914.376550:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762914.376608:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c5708f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea90 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.376692:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c5708fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.376705:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c5708fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.376715:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c5708fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.376728:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570905 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.376733:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570905 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.376741:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570905 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.376916:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c57090c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.376923:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c57090c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.376930:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c57090c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762914.376960:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 16384 00000004:00200000:0.0:1789762914.376963:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762914.376982:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c57090c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377000:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c5708fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377006:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c5708fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377012:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c5708fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377018:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762914.377022:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c5708fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377028:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c5708fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377042:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d900) 00010000:00010000:0.0:1789762914.377044:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762914.377048:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c5708fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377053:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c5708fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377066:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570905 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377071:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570905 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377075:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570905 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377085:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762914.377089:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570905 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377095:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570905 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377104:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d151e90800) 00010000:00010000:0.0:1789762914.377106:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762914.377109:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570905 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377113:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639a00/0xd08452c77c570905 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377162:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c5708f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea90 expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377182:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c57090c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea90 expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.377192:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff95d151e90c00) 00010000:00010000:0.0:1789762914.377195:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789762914.377198:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d174639800, rc 0) 00000100:00100000:0.0:1789762914.377265:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+37:13455:x1876702140807936:12345-192.168.203.31@tcp:101:dd.500 Request processed in 756us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762914.377272:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 261 00000100:00100000:0.0:1789762914.378429:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762914.378484:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140808192 00000100:00100000:3.0:1789762914.378494:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140808192 00000100:00100000:3.0:1789762914.378582:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 262 00000100:00100000:3.0:1789762914.378599:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a2ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+37:13455:x1876702140808192:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:3.0:1789762914.378617:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762914.378635:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c570913 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea97 expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.378765:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c57091a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.378777:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c57091a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.378787:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c57091a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.378801:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570921 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.378807:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.378812:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762914.379321:0:13232:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11:0x0], index 0: 0 00010000:00010000:3.0:1789762914.379485:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c570928 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.379500:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c570928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.379507:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c570928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.379555:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c57091a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.379576:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c57091a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.379582:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c57091a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.379588:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762914.379591:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c57091a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.379596:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c57091a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.379606:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff95d151e90c00) 00010000:00010000:3.0:1789762914.379609:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762914.379612:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c57091a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.379617:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e600/0xd08452c77c57091a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762914.379630:0:13232:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011815c93 reply state 000000008b62d368 transno 4294967518 ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762914.379644:0:13232:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789762914.379674:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003fe00/0xd08452c77c570913 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea97 expref: 40 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.379691:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c570928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea97 expref: 39 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.379698:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff95d15055de00) 00010000:00010000:3.0:1789762914.379700:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762914.379702:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d16003f000, rc 0) 00000100:00100000:3.0:1789762914.379759:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a2ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+40:13455:x1876702140808192:12345-192.168.203.31@tcp:101:dd.500 Request processed in 1169us (1337us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789762914.379765:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 262 00010000:00010000:0.0:1789762914.380383:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.380393:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570921 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.380399:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570921 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.380403:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762914.380407:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570921 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.380413:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570921 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.380428:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x4009f790 (ffff95d15055db00) 00010000:00010000:0.0:1789762914.380430:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762914.380433:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570921 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.380438:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003e200/0xd08452c77c570921 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762914.383232:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762914.383274:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140808320 00000100:00100000:1.0:1789762914.383283:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140808320 00000100:00100000:1.0:1789762914.383354:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318364619590 time 318364742154 state 0x0 ref 1 00000100:00100000:1.0:1789762914.383371:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318414742154 time 318364742154 state 0x1 ref 1 00000100:00100000:1.0:1789762914.383400:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 2 deadline 318414742154 time 318856561333 state 0x0 ref 1 00000100:00100000:1.0:1789762914.383429:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+38:2342:x1876702140808320:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762914.383464:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789762914.383471:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570936 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.383484:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=318s v=(0 0) 00010000:00010000:1.0:1789762914.383488:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762914.383493:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.383504:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762914.406020:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967802 is committed 00002000:00010000:1.0:1789762914.406035:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 0 -> 1048576 00000001:00080000:0.0:1789762914.406037:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967809 is committed 00002000:00010000:1.0:1789762914.406041:0:11722:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb mtime from disk: 0 -> 1789762913 00002000:00010000:1.0:1789762914.406044:0:11722:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb ctime from disk: 0 -> 1789762913 00002000:00010000:1.0:1789762914.406046:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1789762914.406059:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.406074:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.406085:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570936 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.406107:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762914.406113:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570936 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.406121:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570936 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.406137:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570936 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.406142:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570936 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762914.406227:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140808320:12345-192.168.203.31@tcp:4:dd.500 Request processed in 22801us (22992us total) trans 4294967809 rc 0/0 00000100:00100000:1.0:1789762914.406237:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 497 00000100:00100000:1.0:1789762914.406246:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 2 deadline 318414742154 time 318856561333 state 0x2 ref 0 00000100:00100000:2.0:1789762914.421763:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762914.421822:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140808448 00000100:00100000:0.0:1789762914.421849:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140808448 00000100:00100000:0.0:1789762914.421895:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 2 deadline 318414742154 time 318856561333 state 0x0 ref 1 00000100:00100000:0.0:1789762914.421914:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 2 deadline 318906561333 time 318856561333 state 0x1 ref 1 00000100:00100000:0.0:1789762914.421948:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 1 deadline 318906561333 time 318895109427 state 0x0 ref 1 00000100:00100000:0.0:1789762914.421959:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140808448:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762914.421995:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 1048576, mtime: 0x6aad9d61, atime: 0x0, ctime: 0x6aad9d61, blocks: 0x803 00010000:00010000:0.0:1789762914.422001:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57093d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.422014:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=318s v=(0 0) 00010000:00010000:0.0:1789762914.422017:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762914.422022:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57093d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.422032:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57093d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762914.434553:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967810 is committed 00002000:00010000:1.0:1789762914.434583:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1789762914.434589:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1789762914.434600:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57093d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.434609:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57093d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.434626:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57093d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.434631:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762914.434635:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57093d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.434641:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57093d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.434656:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57093d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.434686:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c57093d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762914.434766:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140808448:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12805us (13003us total) trans 4294967810 rc 0/0 00000100:00100000:1.0:1789762914.434775:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 498 00000100:00100000:1.0:1789762914.434787:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 1 deadline 318906561333 time 318895109427 state 0x2 ref 0 00000100:00100000:1.0:1789762914.438008:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762914.438082:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140808576 00000100:00100000:2.0:1789762914.438091:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140808576 00000100:00100000:2.0:1789762914.438149:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 1 deadline 318906561333 time 318895109427 state 0x0 ref 1 00000100:00100000:2.0:1789762914.438163:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 1 deadline 318945109427 time 318895109427 state 0x1 ref 1 00000100:00100000:2.0:1789762914.438193:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318945109427 time 318911354826 state 0x0 ref 1 00000100:00100000:2.0:1789762914.438206:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140808576:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762914.438252:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 2097152, mtime: 0x6aad9d61, atime: 0x0, ctime: 0x6aad9d61, blocks: 0x1007 00010000:00010000:2.0:1789762914.438258:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570944 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.438269:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=318s v=(0 0) 00010000:00010000:2.0:1789762914.438272:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762914.438277:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.438316:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762914.452425:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967811 is committed 00002000:00010000:2.0:1789762914.452438:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1789762914.452443:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789762914.452454:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.452465:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.452472:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.452477:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762914.452481:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.452488:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570944 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.452501:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570944 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.452506:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570944 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762914.452628:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140808576:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14421us (14618us total) trans 4294967811 rc 0/0 00000100:00100000:2.0:1789762914.452640:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 499 00000100:00100000:2.0:1789762914.452652:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318945109427 time 318911354826 state 0x2 ref 0 00000100:00100000:1.0:1789762914.455769:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762914.455863:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140808704 00000100:00100000:0.0:1789762914.455872:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140808704 00000100:00100000:0.0:1789762914.455906:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318945109427 time 318911354826 state 0x0 ref 1 00000100:00100000:0.0:1789762914.455917:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318961354826 time 318911354826 state 0x1 ref 1 00000100:00100000:1.0:1789762914.488309:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318961354826 time 318961445018 state 0x0 ref 1 00000100:00100000:1.0:1789762914.488344:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140808704:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762914.488389:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 3145728, mtime: 0x6aad9d61, atime: 0x0, ctime: 0x6aad9d61, blocks: 0x1807 00010000:00010000:1.0:1789762914.488398:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c57094b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.488413:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=318s v=(0 0) 00010000:00010000:1.0:1789762914.488417:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762914.488423:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c57094b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.488437:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c57094b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762914.501457:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967812 is committed 00002000:00010000:1.0:1789762914.501483:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1789762914.501492:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1789762914.501508:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c57094b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.501524:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c57094b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.501536:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c57094b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.501544:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762914.501587:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c57094b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.501600:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c57094b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.501631:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c57094b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.501637:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c57094b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762914.501730:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140808704:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13386us (45960us total) trans 4294967812 rc 0/0 00000100:00100000:1.0:1789762914.501742:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 500 00000100:00100000:1.0:1789762914.501757:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318961354826 time 318961445018 state 0x2 ref 0 00000100:00100000:3.0:1789762914.505186:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762914.505278:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140808832 00000100:00100000:2.0:1789762914.505287:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140808832 00000100:00100000:2.0:1789762914.505350:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 318961354826 time 318961445018 state 0x0 ref 1 00000100:00100000:2.0:1789762914.505368:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319011445018 time 318961445018 state 0x1 ref 1 00000100:00100000:0.0:1789762914.538458:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319011445018 time 319011604388 state 0x0 ref 1 00000100:00100000:0.0:1789762914.538499:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140808832:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762914.538554:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 4194304, mtime: 0x6aad9d61, atime: 0x0, ctime: 0x6aad9d61, blocks: 0x2007 00010000:00010000:0.0:1789762914.538592:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570952 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.538618:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:0.0:1789762914.538625:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762914.538636:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.538662:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762914.558874:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967813 is committed 00002000:00010000:1.0:1789762914.558994:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1789762914.558999:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1789762914.559009:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.559019:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.559025:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.559040:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762914.559044:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.559051:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570952 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.559066:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570952 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.559093:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570952 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762914.559206:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140808832:12345-192.168.203.31@tcp:4:dd.500 Request processed in 20707us (54018us total) trans 4294967813 rc 0/0 00000100:00100000:1.0:1789762914.559236:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 501 00000100:00100000:1.0:1789762914.559245:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319011445018 time 319011604388 state 0x2 ref 0 00000100:00100000:3.0:1789762914.563230:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762914.563309:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140808960 00000100:00100000:2.0:1789762914.563322:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140808960 00000100:00100000:2.0:1789762914.563382:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319011445018 time 319011604388 state 0x0 ref 1 00000100:00100000:2.0:1789762914.563400:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319061604388 time 319011604388 state 0x1 ref 1 00000100:00100000:2.0:1789762914.588619:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319061604388 time 319061774021 state 0x0 ref 1 00000100:00100000:2.0:1789762914.588639:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140808960:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762914.588705:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 5242880, mtime: 0x6aad9d61, atime: 0x0, ctime: 0x6aad9d61, blocks: 0x2807 00010000:00010000:2.0:1789762914.588715:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570959 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.588751:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1789762914.588756:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762914.588763:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.588778:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762914.606138:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1789762914.606146:0:13229:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb mtime from disk: 1789762913 -> 1789762914 00002000:00010000:0.0:1789762914.606149:0:13229:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb ctime from disk: 1789762913 -> 1789762914 00002000:00010000:0.0:1789762914.606152:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 10247 -> 12295 00000001:00080000:3.0:1789762914.606156:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967814 is committed 00010000:00010000:0.0:1789762914.606167:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.606182:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.606193:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.606215:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762914.606220:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.606230:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570959 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.606248:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570959 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.606256:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570959 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762914.606358:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140808960:12345-192.168.203.31@tcp:4:dd.500 Request processed in 17718us (43121us total) trans 4294967814 rc 0/0 00000100:00100000:0.0:1789762914.606375:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 502 00000100:00100000:0.0:1789762914.606389:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319061604388 time 319061774021 state 0x2 ref 0 00000100:00100000:3.0:1789762914.609483:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762914.609596:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140809088 00000100:00100000:1.0:1789762914.609607:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140809088 00000100:00100000:1.0:1789762914.609657:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319061604388 time 319061774021 state 0x0 ref 1 00000100:00100000:1.0:1789762914.609673:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319111774021 time 319061774021 state 0x1 ref 1 00000100:00100000:1.0:1789762914.638730:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319111774021 time 319111873687 state 0x0 ref 1 00000100:00100000:1.0:1789762914.638782:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140809088:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762914.638922:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 6291456, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x3007 00010000:00010000:1.0:1789762914.638936:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570960 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.638968:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:1.0:1789762914.638975:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762914.638983:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.639002:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762914.662114:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1789762914.662124:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 12295 -> 14343 00000001:00080000:3.0:1789762914.662157:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967815 is committed 00010000:00010000:0.0:1789762914.662163:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.662183:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.662216:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570960 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.662225:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762914.662232:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570960 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.662243:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570960 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.662268:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570960 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.662278:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570960 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762914.662398:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140809088:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23625us (52914us total) trans 4294967815 rc 0/0 00000100:00100000:0.0:1789762914.662412:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 503 00000100:00100000:0.0:1789762914.662428:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319111774021 time 319111873687 state 0x2 ref 0 00000100:00100000:2.0:1789762914.666706:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762914.666807:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140809216 00000100:00100000:1.0:1789762914.666821:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140809216 00000100:00100000:1.0:1789762914.666916:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319111774021 time 319111873687 state 0x0 ref 1 00000100:00100000:1.0:1789762914.666938:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319161873687 time 319111873687 state 0x1 ref 1 00000100:00100000:0.0:1789762914.688868:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319161873687 time 319161987222 state 0x0 ref 1 00000100:00100000:0.0:1789762914.688898:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140809216:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762914.688959:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 7340032, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x3807 00010000:00010000:0.0:1789762914.688984:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570967 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.689007:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:0.0:1789762914.689014:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762914.689022:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.689042:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762914.704302:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967816 is committed 00002000:00010000:3.0:1789762914.704360:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:3.0:1789762914.704365:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1789762914.704376:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.704386:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570967 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.704407:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570967 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.704413:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762914.704417:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570967 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.704424:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570967 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.704438:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570967 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.704444:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570967 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762914.704510:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140809216:12345-192.168.203.31@tcp:4:dd.500 Request processed in 15621us (37809us total) trans 4294967816 rc 0/0 00000100:00100000:3.0:1789762914.704519:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 504 00000100:00100000:3.0:1789762914.704528:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319161873687 time 319161987222 state 0x2 ref 0 00000100:00100000:1.0:1789762914.706931:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762914.707015:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140809344 00000100:00100000:0.0:1789762914.707024:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140809344 00000100:00100000:0.0:1789762914.707063:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319161873687 time 319161987222 state 0x0 ref 1 00000100:00100000:0.0:1789762914.707074:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319211987222 time 319161987222 state 0x1 ref 1 00000100:00100000:2.0:1789762914.738909:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319211987222 time 319212062140 state 0x0 ref 1 00000100:00100000:2.0:1789762914.738931:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140809344:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762914.738974:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 8388608, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x4007 00010000:00010000:2.0:1789762914.738983:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c57096e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.738999:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1789762914.739004:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762914.739011:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c57096e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.739026:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c57096e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762914.750008:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 8388608 -> 9437184 00000001:00080000:3.0:1789762914.750013:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967817 is committed 00002000:00010000:0.0:1789762914.750014:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:0.0:1789762914.750032:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c57096e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.750044:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c57096e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.750067:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c57096e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.750075:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762914.750080:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c57096e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.750090:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c57096e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.750108:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c57096e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.750117:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c57096e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762914.750191:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140809344:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11265us (43257us total) trans 4294967817 rc 0/0 00000100:00100000:0.0:1789762914.750202:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 505 00000100:00100000:0.0:1789762914.750214:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319211987222 time 319212062140 state 0x2 ref 0 00000100:00100000:3.0:1789762914.752375:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762914.752418:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140809472 00000100:00100000:0.0:1789762914.752426:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140809472 00000100:00100000:0.0:1789762914.752468:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319211987222 time 319212062140 state 0x0 ref 1 00000100:00100000:0.0:1789762914.752493:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319262062140 time 319212062140 state 0x1 ref 1 00000100:00100000:2.0:1789762914.788985:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319262062140 time 319262138146 state 0x0 ref 1 00000100:00100000:2.0:1789762914.789015:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140809472:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762914.789056:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 9437184, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x4807 00010000:00010000:2.0:1789762914.789062:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c570975 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.789075:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1789762914.789079:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762914.789083:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c570975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.789093:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c570975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762914.799816:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967818 is committed 00002000:00010000:1.0:1789762914.799830:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:1.0:1789762914.799860:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:1.0:1789762914.799871:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c570975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.799893:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c570975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.799899:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c570975 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.799904:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762914.799908:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c570975 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.799915:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c570975 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.799929:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c570975 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.799934:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d673abd/0xd08452c77c570975 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762914.800001:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140809472:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10989us (47623us total) trans 4294967818 rc 0/0 00000100:00100000:1.0:1789762914.800008:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 506 00000100:00100000:1.0:1789762914.800017:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319262062140 time 319262138146 state 0x2 ref 0 00000100:00100000:3.0:1789762914.802244:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762914.802318:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140809600 00000100:00100000:0.0:1789762914.802326:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140809600 00000100:00100000:0.0:1789762914.802363:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319262062140 time 319262138146 state 0x0 ref 1 00000100:00100000:0.0:1789762914.802374:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319312138146 time 319262138146 state 0x1 ref 1 00000100:00100000:1.0:1789762914.839087:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319312138146 time 319312235516 state 0x0 ref 1 00000100:00100000:1.0:1789762914.839124:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140809600:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762914.839171:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 10485760, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x5007 00010000:00010000:1.0:1789762914.839178:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c57097c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.839192:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:1.0:1789762914.839196:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762914.839200:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c57097c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.839211:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c57097c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762914.850240:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967819 is committed 00002000:00010000:1.0:1789762914.850262:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:1.0:1789762914.850269:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 20487 -> 22535 00010000:00010000:1.0:1789762914.850282:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c57097c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.850297:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c57097c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.850308:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c57097c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.850316:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762914.850327:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c57097c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.850338:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c57097c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.850352:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c57097c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.850358:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c57097c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762914.850421:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140809600:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11301us (48175us total) trans 4294967819 rc 0/0 00000100:00100000:1.0:1789762914.850429:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 507 00000100:00100000:1.0:1789762914.850438:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319312138146 time 319312235516 state 0x2 ref 0 00000100:00100000:3.0:1789762914.852612:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762914.852675:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140809728 00000100:00100000:0.0:1789762914.852684:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140809728 00000100:00100000:0.0:1789762914.852722:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319312138146 time 319312235516 state 0x0 ref 1 00000100:00100000:0.0:1789762914.852733:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319362235516 time 319312235516 state 0x1 ref 1 00000100:00100000:1.0:1789762914.889164:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319362235516 time 319362316305 state 0x0 ref 1 00000100:00100000:1.0:1789762914.889185:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140809728:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762914.889226:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 11534336, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x5807 00010000:00010000:1.0:1789762914.889233:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570983 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.889246:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:1.0:1789762914.889258:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762914.889263:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.889274:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762914.900022:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 11534336 -> 12582912 00000001:00080000:3.0:1789762914.900025:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967820 is committed 00002000:00010000:1.0:1789762914.900029:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 22535 -> 24583 00010000:00010000:1.0:1789762914.900042:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.900054:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.900066:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570983 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.900075:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762914.900080:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570983 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.900091:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570983 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.900108:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570983 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.900130:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570983 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762914.900202:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140809728:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11021us (47587us total) trans 4294967820 rc 0/0 00000100:00100000:1.0:1789762914.900215:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 508 00000100:00100000:1.0:1789762914.900228:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319362235516 time 319362316305 state 0x2 ref 0 00000100:00100000:3.0:1789762914.902371:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762914.902410:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140809856 00000100:00100000:1.0:1789762914.902418:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140809856 00000100:00100000:1.0:1789762914.902458:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319362235516 time 319362316305 state 0x0 ref 1 00000100:00100000:1.0:1789762914.902468:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319412316305 time 319362316305 state 0x1 ref 1 00000100:00100000:2.0:1789762914.939250:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319412316305 time 319412401626 state 0x0 ref 1 00000100:00100000:2.0:1789762914.939273:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140809856:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762914.939321:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 12582912, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x6007 00010000:00010000:2.0:1789762914.939328:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c57098a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.939349:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1789762914.939353:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762914.939357:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c57098a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.939382:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c57098a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762914.950088:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:3.0:1789762914.950095:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 24583 -> 26631 00010000:00010000:3.0:1789762914.950106:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c57098a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.950115:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c57098a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.950122:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c57098a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.950127:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762914.950130:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c57098a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.950138:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c57098a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.950151:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c57098a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762914.950156:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c57098a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762914.950231:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+8:2343:x1876702140809856:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10962us (47855us total) trans 4294967821 rc 0/0 00000100:00100000:3.0:1789762914.950250:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 509 00000100:00100000:3.0:1789762914.950261:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319412316305 time 319412401626 state 0x2 ref 0 00000001:00080000:3.0:1789762914.950294:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967821 is committed 00000100:00100000:2.0:1789762914.952358:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762914.952444:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140809984 00000100:00100000:1.0:1789762914.952453:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140809984 00000100:00100000:1.0:1789762914.952493:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319412316305 time 319412401626 state 0x0 ref 1 00000100:00100000:1.0:1789762914.952504:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319462401626 time 319412401626 state 0x1 ref 1 00000100:00100000:0.0:1789762914.989365:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319462401626 time 319462518490 state 0x0 ref 1 00000100:00100000:0.0:1789762914.989384:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140809984:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762914.989435:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 13631488, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x6807 00010000:00010000:0.0:1789762914.989443:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570991 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.989457:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:0.0:1789762914.989467:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762914.989473:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.989487:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762914.993486:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000001:00080000:1.0:1789762914.993527:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:1.0:1789762914.993594:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000004:00080000:1.0:1789762914.993610:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00000004:00080000:1.0:1789762914.993624:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000100:00100000:1.0:1789762914.993796:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149038848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789762914.993883:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762914.993989:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789762914.993991:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149038848 00000100:00100000:2.0:1789762914.993998:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149038848 00000100:00100000:0.0:1789762914.994003:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149038976:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1789762914.994033:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762914.994038:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762914.994048:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149038976 00000100:00100000:2.0:1789762914.994053:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149038976 00000100:00100000:1.0:1789762914.994067:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789762914.994080:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149038848:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789762914.994089:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789762914.994099:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149038976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789762914.994105:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:11 count 1 00002000:00080000:2.0:1789762914.994114:0:8803:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:16 count 1 00002000:00010000:1.0:1789762914.994138:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 8388608, mtime: 0x6aad9d61, atime: 0x0, ctime: 0x6aad9d61, blocks: 0x1 00002000:00010000:2.0:1789762914.994139:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 8388608, mtime: 0x6aad9d61, atime: 0x0, ctime: 0x6aad9d61, blocks: 0x4007 00010000:00010000:2.0:1789762914.994149:0:8803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57099f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.994152:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb19ad0/0xd08452c77c570998 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.994171:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=319s v=(0 0) 00010000:00010000:1.0:1789762914.994174:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1789762914.994176:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762914.994182:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762914.994184:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57099f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.994190:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb19ad0/0xd08452c77c570998 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.994196:0:8803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57099f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.994210:0:8803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57099f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.994212:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfb19ad0/0xd08452c77c570998 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.994228:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb19ad0/0xd08452c77c570998 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.994231:0:8803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57099f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762914.994249:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb19ad0/0xd08452c77c570998 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762914.994260:0:8803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762914.994270:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789762914.994811:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789762914.994818:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57099f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.994827:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762914.994853:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57099f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.994863:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57099f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.994880:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57099f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.994887:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57099f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.994919:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762914.994922:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfb19ad0/0xd08452c77c570998 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.994928:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762914.994932:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb19ad0/0xd08452c77c570998 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.994938:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb19ad0/0xd08452c77c570998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.994947:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfb19ad0/0xd08452c77c570998 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.994953:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb19ad0/0xd08452c77c570998 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762914.994974:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762914.994978:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762914.994981:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762914.995225:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149038976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1127us (1186us total) trans 4294967823 rc 0/0 00000100:00100000:2.0:1789762914.995233:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00010000:2.0:1789762914.995255:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789762914.995261:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789762914.995286:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d043c3b100/2, rc 0, transno 4294967823 00000100:00100000:2.0:1789762914.995299:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149038976:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762914.995343:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149038848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1263us (1458us total) trans 4294967397 rc 0/0 00000004:00080000:0.0:1789762914.995359:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d044e54700/2, rc 0, transno 4294967397 00000100:00100000:1.0:1789762914.995366:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789762914.995380:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149038848:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1789762915.000767:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967822 is committed 00002000:00010000:0.0:1789762915.000781:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:0.0:1789762915.000786:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 26631 -> 28679 00010000:00010000:0.0:1789762915.000794:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.000808:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.000814:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570991 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.000819:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762915.000821:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570991 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.000826:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570991 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.000854:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570991 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.000860:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570991 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762915.000905:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140809984:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11525us (48547us total) trans 4294967822 rc 0/0 00000100:00100000:0.0:1789762915.000914:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 510 00000100:00100000:0.0:1789762915.000923:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319462401626 time 319462518490 state 0x2 ref 0 00000100:00100000:2.0:1789762915.003179:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762915.003259:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140810112 00000100:00100000:1.0:1789762915.003265:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140810112 00000100:00080000:2.0:1789762915.003299:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762915.003308:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319462401626 time 319462518490 state 0x0 ref 1 00000100:00100000:1.0:1789762915.003319:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319512518490 time 319462518490 state 0x1 ref 1 00000100:00100000:0.0:1789762915.039486:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319512518490 time 319512635099 state 0x0 ref 1 00000100:00100000:0.0:1789762915.039531:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140810112:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762915.039595:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 14680064, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x7007 00010000:00010000:0.0:1789762915.039603:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.039617:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:0.0:1789762915.039627:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762915.039632:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.039643:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762915.052101:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967823 is committed 00000001:00080000:1.0:1789762915.052114:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967824 is committed 00002000:00010000:0.0:1789762915.052133:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:0.0:1789762915.052138:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 28679 -> 30727 00010000:00010000:0.0:1789762915.052148:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.052157:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.052164:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.052169:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762915.052179:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.052186:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.052200:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.052205:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762915.052262:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140810112:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12740us (49083us total) trans 4294967824 rc 0/0 00000100:00100000:0.0:1789762915.052271:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 511 00000100:00100000:0.0:1789762915.052281:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319512518490 time 319512635099 state 0x2 ref 0 00000100:00100000:0.0:1789762915.054390:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762915.054430:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140810240 00000100:00100000:3.0:1789762915.054437:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140810240 00000100:00100000:3.0:1789762915.054473:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319512518490 time 319512635099 state 0x0 ref 1 00000100:00100000:3.0:1789762915.054485:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319562635099 time 319512635099 state 0x1 ref 1 00000100:00100000:0.0:1789762915.089591:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319562635099 time 319562745058 state 0x0 ref 1 00000100:00100000:0.0:1789762915.089611:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140810240:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762915.089652:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 15728640, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x7807 00010000:00010000:0.0:1789762915.089658:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.089670:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:0.0:1789762915.089683:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762915.089688:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.089699:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762915.100455:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967825 is committed 00002000:00010000:3.0:1789762915.100511:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:3.0:1789762915.100517:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 30727 -> 32775 00010000:00010000:3.0:1789762915.100529:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.100543:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.100568:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.100574:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762915.100578:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.100585:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.100606:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.100613:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c5709ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762915.100671:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140810240:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11065us (46280us total) trans 4294967825 rc 0/0 00000100:00100000:3.0:1789762915.100679:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 512 00000100:00100000:3.0:1789762915.100688:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319562635099 time 319562745058 state 0x2 ref 0 00000100:00100000:2.0:1789762915.102784:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762915.102829:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140810368 00000100:00100000:0.0:1789762915.102852:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140810368 00000100:00100000:0.0:1789762915.102890:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319562635099 time 319562745058 state 0x0 ref 1 00000100:00100000:0.0:1789762915.102900:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319612745058 time 319562745058 state 0x1 ref 1 00000100:00100000:2.0:1789762915.139689:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319612745058 time 319612839432 state 0x0 ref 1 00000100:00100000:2.0:1789762915.139715:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140810368:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762915.139761:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 16777216, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x8007 00010000:00010000:2.0:1789762915.139768:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762915.139782:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1789762915.139787:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762915.139793:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762915.139824:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762915.151610:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 16777216 -> 17825792 00000001:00080000:2.0:1789762915.151610:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967826 is committed 00002000:00010000:1.0:1789762915.151617:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 32775 -> 34823 00010000:00010000:1.0:1789762915.151628:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.151638:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.151645:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.151650:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762915.151653:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.151659:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.151682:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.151688:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762915.151746:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140810368:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12041us (48963us total) trans 4294967826 rc 0/0 00000100:00100000:1.0:1789762915.151754:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 513 00000100:00100000:1.0:1789762915.151762:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319612745058 time 319612839432 state 0x2 ref 0 00000100:00100000:2.0:1789762915.153868:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762915.153945:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140810496 00000100:00100000:0.0:1789762915.153953:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140810496 00000100:00100000:0.0:1789762915.153991:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319612745058 time 319612839432 state 0x0 ref 1 00000100:00100000:0.0:1789762915.154002:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319662839432 time 319612839432 state 0x1 ref 1 00000100:00100000:1.0:1789762915.189764:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319662839432 time 319662915972 state 0x0 ref 1 00000100:00100000:1.0:1789762915.189782:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140810496:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762915.189824:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 17825792, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x8807 00010000:00010000:1.0:1789762915.189831:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c5709bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.189866:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:1.0:1789762915.189869:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762915.189874:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c5709bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.189884:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c5709bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762915.200749:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967827 is committed 00002000:00010000:0.0:1789762915.200769:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:0.0:1789762915.200774:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 34823 -> 36871 00010000:00010000:0.0:1789762915.200784:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c5709bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.200793:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c5709bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.200810:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c5709bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.200815:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762915.200819:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c5709bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.200825:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c5709bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.200855:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c5709bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.200861:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c5709bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762915.200917:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140810496:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11138us (47049us total) trans 4294967827 rc 0/0 00000100:00100000:0.0:1789762915.200926:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 514 00000100:00100000:0.0:1789762915.200935:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319662839432 time 319662915972 state 0x2 ref 0 00000100:00100000:3.0:1789762915.202903:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762915.202933:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140810624 00000100:00100000:0.0:1789762915.202940:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140810624 00000100:00100000:0.0:1789762915.202974:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319662839432 time 319662915972 state 0x0 ref 1 00000100:00100000:0.0:1789762915.202992:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319712915972 time 319662915972 state 0x1 ref 1 00000100:00100000:1.0:1789762915.239899:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319712915972 time 319713045229 state 0x0 ref 1 00000100:00100000:1.0:1789762915.239929:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140810624:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762915.239993:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 18874368, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x9007 00010000:00010000:1.0:1789762915.240002:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c5709c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.240016:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:1.0:1789762915.240020:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762915.240025:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c5709c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.240036:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c5709c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762915.251773:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967828 is committed 00002000:00010000:3.0:1789762915.251806:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:3.0:1789762915.251809:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 36871 -> 38919 00010000:00010000:3.0:1789762915.251819:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c5709c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.251827:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c5709c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.251851:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c5709c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.251867:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762915.251870:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c5709c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.251877:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c5709c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.251891:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c5709c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.251896:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c5709c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762915.251952:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140810624:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12033us (49048us total) trans 4294967828 rc 0/0 00000100:00100000:3.0:1789762915.251960:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 515 00000100:00100000:3.0:1789762915.251968:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319712915972 time 319713045229 state 0x2 ref 0 00000100:00100000:3.0:1789762915.254073:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762915.254117:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140810752 00000100:00100000:1.0:1789762915.254125:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140810752 00000100:00100000:1.0:1789762915.254161:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319712915972 time 319713045229 state 0x0 ref 1 00000100:00100000:1.0:1789762915.254172:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319763045229 time 319713045229 state 0x1 ref 1 00000100:00100000:3.0:1789762915.289955:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319763045229 time 319763109253 state 0x0 ref 1 00000100:00100000:3.0:1789762915.289973:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140810752:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762915.290012:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 19922944, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0x9807 00010000:00010000:3.0:1789762915.290029:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.290043:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:3.0:1789762915.290048:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762915.290054:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.290068:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762915.300406:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967829 is committed 00002000:00010000:3.0:1789762915.300426:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:3.0:1789762915.300433:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 38919 -> 40967 00010000:00010000:3.0:1789762915.300444:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.300453:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.300460:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.300464:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fe00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762915.300468:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.300475:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.300494:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.300500:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762915.300564:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140810752:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10584us (46482us total) trans 4294967829 rc 0/0 00000100:00100000:3.0:1789762915.300572:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 516 00000100:00100000:3.0:1789762915.300580:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319763045229 time 319763109253 state 0x2 ref 0 00000100:00100000:3.0:1789762915.302735:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762915.302812:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140810880 00000100:00100000:0.0:1789762915.302820:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140810880 00000100:00100000:0.0:1789762915.302874:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319763045229 time 319763109253 state 0x0 ref 1 00000100:00100000:0.0:1789762915.302886:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319813109253 time 319763109253 state 0x1 ref 1 00000100:00100000:1.0:1789762915.340025:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319813109253 time 319813180717 state 0x0 ref 1 00000100:00100000:1.0:1789762915.340043:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140810880:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762915.340085:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 20971520, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0xa007 00010000:00010000:1.0:1789762915.340092:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.340102:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:1.0:1789762915.340105:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762915.340109:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.340119:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762915.351707:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 20971520 -> 22020096 00000001:00080000:0.0:1789762915.351710:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967830 is committed 00002000:00010000:1.0:1789762915.351717:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 40967 -> 43015 00010000:00010000:1.0:1789762915.351729:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.351740:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.351747:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.351753:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762915.351756:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.351773:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.351789:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.351794:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762915.351887:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140810880:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11846us (49150us total) trans 4294967830 rc 0/0 00000100:00100000:1.0:1789762915.351896:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 517 00000100:00100000:1.0:1789762915.351906:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319813109253 time 319813180717 state 0x2 ref 0 00000100:00100000:3.0:1789762915.354179:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762915.354232:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140811008 00000100:00100000:1.0:1789762915.354242:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140811008 00000100:00100000:1.0:1789762915.354284:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319813109253 time 319813180717 state 0x0 ref 1 00000100:00100000:1.0:1789762915.354296:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319863180717 time 319813180717 state 0x1 ref 1 00010000:00010000:2.0:1789762915.366929:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762915.390100:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319863180717 time 319863256172 state 0x0 ref 1 00000100:00100000:0.0:1789762915.390117:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140811008:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762915.390155:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 22020096, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0xa807 00010000:00010000:0.0:1789762915.390161:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.390173:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:0.0:1789762915.390177:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762915.390181:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.390191:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762915.400544:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:0.0:1789762915.400549:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 43015 -> 45063 00010000:00010000:0.0:1789762915.400570:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.400580:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.400587:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.400591:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762915.400595:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.400601:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.400614:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.400619:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762915.400673:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140811008:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10560us (46494us total) trans 4294967831 rc 0/0 00000100:00100000:0.0:1789762915.400688:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 518 00000100:00100000:0.0:1789762915.400696:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319863180717 time 319863256172 state 0x2 ref 0 00000001:00080000:0.0:1789762915.400725:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967831 is committed 00000100:00100000:3.0:1789762915.402807:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762915.402859:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140811136 00000100:00100000:1.0:1789762915.402867:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140811136 00000100:00100000:1.0:1789762915.402903:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319863180717 time 319863256172 state 0x0 ref 1 00000100:00100000:1.0:1789762915.402913:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319913256172 time 319863256172 state 0x1 ref 1 00000100:00100000:0.0:1789762915.440281:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319913256172 time 319913423846 state 0x0 ref 1 00000100:00100000:0.0:1789762915.440316:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140811136:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762915.440384:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 23068672, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0xb007 00010000:00010000:0.0:1789762915.440395:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.440416:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:0.0:1789762915.440422:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762915.440429:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.440446:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762915.456772:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967832 is committed 00002000:00010000:0.0:1789762915.456816:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:0.0:1789762915.456821:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 45063 -> 47111 00010000:00010000:0.0:1789762915.456853:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.456864:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.456879:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.456885:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762915.456888:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.456895:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.456909:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.456915:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c5709de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762915.456985:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140811136:12345-192.168.203.31@tcp:4:dd.500 Request processed in 16680us (54174us total) trans 4294967832 rc 0/0 00000100:00100000:0.0:1789762915.456997:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 519 00000100:00100000:0.0:1789762915.457009:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319913256172 time 319913423846 state 0x2 ref 0 00000100:00100000:3.0:1789762915.459511:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762915.459585:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140811264 00000100:00100000:1.0:1789762915.459593:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140811264 00000100:00100000:1.0:1789762915.459633:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319913256172 time 319913423846 state 0x0 ref 1 00000100:00100000:1.0:1789762915.459645:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319963423846 time 319913423846 state 0x1 ref 1 00000100:00100000:2.0:1789762915.490334:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319963423846 time 319963489360 state 0x0 ref 1 00000100:00100000:2.0:1789762915.490353:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140811264:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762915.490398:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 24117248, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0xb807 00010000:00010000:2.0:1789762915.490405:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762915.490417:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1789762915.490420:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762915.490425:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762915.490434:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762915.501655:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967833 is committed 00002000:00010000:0.0:1789762915.501674:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:0.0:1789762915.501679:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 47111 -> 49159 00010000:00010000:0.0:1789762915.501689:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.501721:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.501727:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.501732:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762915.501736:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.501743:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.501756:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.501761:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075d71727/0xd08452c77c5709e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762915.501827:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140811264:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11478us (42315us total) trans 4294967833 rc 0/0 00000100:00100000:0.0:1789762915.501874:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 520 00000100:00100000:0.0:1789762915.501884:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319963423846 time 319963489360 state 0x2 ref 0 00000100:00100000:3.0:1789762915.504200:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762915.504262:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140811392 00000100:00100000:0.0:1789762915.504276:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140811392 00000100:00100000:0.0:1789762915.504309:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 319963423846 time 319963489360 state 0x0 ref 1 00000100:00100000:0.0:1789762915.504331:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320013489360 time 319963489360 state 0x1 ref 1 00000100:00100000:3.0:1789762915.540436:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320013489360 time 320013591356 state 0x0 ref 1 00000100:00100000:3.0:1789762915.540455:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140811392:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762915.540492:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 25165824, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0xc007 00010000:00010000:3.0:1789762915.540498:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.540521:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1789762915.540525:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762915.540530:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.540542:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762915.552076:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967834 is committed 00002000:00010000:3.0:1789762915.552089:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:3.0:1789762915.552094:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 49159 -> 51207 00010000:00010000:3.0:1789762915.552104:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.552114:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.552121:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.552126:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fe00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762915.552130:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.552136:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.552159:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.552165:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762915.552242:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140811392:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11788us (48038us total) trans 4294967834 rc 0/0 00000100:00100000:3.0:1789762915.552249:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 521 00000100:00100000:3.0:1789762915.552257:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320013489360 time 320013591356 state 0x2 ref 0 00000100:00100000:3.0:1789762915.554527:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762915.554595:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140811520 00000100:00100000:0.0:1789762915.554603:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140811520 00000100:00100000:0.0:1789762915.554650:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320013489360 time 320013591356 state 0x0 ref 1 00000100:00100000:0.0:1789762915.554661:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320063591356 time 320013591356 state 0x1 ref 1 00000100:00100000:3.0:1789762915.590545:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320063591356 time 320063698863 state 0x0 ref 1 00000100:00100000:3.0:1789762915.590593:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140811520:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762915.590632:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 26214400, mtime: 0x6aad9d62, atime: 0x0, ctime: 0x6aad9d62, blocks: 0xc807 00010000:00010000:3.0:1789762915.590639:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.590662:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1789762915.590665:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762915.590669:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.590693:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762915.602000:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967835 is committed 00002000:00010000:1.0:1789762915.602019:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:1.0:1789762915.602024:0:11723:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb mtime from disk: 1789762914 -> 1789762915 00002000:00010000:1.0:1789762915.602027:0:11723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb ctime from disk: 1789762914 -> 1789762915 00002000:00010000:1.0:1789762915.602029:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 51207 -> 53255 00010000:00010000:1.0:1789762915.602038:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.602047:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.602055:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.602061:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fe00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762915.602066:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.602076:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.602109:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.602116:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c5709f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762915.602177:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140811520:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11600us (47647us total) trans 4294967835 rc 0/0 00000100:00100000:1.0:1789762915.602185:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 522 00000100:00100000:1.0:1789762915.602194:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320063591356 time 320063698863 state 0x2 ref 0 00000100:00100000:3.0:1789762915.604473:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762915.604531:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140811648 00000100:00100000:0.0:1789762915.604541:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140811648 00000100:00100000:0.0:1789762915.604607:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320063591356 time 320063698863 state 0x0 ref 1 00000100:00100000:0.0:1789762915.604619:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320113698863 time 320063698863 state 0x1 ref 1 00000100:00100000:1.0:1789762915.640689:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320113698863 time 320113834524 state 0x0 ref 1 00000100:00100000:1.0:1789762915.640718:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140811648:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762915.640780:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 27262976, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0xd007 00010000:00010000:1.0:1789762915.640788:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.640800:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:1.0:1789762915.640804:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762915.640808:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.640818:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762915.652134:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967836 is committed 00002000:00010000:3.0:1789762915.652184:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:3.0:1789762915.652190:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 53255 -> 55303 00010000:00010000:3.0:1789762915.652203:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.652218:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.652229:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.652238:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762915.652243:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.652250:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.652264:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.652279:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5709fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762915.652340:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140811648:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11630us (47865us total) trans 4294967836 rc 0/0 00000100:00100000:3.0:1789762915.652348:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 523 00000100:00100000:3.0:1789762915.652356:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320113698863 time 320113834524 state 0x2 ref 0 00000100:00100000:3.0:1789762915.654404:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762915.654480:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140811776 00000100:00100000:1.0:1789762915.654489:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140811776 00000100:00100000:1.0:1789762915.654537:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320113698863 time 320113834524 state 0x0 ref 1 00000100:00100000:1.0:1789762915.654569:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320163834524 time 320113834524 state 0x1 ref 1 00000100:00100000:1.0:1789762915.690737:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320163834524 time 320163893335 state 0x0 ref 1 00000100:00100000:1.0:1789762915.690753:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140811776:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762915.690788:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 28311552, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0xd807 00010000:00010000:1.0:1789762915.690795:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.690807:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:1.0:1789762915.690810:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762915.690815:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.690825:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762915.702101:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967837 is committed 00002000:00010000:1.0:1789762915.702155:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:1.0:1789762915.702160:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 55303 -> 57351 00010000:00010000:1.0:1789762915.702170:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.702186:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.702192:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.702198:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762915.702201:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.702208:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.702222:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.702227:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762915.702284:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140811776:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11533us (47879us total) trans 4294967837 rc 0/0 00000100:00100000:1.0:1789762915.702292:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 524 00000100:00100000:1.0:1789762915.702301:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320163834524 time 320163893335 state 0x2 ref 0 00000100:00100000:3.0:1789762915.704477:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762915.704529:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140811904 00000100:00100000:1.0:1789762915.704547:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140811904 00000100:00100000:1.0:1789762915.704596:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320163834524 time 320163893335 state 0x0 ref 1 00000100:00100000:1.0:1789762915.704607:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320213893335 time 320163893335 state 0x1 ref 1 00000100:00100000:3.0:1789762915.740880:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320213893335 time 320214033358 state 0x0 ref 1 00000100:00100000:3.0:1789762915.740901:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140811904:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762915.740944:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 29360128, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0xe007 00010000:00010000:3.0:1789762915.740950:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570a08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.740963:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1789762915.740966:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762915.740970:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570a08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.740981:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570a08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762915.751952:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967838 is committed 00002000:00010000:1.0:1789762915.751957:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:1.0:1789762915.751963:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 57351 -> 59399 00010000:00010000:1.0:1789762915.751975:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570a08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.751986:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570a08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.751993:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570a08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.751999:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762915.752002:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570a08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.752008:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570a08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.752023:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570a08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.752030:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570a08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762915.752112:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140811904:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11215us (47631us total) trans 4294967838 rc 0/0 00000100:00100000:1.0:1789762915.752121:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 525 00000100:00100000:1.0:1789762915.752130:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320213893335 time 320214033358 state 0x2 ref 0 00000100:00100000:3.0:1789762915.754251:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762915.754289:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140812032 00000100:00100000:1.0:1789762915.754298:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140812032 00000100:00100000:1.0:1789762915.754334:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320213893335 time 320214033358 state 0x0 ref 1 00000100:00100000:1.0:1789762915.754346:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320264033358 time 320214033358 state 0x1 ref 1 00000100:00100000:0.0:1789762915.790981:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320264033358 time 320264131124 state 0x0 ref 1 00000100:00100000:0.0:1789762915.791010:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140812032:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762915.791059:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 30408704, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0xe807 00010000:00010000:0.0:1789762915.791066:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053b70a78/0xd08452c77c570a0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.791079:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1789762915.791095:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762915.791100:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053b70a78/0xd08452c77c570a0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.791112:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053b70a78/0xd08452c77c570a0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762915.802986:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967839 is committed 00002000:00010000:1.0:1789762915.803008:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:1.0:1789762915.803014:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 59399 -> 61447 00010000:00010000:1.0:1789762915.803025:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053b70a78/0xd08452c77c570a0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.803036:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053b70a78/0xd08452c77c570a0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.803043:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053b70a78/0xd08452c77c570a0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.803048:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762915.803051:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053b70a78/0xd08452c77c570a0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.803065:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053b70a78/0xd08452c77c570a0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.803081:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053b70a78/0xd08452c77c570a0f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762915.803086:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053b70a78/0xd08452c77c570a0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762915.803154:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140812032:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12155us (48901us total) trans 4294967839 rc 0/0 00000100:00100000:1.0:1789762915.803163:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 526 00000100:00100000:1.0:1789762915.803172:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320264033358 time 320264131124 state 0x2 ref 0 00000100:00100000:3.0:1789762915.805463:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762915.805509:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140812160 00000100:00100000:1.0:1789762915.805518:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140812160 00000100:00100000:1.0:1789762915.805580:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320264033358 time 320264131124 state 0x0 ref 1 00000100:00100000:1.0:1789762915.805597:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320314131124 time 320264131124 state 0x1 ref 1 00000100:00100000:0.0:1789762915.841114:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320314131124 time 320314263900 state 0x0 ref 1 00000100:00100000:0.0:1789762915.841143:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140812160:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762915.841214:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 31457280, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0xf007 00010000:00010000:0.0:1789762915.841225:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570a16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.841243:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1789762915.841248:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762915.841253:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570a16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.841265:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570a16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762915.852503:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:0.0:1789762915.852510:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 61447 -> 63495 00000001:00080000:3.0:1789762915.852512:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967840 is committed 00010000:00010000:0.0:1789762915.852523:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570a16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.852563:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570a16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.852575:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570a16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.852583:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762915.852588:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570a16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.852599:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570a16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.852618:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570a16 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762915.852627:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570a16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762915.852691:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140812160:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11560us (47226us total) trans 4294967840 rc 0/0 00000100:00100000:0.0:1789762915.852699:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 527 00000100:00100000:0.0:1789762915.852707:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320314131124 time 320314263900 state 0x2 ref 0 00000100:00100000:3.0:1789762915.854771:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762915.854830:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140812288 00000100:00100000:1.0:1789762915.854853:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140812288 00000100:00100000:1.0:1789762915.854891:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320314131124 time 320314263900 state 0x0 ref 1 00000100:00100000:1.0:1789762915.854903:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320364263900 time 320314263900 state 0x1 ref 1 00000100:00100000:3.0:1789762915.891199:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320364263900 time 320364353214 state 0x0 ref 1 00000100:00100000:3.0:1789762915.891218:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140812288:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762915.891255:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 32505856, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0xf807 00010000:00010000:3.0:1789762915.891261:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.891274:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1789762915.891277:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762915.891282:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.891291:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762915.902702:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967841 is committed 00002000:00010000:3.0:1789762915.902718:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:3.0:1789762915.902723:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 63495 -> 65543 00010000:00010000:3.0:1789762915.902733:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.902752:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.902758:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.902763:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762915.902766:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.902773:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.902786:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.902791:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762915.902888:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140812288:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11671us (48112us total) trans 4294967841 rc 0/0 00000100:00100000:3.0:1789762915.902900:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 528 00000100:00100000:3.0:1789762915.902911:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320364263900 time 320364353214 state 0x2 ref 0 00000100:00100000:2.0:1789762915.905127:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762915.905195:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140812416 00000100:00100000:1.0:1789762915.905202:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140812416 00000100:00100000:1.0:1789762915.905240:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320364263900 time 320364353214 state 0x0 ref 1 00000100:00100000:1.0:1789762915.905251:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320414353214 time 320364353214 state 0x1 ref 1 00000100:00100000:3.0:1789762915.941266:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320414353214 time 320414421741 state 0x0 ref 1 00000100:00100000:3.0:1789762915.941305:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140812416:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762915.941341:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 33554432, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x10007 00010000:00010000:3.0:1789762915.941347:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.941358:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1789762915.941362:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762915.941366:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.941375:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762915.952510:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967842 is committed 00002000:00010000:3.0:1789762915.952525:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:3.0:1789762915.952531:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 65543 -> 67591 00010000:00010000:3.0:1789762915.952540:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.952565:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.952572:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.952577:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762915.952587:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.952594:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.952617:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.952623:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762915.952682:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140812416:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11379us (47553us total) trans 4294967842 rc 0/0 00000100:00100000:3.0:1789762915.952690:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 529 00000100:00100000:3.0:1789762915.952699:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320414353214 time 320414421741 state 0x2 ref 0 00000100:00100000:2.0:1789762915.954818:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762915.954877:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140812544 00000100:00100000:0.0:1789762915.954893:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140812544 00000100:00100000:0.0:1789762915.954950:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320414353214 time 320414421741 state 0x0 ref 1 00000100:00100000:0.0:1789762915.954966:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320464421741 time 320414421741 state 0x1 ref 1 00000100:00100000:3.0:1789762915.991370:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320464421741 time 320464518709 state 0x0 ref 1 00000100:00100000:3.0:1789762915.991395:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140812544:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762915.991445:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 34603008, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x10807 00010000:00010000:3.0:1789762915.991453:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.991466:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1789762915.991481:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762915.991486:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762915.991497:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.002656:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967843 is committed 00002000:00010000:1.0:1789762916.002675:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 34603008 -> 35651584 00002000:00010000:1.0:1789762916.002682:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 67591 -> 69639 00010000:00010000:1.0:1789762916.002696:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.002711:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.002722:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.002728:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762916.002732:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.002739:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.002755:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.002770:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570a2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762916.002859:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140812544:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11446us (48013us total) trans 4294967843 rc 0/0 00000100:00100000:1.0:1789762916.002869:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 530 00000100:00100000:1.0:1789762916.002879:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320464421741 time 320464518709 state 0x2 ref 0 00000100:00100000:0.0:1789762916.005401:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762916.005453:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140812672 00000100:00100000:3.0:1789762916.005462:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140812672 00000100:00100000:3.0:1789762916.005512:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320464421741 time 320464518709 state 0x0 ref 1 00000100:00100000:3.0:1789762916.005528:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320514518709 time 320464518709 state 0x1 ref 1 00000100:00100000:0.0:1789762916.007020:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149039104:0@lo:400:kworker.0 00000004:00080000:3.0:1789762916.007039:0:8167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 320480203404ns, next at 321480199524ns, rc = 0 00000100:00100000:1.0:1789762916.007041:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149039232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762916.007064:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149039360:0@lo:400:kworker.0 00000100:00100000:0.0:1789762916.007079:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762916.007087:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762916.007106:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149039488:0@lo:400:kworker.0 00000100:00100000:3.0:1789762916.007109:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762916.007149:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762916.007155:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d14552b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149039872:0@lo:400:kworker.0 00000100:00100000:0.0:1789762916.007156:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149039616:0@lo:400:kworker.0 00000100:00100000:1.0:1789762916.007163:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149039744:0@lo:400:kworker.0 00000100:00100000:2.0:1789762916.007191:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149039360 00000100:00100000:2.0:1789762916.007196:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149039360 00000100:00100000:3.0:1789762916.007203:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762916.007209:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762916.007212:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149039104 00000100:00100000:0.0:1789762916.007218:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149039104 00000100:00100000:2.0:1789762916.007236:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149039488 00000100:00100000:2.0:1789762916.007240:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149039488 00000100:00100000:0.0:1789762916.007268:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789762916.007269:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149039232 00000100:00100000:1.0:1789762916.007272:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149039744 00000100:00100000:3.0:1789762916.007275:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149039232 00000100:00100000:1.0:1789762916.007277:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149039744 00000100:00100000:2.0:1789762916.007280:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789762916.007286:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149039104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762916.007294:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149039360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762916.007322:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789762916.007326:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789762916.007335:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149039232:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762916.007340:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149039488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762916.007342:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149039104:12345-0@lo:400:kworker.0 Request processed in 62us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762916.007350:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149039360:12345-0@lo:400:kworker.0 Request processed in 57us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762916.007360:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789762916.007361:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00002000:00000024:3.0:1789762916.007368:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 97058816 pending 25559040 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789762916.007383:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789762916.007394:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149039744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762916.007397:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149039488:12345-0@lo:400:kworker.0 Request processed in 62us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762916.007404:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789762916.007424:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149039232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762916.007428:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149039872 00000100:00100000:0.0:1789762916.007433:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149039872 00000100:00100000:3.0:1789762916.007433:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789762916.007436:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149039744:12345-0@lo:400:kworker.0 Request processed in 45us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762916.007447:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789762916.007451:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762916.007471:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149039616 00000100:00080000:2.0:1789762916.007477:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762916.007483:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149039616 00000100:00080000:2.0:1789762916.007483:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762916.007493:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149039360:0@lo:400:kworker.0 00000100:00100000:1.0:1789762916.007506:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149039104:0@lo:400:kworker.0 00000100:00100000:0.0:1789762916.007523:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789762916.007525:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149039488:0@lo:400:kworker.0 00000100:00100000:3.0:1789762916.007532:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789762916.007536:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149039872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762916.007562:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149039616:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789762916.007571:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762916.007617:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149039872:12345-0@lo:400:kworker.0 Request processed in 84us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762916.007624:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789762916.007638:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149039744:0@lo:400:kworker.0 00000100:00100000:3.0:1789762916.007655:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149039616:12345-0@lo:400:kworker.0 Request processed in 109us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762916.007665:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149039232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762916.007669:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789762916.007674:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967823 gen 2 00000004:00080000:1.0:1789762916.007681:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d043c3b100, transno 4294967823 00000100:00100000:1.0:1789762916.007696:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149039616:0@lo:400:kworker.0 00000100:00100000:3.0:1789762916.007722:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d14552b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149039872:0@lo:400:kworker.0 00000100:00100000:0.0:1789762916.041476:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320514518709 time 320514625868 state 0x0 ref 1 00000100:00100000:0.0:1789762916.041517:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140812672:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762916.041583:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 35651584, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x11007 00010000:00010000:0.0:1789762916.041591:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.041604:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1789762916.041607:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762916.041613:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.041628:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.052171:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967844 is committed 00002000:00010000:1.0:1789762916.052193:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:1.0:1789762916.052198:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 69639 -> 71687 00010000:00010000:1.0:1789762916.052208:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.052218:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.052225:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.052239:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762916.052243:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.052250:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.052264:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.052269:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762916.052338:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140812672:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10826us (46939us total) trans 4294967844 rc 0/0 00000100:00100000:1.0:1789762916.052347:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 531 00000100:00100000:1.0:1789762916.052362:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320514518709 time 320514625868 state 0x2 ref 0 00000100:00100000:0.0:1789762916.054808:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762916.054857:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140812800 00000100:00100000:3.0:1789762916.054865:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140812800 00000100:00100000:3.0:1789762916.054902:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320514518709 time 320514625868 state 0x0 ref 1 00000100:00100000:3.0:1789762916.054913:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320564625868 time 320514625868 state 0x1 ref 1 00000100:00100000:1.0:1789762916.091579:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320564625868 time 320564729904 state 0x0 ref 1 00000100:00100000:1.0:1789762916.091601:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140812800:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762916.091644:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 36700160, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x11807 00010000:00010000:1.0:1789762916.091651:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.091664:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:1.0:1789762916.091667:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762916.091672:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.091682:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.103375:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967845 is committed 00002000:00010000:1.0:1789762916.103435:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:1.0:1789762916.103440:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 71687 -> 73735 00010000:00010000:1.0:1789762916.103451:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.103460:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.103467:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.103491:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762916.103494:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.103501:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.103514:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.103519:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762916.103605:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140812800:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12010us (48796us total) trans 4294967845 rc 0/0 00000100:00100000:1.0:1789762916.103613:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 532 00000100:00100000:1.0:1789762916.103621:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320564625868 time 320564729904 state 0x2 ref 0 00000100:00100000:3.0:1789762916.105794:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.105829:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140812928 00000100:00100000:1.0:1789762916.105862:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140812928 00000100:00100000:1.0:1789762916.105898:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320564625868 time 320564729904 state 0x0 ref 1 00000100:00100000:1.0:1789762916.105908:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320614729904 time 320564729904 state 0x1 ref 1 00000100:00100000:1.0:1789762916.141675:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320614729904 time 320614820885 state 0x0 ref 1 00000100:00100000:1.0:1789762916.141729:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140812928:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762916.141787:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 37748736, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x12007 00010000:00010000:1.0:1789762916.141797:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.141814:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:1.0:1789762916.141819:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762916.141825:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.141871:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.153466:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967846 is committed 00002000:00010000:1.0:1789762916.153520:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:1.0:1789762916.153525:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 73735 -> 75783 00010000:00010000:1.0:1789762916.153536:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.153562:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.153570:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.153575:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762916.153586:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.153605:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.153620:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.153626:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762916.153698:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140812928:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11977us (47902us total) trans 4294967846 rc 0/0 00000100:00100000:1.0:1789762916.153707:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 533 00000100:00100000:1.0:1789762916.153727:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320614729904 time 320614820885 state 0x2 ref 0 00000100:00100000:3.0:1789762916.155930:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.155973:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140813056 00000100:00100000:1.0:1789762916.155982:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140813056 00000100:00100000:1.0:1789762916.156020:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320614729904 time 320614820885 state 0x0 ref 1 00000100:00100000:1.0:1789762916.156031:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320664820885 time 320614820885 state 0x1 ref 1 00000100:00100000:0.0:1789762916.191765:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320664820885 time 320664915856 state 0x0 ref 1 00000100:00100000:0.0:1789762916.191785:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140813056:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762916.191827:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 38797312, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x12807 00010000:00010000:0.0:1789762916.191856:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.191870:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1789762916.191873:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762916.191878:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.191901:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.202481:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967847 is committed 00002000:00010000:1.0:1789762916.202530:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:1.0:1789762916.202534:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 75783 -> 77831 00010000:00010000:1.0:1789762916.202571:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.202588:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.202595:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.202601:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762916.202615:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.202621:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.202634:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.202639:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570a47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762916.202702:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140813056:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10922us (46772us total) trans 4294967847 rc 0/0 00000100:00100000:1.0:1789762916.202720:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 534 00000100:00100000:1.0:1789762916.202728:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320664820885 time 320664915856 state 0x2 ref 0 00000100:00100000:3.0:1789762916.204924:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.204956:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140813184 00000100:00100000:1.0:1789762916.204970:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140813184 00000100:00100000:1.0:1789762916.205004:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320664820885 time 320664915856 state 0x0 ref 1 00000100:00100000:1.0:1789762916.205015:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320714915856 time 320664915856 state 0x1 ref 1 00000100:00100000:2.0:1789762916.212124:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762916.212153:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762916.212186:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140813440 00000100:00100000:2.0:1789762916.212191:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762916.212192:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140813440 00000100:00100000:1.0:1789762916.212232:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140813696 00000100:00100000:2.0:1789762916.212232:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.212240:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140813696 00000100:00100000:3.0:1789762916.212242:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140813312 00000100:00100000:3.0:1789762916.212248:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140813312 00000100:00100000:0.0:1789762916.212249:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 230 00000100:00100000:0.0:1789762916.212262:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+8:2342:x1876702140813440:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762916.212286:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:3.0:1789762916.212292:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 297 00000100:00100000:1.0:1789762916.212299:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140813696:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:2.0:1789762916.212306:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762916.212306:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140813312:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762916.212315:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+8:2342:x1876702140813440:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762916.212321:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 230 00000100:00100000:1.0:1789762916.212348:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140813696:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 53us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762916.212355:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140813312:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 53us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762916.212357:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:3.0:1789762916.212369:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 297 00000100:00100000:2.0:1789762916.212370:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140813568 00000100:00100000:2.0:1789762916.212375:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140813568 00000100:00080000:3.0:1789762916.212417:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762916.212431:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:2.0:1789762916.212442:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+35:2342:x1876702140813568:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762916.212485:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+35:2342:x1876702140813568:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 47us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762916.212490:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:1.0:1789762916.241884:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320714915856 time 320715034198 state 0x0 ref 1 00000100:00100000:1.0:1789762916.241921:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140813184:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762916.241972:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 39845888, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x13007 00010000:00010000:1.0:1789762916.241979:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.241992:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:1.0:1789762916.241996:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762916.242000:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.242012:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.253812:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967848 is committed 00002000:00010000:1.0:1789762916.253884:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:1.0:1789762916.253889:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 77831 -> 79879 00010000:00010000:1.0:1789762916.253900:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.253909:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.253916:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.253921:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762916.253924:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.253931:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.253945:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.253950:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762916.254021:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140813184:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12118us (49095us total) trans 4294967848 rc 0/0 00000100:00100000:1.0:1789762916.254036:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 535 00000100:00100000:1.0:1789762916.254045:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320714915856 time 320715034198 state 0x2 ref 0 00000100:00100000:3.0:1789762916.256268:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.256307:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140813824 00000100:00100000:1.0:1789762916.256316:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140813824 00000100:00100000:1.0:1789762916.256354:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320714915856 time 320715034198 state 0x0 ref 1 00000100:00100000:1.0:1789762916.256365:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320765034198 time 320715034198 state 0x1 ref 1 00000100:00100000:3.0:1789762916.291964:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320765034198 time 320765105641 state 0x0 ref 1 00000100:00100000:3.0:1789762916.291984:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140813824:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762916.292047:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 40894464, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x13807 00010000:00010000:3.0:1789762916.292056:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570a55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.292069:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1789762916.292073:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762916.292087:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570a55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.292098:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570a55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.304084:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967849 is committed 00002000:00010000:1.0:1789762916.304125:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:1.0:1789762916.304130:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 79879 -> 81927 00010000:00010000:1.0:1789762916.304140:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570a55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.304150:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570a55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.304156:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570a55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.304161:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762916.304164:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570a55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.304171:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570a55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.304194:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570a55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.304200:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570a55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762916.304260:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140813824:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12281us (47991us total) trans 4294967849 rc 0/0 00000100:00100000:1.0:1789762916.304268:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 536 00000100:00100000:1.0:1789762916.304276:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320765034198 time 320765105641 state 0x2 ref 0 00000100:00100000:3.0:1789762916.306350:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.306388:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140813952 00000100:00100000:1.0:1789762916.306397:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140813952 00000100:00100000:1.0:1789762916.306433:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320765034198 time 320765105641 state 0x0 ref 1 00000100:00100000:1.0:1789762916.306445:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320815105641 time 320765105641 state 0x1 ref 1 00000100:00100000:3.0:1789762916.342110:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320815105641 time 320815263208 state 0x0 ref 1 00000100:00100000:3.0:1789762916.342130:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140813952:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762916.342171:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 41943040, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x14007 00010000:00010000:3.0:1789762916.342181:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570a5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.342197:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1789762916.342213:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762916.342232:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570a5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.342246:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570a5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762916.353258:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967850 is committed 00002000:00010000:1.0:1789762916.353314:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:1.0:1789762916.353319:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 81927 -> 83975 00010000:00010000:1.0:1789762916.353330:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570a5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.353340:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570a5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.353358:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570a5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.353363:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762916.353366:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570a5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.353373:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570a5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.353387:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570a5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.353393:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570a5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762916.353458:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140813952:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11332us (47106us total) trans 4294967850 rc 0/0 00000100:00100000:1.0:1789762916.353466:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 537 00000100:00100000:1.0:1789762916.353475:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320815105641 time 320815263208 state 0x2 ref 0 00000100:00100000:3.0:1789762916.355684:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.355723:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140814080 00000100:00100000:1.0:1789762916.355732:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140814080 00000100:00100000:1.0:1789762916.355769:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320815105641 time 320815263208 state 0x0 ref 1 00000100:00100000:1.0:1789762916.355789:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320865263208 time 320815263208 state 0x1 ref 1 00010000:00010000:3.0:1789762916.390997:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762916.392181:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320865263208 time 320865333299 state 0x0 ref 1 00000100:00100000:0.0:1789762916.392207:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140814080:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762916.392260:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 42991616, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x14807 00010000:00010000:0.0:1789762916.392269:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000476460c/0xd08452c77c570a63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.392285:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1789762916.392290:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762916.392297:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000476460c/0xd08452c77c570a63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.392309:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000476460c/0xd08452c77c570a63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.403325:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967851 is committed 00002000:00010000:3.0:1789762916.403337:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:3.0:1789762916.403342:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 83975 -> 86023 00010000:00010000:3.0:1789762916.403353:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000476460c/0xd08452c77c570a63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.403363:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000476460c/0xd08452c77c570a63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.403369:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000476460c/0xd08452c77c570a63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.403374:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762916.403378:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000476460c/0xd08452c77c570a63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.403385:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000476460c/0xd08452c77c570a63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.403411:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000476460c/0xd08452c77c570a63 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.403424:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000476460c/0xd08452c77c570a63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762916.403496:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140814080:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11298us (47812us total) trans 4294967851 rc 0/0 00000100:00100000:3.0:1789762916.403504:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 538 00000100:00100000:3.0:1789762916.403513:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320865263208 time 320865333299 state 0x2 ref 0 00000100:00100000:2.0:1789762916.405525:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.405577:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140814208 00000100:00100000:1.0:1789762916.405585:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140814208 00000100:00100000:1.0:1789762916.405621:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320865263208 time 320865333299 state 0x0 ref 1 00000100:00100000:1.0:1789762916.405632:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320915333299 time 320865333299 state 0x1 ref 1 00000100:00100000:3.0:1789762916.442323:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320915333299 time 320915472007 state 0x0 ref 1 00000100:00100000:3.0:1789762916.442347:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140814208:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762916.442394:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 44040192, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x15007 00010000:00010000:3.0:1789762916.442401:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570a6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.442415:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1789762916.442418:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762916.442423:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570a6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.442434:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570a6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762916.453089:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967852 is committed 00002000:00010000:1.0:1789762916.453104:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:1.0:1789762916.453109:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 86023 -> 88071 00010000:00010000:1.0:1789762916.453120:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570a6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.453130:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570a6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.453137:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570a6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.453142:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762916.453146:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570a6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.453153:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570a6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.453178:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570a6a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.453184:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570a6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762916.453237:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140814208:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10899us (47711us total) trans 4294967852 rc 0/0 00000100:00100000:1.0:1789762916.453246:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 539 00000100:00100000:1.0:1789762916.453254:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320915333299 time 320915472007 state 0x2 ref 0 00000100:00100000:2.0:1789762916.455416:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.455458:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140814336 00000100:00100000:1.0:1789762916.455466:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140814336 00000100:00100000:1.0:1789762916.455510:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320915333299 time 320915472007 state 0x0 ref 1 00000100:00100000:1.0:1789762916.455525:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320965472007 time 320915472007 state 0x1 ref 1 00000100:00100000:0.0:1789762916.492393:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320965472007 time 320965546614 state 0x0 ref 1 00000100:00100000:0.0:1789762916.492411:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140814336:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762916.492463:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 45088768, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x15807 00010000:00010000:0.0:1789762916.492470:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570a71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.492482:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1789762916.492486:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762916.492490:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570a71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.492501:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570a71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.504027:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967853 is committed 00002000:00010000:3.0:1789762916.504078:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:3.0:1789762916.504083:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 88071 -> 90119 00010000:00010000:3.0:1789762916.504092:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570a71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.504102:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570a71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.504108:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570a71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.504113:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762916.504117:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570a71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.504123:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570a71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.504136:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570a71 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.504141:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570a71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762916.504201:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140814336:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11794us (48786us total) trans 4294967853 rc 0/0 00000100:00100000:3.0:1789762916.504209:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 540 00000100:00100000:3.0:1789762916.504223:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320965472007 time 320965546614 state 0x2 ref 0 00000100:00100000:3.0:1789762916.506273:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762916.506318:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140814464 00000100:00100000:0.0:1789762916.506325:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140814464 00000100:00100000:0.0:1789762916.506360:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 320965472007 time 320965546614 state 0x0 ref 1 00000100:00100000:0.0:1789762916.506370:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321015546614 time 320965546614 state 0x1 ref 1 00000100:00100000:2.0:1789762916.519005:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149040000:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1789762916.519005:0:7131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 320992169820ns, next at 321992168230ns, rc = 0 00000100:00100000:2.0:1789762916.519059:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762916.519137:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149040000 00000100:00100000:0.0:1789762916.519143:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149040000 00000100:00100000:0.0:1789762916.519176:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789762916.519191:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149040000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762916.519208:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526712832 pending 0 free 3838836736 avail 3794796544 00000100:00100000:0.0:1789762916.519245:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149040000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762916.519251:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789762916.519290:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149040000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762916.542459:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321015546614 time 321015611167 state 0x0 ref 1 00000100:00100000:0.0:1789762916.542481:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140814464:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762916.542525:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 46137344, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x16007 00010000:00010000:0.0:1789762916.542532:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570a78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.542559:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1789762916.542563:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762916.542568:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.542592:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.553309:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967854 is committed 00002000:00010000:3.0:1789762916.553341:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:3.0:1789762916.553347:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 90119 -> 92167 00010000:00010000:3.0:1789762916.553361:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.553374:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570a78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.553384:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570a78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.553392:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762916.553397:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570a78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.553406:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570a78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.553426:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570a78 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.553435:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570a78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762916.553518:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140814464:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11042us (47242us total) trans 4294967854 rc 0/0 00000100:00100000:3.0:1789762916.553530:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 541 00000100:00100000:3.0:1789762916.553556:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321015546614 time 321015611167 state 0x2 ref 0 00000100:00100000:3.0:1789762916.555614:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.555665:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140814592 00000100:00100000:1.0:1789762916.555673:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140814592 00000100:00100000:1.0:1789762916.555710:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321015546614 time 321015611167 state 0x0 ref 1 00000100:00100000:1.0:1789762916.555721:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321065611167 time 321015611167 state 0x1 ref 1 00000100:00100000:3.0:1789762916.592560:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321065611167 time 321065700962 state 0x0 ref 1 00000100:00100000:3.0:1789762916.592597:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140814592:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762916.592642:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 47185920, mtime: 0x6aad9d63, atime: 0x0, ctime: 0x6aad9d63, blocks: 0x16807 00010000:00010000:3.0:1789762916.592649:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570a7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.592662:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1789762916.592665:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762916.592670:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.592681:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.603615:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967855 is committed 00002000:00010000:1.0:1789762916.603616:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 47185920 -> 48234496 00002000:00010000:1.0:1789762916.603626:0:13229:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb mtime from disk: 1789762915 -> 1789762916 00002000:00010000:1.0:1789762916.603628:0:13229:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb ctime from disk: 1789762915 -> 1789762916 00002000:00010000:1.0:1789762916.603630:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 92167 -> 94215 00010000:00010000:1.0:1789762916.603640:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.603649:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.603656:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570a7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.603661:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762916.603665:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570a7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.603671:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570a7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.603685:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570a7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.603690:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570a7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762916.603745:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140814592:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11168us (48131us total) trans 4294967855 rc 0/0 00000100:00100000:1.0:1789762916.603760:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 542 00000100:00100000:1.0:1789762916.603768:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321065611167 time 321065700962 state 0x2 ref 0 00000100:00100000:3.0:1789762916.605747:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.605786:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140814720 00000100:00100000:1.0:1789762916.605794:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140814720 00000100:00100000:1.0:1789762916.605830:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321065611167 time 321065700962 state 0x0 ref 1 00000100:00100000:1.0:1789762916.605857:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321115700962 time 321065700962 state 0x1 ref 1 00000100:00100000:1.0:1789762916.642657:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321115700962 time 321115796262 state 0x0 ref 1 00000100:00100000:1.0:1789762916.642682:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140814720:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762916.642730:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 48234496, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x17007 00010000:00010000:1.0:1789762916.642737:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.642751:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1789762916.642754:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762916.642759:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.642770:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.654114:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967856 is committed 00002000:00010000:1.0:1789762916.654117:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:1.0:1789762916.654123:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 94215 -> 96265 00010000:00010000:1.0:1789762916.654134:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.654144:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.654155:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.654163:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762916.654168:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.654179:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.654198:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a86 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.654204:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762916.654258:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140814720:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11584us (48510us total) trans 4294967856 rc 0/0 00000100:00100000:1.0:1789762916.654272:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 543 00000100:00100000:1.0:1789762916.654281:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321115700962 time 321115796262 state 0x2 ref 0 00000100:00100000:3.0:1789762916.656469:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762916.656561:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140814848 00000100:00100000:0.0:1789762916.656582:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140814848 00000100:00100000:0.0:1789762916.656628:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321115700962 time 321115796262 state 0x0 ref 1 00000100:00100000:0.0:1789762916.656653:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321165796262 time 321115796262 state 0x1 ref 1 00000100:00100000:3.0:1789762916.692723:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321165796262 time 321165877456 state 0x0 ref 1 00000100:00100000:3.0:1789762916.692751:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140814848:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762916.692802:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 49283072, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x17809 00010000:00010000:3.0:1789762916.692808:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570a8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.692821:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1789762916.692824:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762916.692829:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.692863:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762916.705829:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 49283072 -> 50331648 00000001:00080000:2.0:1789762916.705850:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967857 is committed 00002000:00010000:1.0:1789762916.705855:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 96265 -> 98313 00010000:00010000:1.0:1789762916.705867:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.705876:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.705883:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570a8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.705888:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762916.705891:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570a8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.705910:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570a8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.705924:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570a8d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.705930:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570a8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762916.706014:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140814848:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13263us (49541us total) trans 4294967857 rc 0/0 00000100:00100000:1.0:1789762916.706027:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 544 00000100:00100000:1.0:1789762916.706050:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321165796262 time 321165877456 state 0x2 ref 0 00000100:00100000:2.0:1789762916.708373:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.708446:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140814976 00000100:00100000:1.0:1789762916.708454:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140814976 00000100:00100000:1.0:1789762916.708511:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321165796262 time 321165877456 state 0x0 ref 1 00000100:00100000:1.0:1789762916.708526:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321215877456 time 321165877456 state 0x1 ref 1 00000100:00100000:0.0:1789762916.742803:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321215877456 time 321215957273 state 0x0 ref 1 00000100:00100000:0.0:1789762916.742822:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140814976:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762916.742896:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 50331648, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x18009 00010000:00010000:0.0:1789762916.742902:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570a94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.742914:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1789762916.742918:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762916.742922:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.742933:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.753813:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967858 is committed 00002000:00010000:3.0:1789762916.753880:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:3.0:1789762916.753885:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 98313 -> 100361 00010000:00010000:3.0:1789762916.753894:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.753903:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570a94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.753910:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570a94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.753915:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762916.753926:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570a94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.753933:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570a94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.753957:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570a94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.753963:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570a94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762916.754021:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140814976:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11203us (45646us total) trans 4294967858 rc 0/0 00000100:00100000:3.0:1789762916.754028:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 545 00000100:00100000:3.0:1789762916.754037:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321215877456 time 321215957273 state 0x2 ref 0 00000100:00100000:3.0:1789762916.756273:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.756320:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140815104 00000100:00100000:1.0:1789762916.756329:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140815104 00000100:00100000:1.0:1789762916.756375:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321215877456 time 321215957273 state 0x0 ref 1 00000100:00100000:1.0:1789762916.756386:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321265957273 time 321215957273 state 0x1 ref 1 00000100:00100000:1.0:1789762916.792864:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321265957273 time 321266018873 state 0x0 ref 1 00000100:00100000:1.0:1789762916.792895:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140815104:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762916.792934:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 51380224, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x18809 00010000:00010000:1.0:1789762916.792941:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.792976:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1789762916.792979:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762916.792983:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.792997:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762916.804596:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967859 is committed 00002000:00010000:3.0:1789762916.804657:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:3.0:1789762916.804662:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 100361 -> 102409 00010000:00010000:3.0:1789762916.804672:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.804682:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.804689:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.804700:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762916.804704:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.804721:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.804735:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.804740:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570a9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762916.804798:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140815104:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11919us (48524us total) trans 4294967859 rc 0/0 00000100:00100000:3.0:1789762916.804807:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 546 00000100:00100000:3.0:1789762916.804816:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321265957273 time 321266018873 state 0x2 ref 0 00000100:00100000:3.0:1789762916.806966:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.807034:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140815232 00000100:00100000:1.0:1789762916.807042:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140815232 00000100:00100000:1.0:1789762916.807098:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321265957273 time 321266018873 state 0x0 ref 1 00000100:00100000:1.0:1789762916.807113:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321316018873 time 321266018873 state 0x1 ref 1 00000100:00100000:3.0:1789762916.842997:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321316018873 time 321316147268 state 0x0 ref 1 00000100:00100000:3.0:1789762916.843022:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140815232:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762916.843082:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 52428800, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x19009 00010000:00010000:3.0:1789762916.843103:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570aa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.843135:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1789762916.843139:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762916.843143:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.843155:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.855501:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967860 is committed 00002000:00010000:3.0:1789762916.855567:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:3.0:1789762916.855582:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 102409 -> 104457 00010000:00010000:3.0:1789762916.855593:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.855603:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570aa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.855610:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570aa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.855614:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ea00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762916.855618:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570aa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.855625:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570aa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.855658:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570aa2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.855664:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570aa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762916.855739:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140815232:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12726us (48772us total) trans 4294967860 rc 0/0 00000100:00100000:3.0:1789762916.855748:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 547 00000100:00100000:3.0:1789762916.855758:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321316018873 time 321316147268 state 0x2 ref 0 00000100:00100000:3.0:1789762916.858419:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762916.858484:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140815360 00000100:00100000:0.0:1789762916.858493:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140815360 00000100:00100000:0.0:1789762916.858539:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321316018873 time 321316147268 state 0x0 ref 1 00000100:00100000:0.0:1789762916.858581:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321366147268 time 321316147268 state 0x1 ref 1 00000100:00100000:0.0:1789762916.893089:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321366147268 time 321366240086 state 0x0 ref 1 00000100:00100000:0.0:1789762916.893134:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140815360:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762916.893174:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 53477376, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x19809 00010000:00010000:0.0:1789762916.893191:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570aa9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.893204:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1789762916.893207:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762916.893211:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.893222:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762916.905251:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967861 is committed 00002000:00010000:0.0:1789762916.905253:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:0.0:1789762916.905259:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 104457 -> 106505 00010000:00010000:0.0:1789762916.905269:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.905280:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.905287:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570aa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.905292:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762916.905312:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570aa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.905319:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570aa9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.905332:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570aa9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762916.905338:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570aa9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762916.905403:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140815360:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12272us (46984us total) trans 4294967861 rc 0/0 00000100:00100000:0.0:1789762916.905411:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 548 00000100:00100000:0.0:1789762916.905420:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321366147268 time 321366240086 state 0x2 ref 0 00000100:00100000:3.0:1789762916.907815:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.907893:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140815488 00000100:00100000:1.0:1789762916.907901:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140815488 00000100:00100000:1.0:1789762916.907935:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321366147268 time 321366240086 state 0x0 ref 1 00000100:00100000:1.0:1789762916.907946:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321416240086 time 321366240086 state 0x1 ref 1 00000100:00100000:3.0:1789762916.943187:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321416240086 time 321416336845 state 0x0 ref 1 00000100:00100000:3.0:1789762916.943210:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140815488:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762916.943254:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 54525952, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x1a009 00010000:00010000:3.0:1789762916.943261:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570ab0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.943273:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1789762916.943277:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762916.943281:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.943318:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762916.954175:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967862 is committed 00002000:00010000:3.0:1789762916.954206:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:3.0:1789762916.954213:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 106505 -> 108553 00010000:00010000:3.0:1789762916.954224:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.954234:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570ab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.954241:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570ab0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.954246:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ea00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762916.954249:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570ab0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.954256:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570ab0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.954269:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570ab0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762916.954274:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570ab0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762916.954371:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140815488:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11166us (46553us total) trans 4294967862 rc 0/0 00000100:00100000:3.0:1789762916.954379:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 549 00000100:00100000:3.0:1789762916.954388:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321416240086 time 321416336845 state 0x2 ref 0 00000100:00100000:3.0:1789762916.956683:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762916.956736:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140815616 00000100:00100000:1.0:1789762916.956744:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140815616 00000100:00100000:1.0:1789762916.956781:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321416240086 time 321416336845 state 0x0 ref 1 00000100:00100000:1.0:1789762916.956801:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321466336845 time 321416336845 state 0x1 ref 1 00000100:00100000:1.0:1789762916.993245:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321466336845 time 321466393771 state 0x0 ref 1 00000100:00100000:1.0:1789762916.993266:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140815616:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762916.993312:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 55574528, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x1a809 00010000:00010000:1.0:1789762916.993319:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570ab7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.993333:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1789762916.993336:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762916.993341:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762916.993351:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762917.005387:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967863 is committed 00002000:00010000:3.0:1789762917.005412:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:3.0:1789762917.005417:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 108553 -> 110601 00010000:00010000:3.0:1789762917.005428:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.005439:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570ab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.005445:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570ab7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.005451:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762917.005455:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570ab7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.005462:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570ab7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.005476:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570ab7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.005489:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570ab7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762917.005570:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140815616:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12306us (48883us total) trans 4294967863 rc 0/0 00000100:00100000:3.0:1789762917.005578:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 550 00000100:00100000:3.0:1789762917.005598:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321466336845 time 321466393771 state 0x2 ref 0 00000100:00100000:3.0:1789762917.007909:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762917.007971:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140815744 00000100:00100000:0.0:1789762917.007980:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140815744 00000100:00080000:3.0:1789762917.008027:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762917.008049:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321466336845 time 321466393771 state 0x0 ref 1 00000100:00100000:0.0:1789762917.008066:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321516393771 time 321466393771 state 0x1 ref 1 00000100:00100000:3.0:1789762917.043325:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321516393771 time 321516474664 state 0x0 ref 1 00000100:00100000:3.0:1789762917.043348:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140815744:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762917.043397:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 56623104, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x1b009 00010000:00010000:3.0:1789762917.043404:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570abe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.043417:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1789762917.043421:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762917.043425:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.043437:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762917.054585:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 56623104 -> 57671680 00000001:00080000:2.0:1789762917.054588:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967864 is committed 00002000:00010000:1.0:1789762917.054592:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 110601 -> 112649 00010000:00010000:1.0:1789762917.054605:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.054615:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.054630:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570abe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.054635:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ea00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762917.054638:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570abe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.054645:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570abe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.054659:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570abe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.054665:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0d3e28f/0xd08452c77c570abe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762917.054723:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140815744:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11380us (46812us total) trans 4294967864 rc 0/0 00000100:00100000:1.0:1789762917.054730:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 551 00000100:00100000:1.0:1789762917.054739:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321516393771 time 321516474664 state 0x2 ref 0 00000100:00100000:3.0:1789762917.056966:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762917.057006:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140815872 00000100:00100000:1.0:1789762917.057014:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140815872 00000100:00100000:1.0:1789762917.057057:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321516393771 time 321516474664 state 0x0 ref 1 00000100:00100000:1.0:1789762917.057078:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321566474664 time 321516474664 state 0x1 ref 1 00000100:00100000:0.0:1789762917.093426:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321566474664 time 321566576986 state 0x0 ref 1 00000100:00100000:0.0:1789762917.093449:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140815872:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762917.093516:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 57671680, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x1b809 00010000:00010000:0.0:1789762917.093524:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570ac5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762917.093537:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1789762917.093555:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762917.093560:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762917.093577:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762917.105301:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967865 is committed 00002000:00010000:3.0:1789762917.105323:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:3.0:1789762917.105328:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 112649 -> 114697 00010000:00010000:3.0:1789762917.105340:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.105354:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.105365:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570ac5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.105374:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762917.105379:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570ac5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.105390:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570ac5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.105407:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570ac5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.105415:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570ac5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762917.105488:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140815872:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12046us (48524us total) trans 4294967865 rc 0/0 00000100:00100000:3.0:1789762917.105497:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 552 00000100:00100000:3.0:1789762917.105506:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321566474664 time 321566576986 state 0x2 ref 0 00000100:00100000:2.0:1789762917.107577:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762917.107612:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140816000 00000100:00100000:3.0:1789762917.107620:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140816000 00000100:00100000:3.0:1789762917.107657:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321566474664 time 321566576986 state 0x0 ref 1 00000100:00100000:3.0:1789762917.107668:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321616576986 time 321566576986 state 0x1 ref 1 00000100:00100000:1.0:1789762917.143586:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321616576986 time 321616723927 state 0x0 ref 1 00000100:00100000:1.0:1789762917.143612:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140816000:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762917.143668:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 58720256, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x1c009 00010000:00010000:1.0:1789762917.143676:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570acc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.143690:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1789762917.143693:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762917.143698:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.143710:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762917.154857:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967866 is committed 00002000:00010000:1.0:1789762917.154876:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:1.0:1789762917.154882:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 114697 -> 116745 00010000:00010000:1.0:1789762917.154893:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.154903:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.154921:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570acc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.154926:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762917.154930:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570acc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.154937:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570acc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.154951:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570acc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.154957:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570acc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762917.155022:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140816000:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11419us (47442us total) trans 4294967866 rc 0/0 00000100:00100000:1.0:1789762917.155031:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 553 00000100:00100000:1.0:1789762917.155043:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321616576986 time 321616723927 state 0x2 ref 0 00000100:00100000:3.0:1789762917.157669:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762917.157717:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140816128 00000100:00100000:1.0:1789762917.157725:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140816128 00000100:00100000:1.0:1789762917.157764:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321616576986 time 321616723927 state 0x0 ref 1 00000100:00100000:1.0:1789762917.157784:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321666723927 time 321616723927 state 0x1 ref 1 00000100:00100000:3.0:1789762917.193664:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321666723927 time 321666817234 state 0x0 ref 1 00000100:00100000:3.0:1789762917.193685:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140816128:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762917.193728:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 59768832, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x1c809 00010000:00010000:3.0:1789762917.193735:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570ad3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.193748:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1789762917.193752:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762917.193756:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.193782:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762917.204983:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967867 is committed 00002000:00010000:1.0:1789762917.204987:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:1.0:1789762917.204993:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 116745 -> 118793 00010000:00010000:1.0:1789762917.205004:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.205022:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.205029:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.205034:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762917.205038:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.205045:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570ad3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.205059:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570ad3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.205064:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570ad3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762917.205136:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140816128:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11455us (47467us total) trans 4294967867 rc 0/0 00000100:00100000:1.0:1789762917.205145:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 554 00000100:00100000:1.0:1789762917.205155:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321666723927 time 321666817234 state 0x2 ref 0 00000100:00100000:3.0:1789762917.207336:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762917.207381:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140816256 00000100:00100000:0.0:1789762917.207389:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140816256 00000100:00100000:0.0:1789762917.207430:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321666723927 time 321666817234 state 0x0 ref 1 00000100:00100000:0.0:1789762917.207441:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321716817234 time 321666817234 state 0x1 ref 1 00000100:00100000:0.0:1789762917.243735:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321716817234 time 321716885284 state 0x0 ref 1 00000100:00100000:0.0:1789762917.243762:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140816256:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762917.243810:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 60817408, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x1d009 00010000:00010000:0.0:1789762917.243817:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570ada lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762917.243866:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1789762917.243870:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762917.243875:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762917.243886:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762917.255126:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967868 is committed 00002000:00010000:3.0:1789762917.255141:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:3.0:1789762917.255147:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 118793 -> 120841 00010000:00010000:3.0:1789762917.255160:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.255174:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.255184:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570ada lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.255192:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762917.255197:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570ada lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.255207:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570ada lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.255225:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570ada lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.255240:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c36788/0xd08452c77c570ada lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762917.255301:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140816256:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11547us (47962us total) trans 4294967868 rc 0/0 00000100:00100000:3.0:1789762917.255312:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 555 00000100:00100000:3.0:1789762917.255323:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321716817234 time 321716885284 state 0x2 ref 0 00000100:00100000:3.0:1789762917.257594:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762917.257646:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140816384 00000100:00100000:1.0:1789762917.257654:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140816384 00000100:00100000:1.0:1789762917.257692:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321716817234 time 321716885284 state 0x0 ref 1 00000100:00100000:1.0:1789762917.257703:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321766885284 time 321716885284 state 0x1 ref 1 00000100:00100000:3.0:1789762917.293845:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321766885284 time 321766984833 state 0x0 ref 1 00000100:00100000:3.0:1789762917.293865:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140816384:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762917.293905:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 61865984, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x1d809 00010000:00010000:3.0:1789762917.293912:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570ae1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.293924:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1789762917.293927:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762917.293931:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.293942:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762917.305324:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967869 is committed 00002000:00010000:1.0:1789762917.305329:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:1.0:1789762917.305334:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 120841 -> 122889 00010000:00010000:1.0:1789762917.305344:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.305354:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.305361:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.305366:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762917.305370:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.305383:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.305396:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570ae1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.305401:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570ae1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762917.305458:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140816384:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11598us (47863us total) trans 4294967869 rc 0/0 00000100:00100000:1.0:1789762917.305466:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 556 00000100:00100000:1.0:1789762917.305474:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321766885284 time 321766984833 state 0x2 ref 0 00000100:00100000:3.0:1789762917.307398:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762917.307467:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140816512 00000100:00100000:1.0:1789762917.307475:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140816512 00000100:00100000:1.0:1789762917.307510:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321766885284 time 321766984833 state 0x0 ref 1 00000100:00100000:1.0:1789762917.307521:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321816984833 time 321766984833 state 0x1 ref 1 00000100:00100000:3.0:1789762917.343910:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321816984833 time 321817062162 state 0x0 ref 1 00000100:00100000:3.0:1789762917.343931:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140816512:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762917.343972:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 62914560, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x1e009 00010000:00010000:3.0:1789762917.343980:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570ae8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.343992:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1789762917.343996:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762917.344009:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.344020:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762917.355108:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967870 is committed 00002000:00010000:1.0:1789762917.355113:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:1.0:1789762917.355118:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 122889 -> 124937 00010000:00010000:1.0:1789762917.355129:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.355159:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.355166:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570ae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.355171:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762917.355175:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570ae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.355182:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570ae8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.355197:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570ae8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.355202:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a705d722/0xd08452c77c570ae8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762917.355269:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140816512:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11342us (47870us total) trans 4294967870 rc 0/0 00000100:00100000:1.0:1789762917.355277:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 557 00000100:00100000:1.0:1789762917.355286:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321816984833 time 321817062162 state 0x2 ref 0 00000100:00100000:3.0:1789762917.357790:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762917.357871:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140816640 00000100:00100000:0.0:1789762917.357879:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140816640 00000100:00100000:0.0:1789762917.357917:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321816984833 time 321817062162 state 0x0 ref 1 00000100:00100000:0.0:1789762917.357928:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321867062162 time 321817062162 state 0x1 ref 1 00000100:00100000:3.0:1789762917.394015:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321867062162 time 321867168128 state 0x0 ref 1 00000100:00100000:3.0:1789762917.394035:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140816640:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762917.394077:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 63963136, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x1e809 00010000:00010000:3.0:1789762917.394083:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570aef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.394106:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1789762917.394110:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762917.394114:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.394136:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762917.405524:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967871 is committed 00002000:00010000:1.0:1789762917.405525:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:1.0:1789762917.405549:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 124937 -> 126985 00010000:00010000:1.0:1789762917.405560:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.405570:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.405576:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570aef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.405581:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762917.405585:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570aef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.405591:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570aef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.405606:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570aef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.405611:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9bf355/0xd08452c77c570aef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762917.405667:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140816640:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11638us (47877us total) trans 4294967871 rc 0/0 00000100:00100000:1.0:1789762917.405675:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 558 00000100:00100000:1.0:1789762917.405684:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321867062162 time 321867168128 state 0x2 ref 0 00000100:00100000:2.0:1789762917.408020:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762917.408051:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140816768 00000100:00100000:1.0:1789762917.408060:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140816768 00000100:00100000:1.0:1789762917.408096:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321867062162 time 321867168128 state 0x0 ref 1 00000100:00100000:1.0:1789762917.408108:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321917168128 time 321867168128 state 0x1 ref 1 00010000:00010000:0.0:1789762917.414960:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762917.444127:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321917168128 time 321917277094 state 0x0 ref 1 00000100:00100000:0.0:1789762917.444152:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140816768:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762917.444200:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 65011712, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x1f009 00010000:00010000:0.0:1789762917.444206:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570af6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762917.444220:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1789762917.444223:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762917.444240:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762917.444251:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762917.454961:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967872 is committed 00002000:00010000:3.0:1789762917.454966:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:3.0:1789762917.454971:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 126985 -> 129033 00010000:00010000:3.0:1789762917.454983:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.454992:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.454999:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570af6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.455004:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762917.455008:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570af6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.455014:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570af6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.455040:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570af6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.455045:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570af6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762917.455103:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140816768:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10959us (47082us total) trans 4294967872 rc 0/0 00000100:00100000:3.0:1789762917.455110:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 559 00000100:00100000:3.0:1789762917.455119:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321917168128 time 321917277094 state 0x2 ref 0 00000100:00100000:0.0:1789762917.457050:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762917.457126:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140816896 00000100:00100000:1.0:1789762917.457135:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140816896 00000100:00100000:1.0:1789762917.457173:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321917168128 time 321917277094 state 0x0 ref 1 00000100:00100000:1.0:1789762917.457183:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321967277094 time 321917277094 state 0x1 ref 1 00000100:00100000:1.0:1789762917.494199:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321967277094 time 321967351186 state 0x0 ref 1 00000100:00100000:1.0:1789762917.494220:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140816896:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762917.494262:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 66060288, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x1f809 00010000:00010000:1.0:1789762917.494269:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570afd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.494281:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1789762917.494284:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762917.494288:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.494298:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762917.505681:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967873 is committed 00002000:00010000:1.0:1789762917.505683:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:1.0:1789762917.505689:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 129033 -> 131081 00010000:00010000:1.0:1789762917.505699:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.505710:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.505717:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.505722:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762917.505726:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.505732:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570afd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.505745:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570afd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.505750:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570afd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762917.505808:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140816896:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11594us (48759us total) trans 4294967873 rc 0/0 00000100:00100000:1.0:1789762917.505822:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 560 00000100:00100000:1.0:1789762917.505830:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321967277094 time 321967351186 state 0x2 ref 0 00000100:00100000:2.0:1789762917.508116:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762917.508152:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140817024 00000100:00100000:1.0:1789762917.508161:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140817024 00000100:00100000:1.0:1789762917.508196:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 321967277094 time 321967351186 state 0x0 ref 1 00000100:00100000:1.0:1789762917.508208:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322017351186 time 321967351186 state 0x1 ref 1 00000100:00100000:3.0:1789762917.544294:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322017351186 time 322017446697 state 0x0 ref 1 00000100:00100000:3.0:1789762917.544313:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140817024:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762917.544354:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 67108864, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x20009 00010000:00010000:3.0:1789762917.544361:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.544374:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1789762917.544377:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762917.544382:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.544393:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762917.555111:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967874 is committed 00002000:00010000:3.0:1789762917.555139:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:3.0:1789762917.555144:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 131081 -> 133129 00010000:00010000:3.0:1789762917.555154:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.555165:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.555171:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.555176:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762917.555180:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.555187:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.555201:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.555213:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762917.555280:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140817024:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10970us (47164us total) trans 4294967874 rc 0/0 00000100:00100000:3.0:1789762917.555296:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 561 00000100:00100000:3.0:1789762917.555305:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322017351186 time 322017446697 state 0x2 ref 0 00000100:00100000:2.0:1789762917.557500:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762917.557533:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140817152 00000100:00100000:3.0:1789762917.557552:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140817152 00000100:00100000:3.0:1789762917.557588:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322017351186 time 322017446697 state 0x0 ref 1 00000100:00100000:3.0:1789762917.557599:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322067446697 time 322017446697 state 0x1 ref 1 00000100:00100000:0.0:1789762917.594374:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322067446697 time 322067526783 state 0x0 ref 1 00000100:00100000:0.0:1789762917.594395:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140817152:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762917.594437:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 68157440, mtime: 0x6aad9d64, atime: 0x0, ctime: 0x6aad9d64, blocks: 0x20809 00010000:00010000:0.0:1789762917.594444:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072e6268c/0xd08452c77c570b0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762917.594457:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1789762917.594461:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762917.594466:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072e6268c/0xd08452c77c570b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762917.594481:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072e6268c/0xd08452c77c570b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762917.604801:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967875 is committed 00002000:00010000:3.0:1789762917.604818:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:3.0:1789762917.604823:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb mtime from disk: 1789762916 -> 1789762917 00002000:00010000:3.0:1789762917.604826:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb ctime from disk: 1789762916 -> 1789762917 00002000:00010000:3.0:1789762917.604828:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 133129 -> 135177 00010000:00010000:3.0:1789762917.604854:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072e6268c/0xd08452c77c570b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.604864:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072e6268c/0xd08452c77c570b0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.604870:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072e6268c/0xd08452c77c570b0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.604875:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762917.604878:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072e6268c/0xd08452c77c570b0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.604896:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072e6268c/0xd08452c77c570b0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.604910:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072e6268c/0xd08452c77c570b0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.604916:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072e6268c/0xd08452c77c570b0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762917.604976:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140817152:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10587us (47474us total) trans 4294967875 rc 0/0 00000100:00100000:3.0:1789762917.604985:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 562 00000100:00100000:3.0:1789762917.604996:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322067446697 time 322067526783 state 0x2 ref 0 00000100:00100000:0.0:1789762917.607202:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762917.607244:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140817280 00000100:00100000:1.0:1789762917.607252:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140817280 00000100:00100000:1.0:1789762917.607289:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322067446697 time 322067526783 state 0x0 ref 1 00000100:00100000:1.0:1789762917.607300:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322117526783 time 322067526783 state 0x1 ref 1 00000100:00100000:3.0:1789762917.644526:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322117526783 time 322117675494 state 0x0 ref 1 00000100:00100000:3.0:1789762917.644565:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140817280:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762917.644617:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 69206016, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x21009 00010000:00010000:3.0:1789762917.644624:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.644638:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1789762917.644642:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762917.644646:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.644671:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762917.655148:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967876 is committed 00002000:00010000:3.0:1789762917.655192:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 69206016 -> 70254592 00002000:00010000:3.0:1789762917.655197:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 135177 -> 137225 00010000:00010000:3.0:1789762917.655206:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.655215:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.655222:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.655227:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762917.655230:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.655237:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.655250:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.655255:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762917.655321:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140817280:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10766us (48118us total) trans 4294967876 rc 0/0 00000100:00100000:3.0:1789762917.655328:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 563 00000100:00100000:3.0:1789762917.655336:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322117526783 time 322117675494 state 0x2 ref 0 00000100:00100000:2.0:1789762917.657345:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762917.657379:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140817408 00000100:00100000:3.0:1789762917.657388:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140817408 00000100:00100000:3.0:1789762917.657423:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322117526783 time 322117675494 state 0x0 ref 1 00000100:00100000:3.0:1789762917.657435:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322167675494 time 322117675494 state 0x1 ref 1 00000100:00100000:1.0:1789762917.694684:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322167675494 time 322167818301 state 0x0 ref 1 00000100:00100000:1.0:1789762917.694730:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140817408:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762917.694806:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 70254592, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x21809 00010000:00010000:1.0:1789762917.694824:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.694919:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1789762917.694923:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762917.694941:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.694953:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762917.712983:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967877 is committed 00002000:00010000:3.0:1789762917.713018:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:3.0:1789762917.713027:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 137225 -> 139273 00010000:00010000:3.0:1789762917.713043:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.713060:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.713071:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.713079:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762917.713083:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.713102:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.713122:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b19 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.713129:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762917.713204:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140817408:12345-192.168.203.31@tcp:4:dd.500 Request processed in 18493us (55857us total) trans 4294967877 rc 0/0 00000100:00100000:3.0:1789762917.713213:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 564 00000100:00100000:3.0:1789762917.713223:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322167675494 time 322167818301 state 0x2 ref 0 00000100:00100000:2.0:1789762917.716144:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762917.716216:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140817536 00000100:00100000:3.0:1789762917.716231:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140817536 00000100:00100000:3.0:1789762917.716290:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322167675494 time 322167818301 state 0x0 ref 1 00000100:00100000:3.0:1789762917.716309:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322217818301 time 322167818301 state 0x1 ref 1 00000100:00100000:3.0:1789762917.744771:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322217818301 time 322217920826 state 0x0 ref 1 00000100:00100000:3.0:1789762917.744799:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140817536:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762917.744908:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 71303168, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x22009 00010000:00010000:3.0:1789762917.744920:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.744952:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1789762917.744956:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762917.744962:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.744974:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762917.761897:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967878 is committed 00002000:00010000:3.0:1789762917.761926:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:3.0:1789762917.761933:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 139273 -> 141321 00010000:00010000:3.0:1789762917.761946:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.761959:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.761968:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.761975:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762917.761979:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.762003:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.762022:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.762029:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762917.762117:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140817536:12345-192.168.203.31@tcp:4:dd.500 Request processed in 17323us (45977us total) trans 4294967878 rc 0/0 00000100:00100000:3.0:1789762917.762128:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 565 00000100:00100000:3.0:1789762917.762139:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322217818301 time 322217920826 state 0x2 ref 0 00000100:00100000:0.0:1789762917.764971:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762917.765031:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140817664 00000100:00100000:3.0:1789762917.765042:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140817664 00000100:00100000:3.0:1789762917.765089:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322217818301 time 322217920826 state 0x0 ref 1 00000100:00100000:3.0:1789762917.765104:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322267920826 time 322217920826 state 0x1 ref 1 00000100:00100000:0.0:1789762917.794915:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322267920826 time 322268064373 state 0x0 ref 1 00000100:00100000:0.0:1789762917.794942:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140817664:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762917.794993:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 72351744, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x22809 00010000:00010000:0.0:1789762917.795002:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570b27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762917.795019:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1789762917.795023:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762917.795029:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570b27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762917.795043:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570b27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762917.810139:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967879 is committed 00002000:00010000:3.0:1789762917.810163:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:3.0:1789762917.810170:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 141321 -> 143369 00010000:00010000:3.0:1789762917.810185:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570b27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.810222:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570b27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.810236:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570b27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.810246:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762917.810251:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570b27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.810260:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570b27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.810278:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570b27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.810284:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c570b27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762917.810361:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140817664:12345-192.168.203.31@tcp:4:dd.500 Request processed in 15427us (45390us total) trans 4294967879 rc 0/0 00000100:00100000:3.0:1789762917.810372:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 566 00000100:00100000:3.0:1789762917.810383:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322267920826 time 322268064373 state 0x2 ref 0 00000100:00100000:2.0:1789762917.813153:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762917.813202:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140817792 00000100:00100000:3.0:1789762917.813234:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140817792 00000100:00100000:3.0:1789762917.813284:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322267920826 time 322268064373 state 0x0 ref 1 00000100:00100000:3.0:1789762917.813299:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322318064373 time 322268064373 state 0x1 ref 1 00000100:00100000:1.0:1789762917.845077:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322318064373 time 322318214094 state 0x0 ref 1 00000100:00100000:1.0:1789762917.845138:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140817792:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762917.845232:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 73400320, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x23009 00010000:00010000:1.0:1789762917.845244:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.845264:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1789762917.845269:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762917.845276:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.845308:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762917.858748:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967880 is committed 00002000:00010000:3.0:1789762917.858762:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:3.0:1789762917.858767:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 143369 -> 145417 00010000:00010000:3.0:1789762917.858778:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.858787:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.858794:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.858799:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762917.858802:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.858810:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.858824:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.858829:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762917.858909:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140817792:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13807us (45756us total) trans 4294967880 rc 0/0 00000100:00100000:3.0:1789762917.858917:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 567 00000100:00100000:3.0:1789762917.858926:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322318064373 time 322318214094 state 0x2 ref 0 00000100:00100000:0.0:1789762917.860930:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762917.860963:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140817920 00000100:00100000:3.0:1789762917.860972:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140817920 00000100:00100000:3.0:1789762917.861017:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322318064373 time 322318214094 state 0x0 ref 1 00000100:00100000:3.0:1789762917.861029:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322368214094 time 322318214094 state 0x1 ref 1 00000100:00100000:1.0:1789762917.895137:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322368214094 time 322368288248 state 0x0 ref 1 00000100:00100000:1.0:1789762917.895158:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140817920:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762917.895209:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 74448896, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x23809 00010000:00010000:1.0:1789762917.895216:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.895228:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1789762917.895231:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762917.895236:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.895246:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762917.906063:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967881 is committed 00002000:00010000:3.0:1789762917.906093:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:3.0:1789762917.906099:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 145417 -> 147465 00010000:00010000:3.0:1789762917.906112:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.906125:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.906137:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.906146:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762917.906151:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.906171:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.906190:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.906200:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570b35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762917.906274:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140817920:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11119us (45340us total) trans 4294967881 rc 0/0 00000100:00100000:3.0:1789762917.906286:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 568 00000100:00100000:3.0:1789762917.906298:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322368214094 time 322368288248 state 0x2 ref 0 00000100:00100000:0.0:1789762917.908517:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762917.908563:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140818048 00000100:00100000:3.0:1789762917.908573:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140818048 00000100:00100000:3.0:1789762917.908618:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322368214094 time 322368288248 state 0x0 ref 1 00000100:00100000:3.0:1789762917.908631:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322418288248 time 322368288248 state 0x1 ref 1 00000100:00100000:0.0:1789762917.945256:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322418288248 time 322418407853 state 0x0 ref 1 00000100:00100000:0.0:1789762917.945292:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140818048:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762917.945338:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 75497472, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x24009 00010000:00010000:0.0:1789762917.945345:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570b3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762917.945374:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1789762917.945377:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762917.945382:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570b3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762917.945393:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570b3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762917.956707:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967882 is committed 00002000:00010000:3.0:1789762917.956718:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 75497472 -> 76546048 00002000:00010000:3.0:1789762917.956724:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 147465 -> 149513 00010000:00010000:3.0:1789762917.956737:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570b3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.956775:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570b3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.956785:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570b3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.956793:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762917.956799:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570b3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.956809:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570b3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.956828:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570b3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762917.956857:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570b3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762917.956929:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140818048:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11657us (48411us total) trans 4294967882 rc 0/0 00000100:00100000:3.0:1789762917.956939:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 569 00000100:00100000:3.0:1789762917.956949:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322418288248 time 322418407853 state 0x2 ref 0 00000100:00100000:2.0:1789762917.959345:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762917.959380:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140818176 00000100:00100000:3.0:1789762917.959395:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140818176 00000100:00100000:3.0:1789762917.959433:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322418288248 time 322418407853 state 0x0 ref 1 00000100:00100000:3.0:1789762917.959444:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322468407853 time 322418407853 state 0x1 ref 1 00000100:00100000:1.0:1789762917.995335:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322468407853 time 322468476247 state 0x0 ref 1 00000100:00100000:1.0:1789762917.995360:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140818176:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762917.995407:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 76546048, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x24809 00010000:00010000:1.0:1789762917.995414:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.995425:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1789762917.995429:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762917.995433:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762917.995443:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762918.006862:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:1.0:1789762918.006868:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 149513 -> 151561 00010000:00010000:1.0:1789762918.006880:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762918.006880:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967883 is committed 00010000:00010000:1.0:1789762918.006893:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.006900:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.006905:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762918.006909:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.006915:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.006928:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.006933:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762918.006989:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140818176:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11637us (47645us total) trans 4294967883 rc 0/0 00000100:00100000:1.0:1789762918.007010:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 570 00000100:00100000:1.0:1789762918.007018:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322468407853 time 322468476247 state 0x2 ref 0 00000100:00100000:2.0:1789762918.009084:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762918.009130:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140818304 00000100:00100000:3.0:1789762918.009138:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140818304 00000100:00100000:3.0:1789762918.009173:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322468407853 time 322468476247 state 0x0 ref 1 00000100:00100000:3.0:1789762918.009184:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322518476247 time 322468476247 state 0x1 ref 1 00000100:00100000:1.0:1789762918.045403:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322518476247 time 322518550453 state 0x0 ref 1 00000100:00100000:1.0:1789762918.045427:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140818304:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762918.045476:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 77594624, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x25009 00010000:00010000:1.0:1789762918.045483:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.045496:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1789762918.045500:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762918.045506:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.045517:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762918.056482:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967884 is committed 00002000:00010000:3.0:1789762918.056506:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:3.0:1789762918.056513:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 151561 -> 153609 00010000:00010000:3.0:1789762918.056526:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.056552:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.056562:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.056571:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762918.056576:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.056587:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.056616:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b4a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.056626:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570b4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762918.056699:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140818304:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11278us (47613us total) trans 4294967884 rc 0/0 00000100:00100000:3.0:1789762918.056710:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 571 00000100:00100000:3.0:1789762918.056722:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322518476247 time 322518550453 state 0x2 ref 0 00000100:00100000:2.0:1789762918.058993:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762918.059209:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140818432 00000100:00100000:3.0:1789762918.059220:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140818432 00000100:00100000:3.0:1789762918.059268:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322518476247 time 322518550453 state 0x0 ref 1 00000100:00100000:3.0:1789762918.059280:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322568550453 time 322518550453 state 0x1 ref 1 00000100:00100000:2.0:1789762918.095477:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322568550453 time 322568630965 state 0x0 ref 1 00000100:00100000:2.0:1789762918.095495:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140818432:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762918.095552:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 78643200, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x25809 00010000:00010000:2.0:1789762918.095560:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570b51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762918.095572:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1789762918.095576:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762918.095581:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762918.095591:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762918.106714:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967885 is committed 00002000:00010000:3.0:1789762918.106730:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 78643200 -> 79691776 00002000:00010000:3.0:1789762918.106735:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 153609 -> 155657 00010000:00010000:3.0:1789762918.106745:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.106754:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570b51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.106772:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570b51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.106777:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762918.106780:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570b51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.106786:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570b51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.106800:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570b51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.106806:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570b51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762918.106887:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140818432:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11395us (47897us total) trans 4294967885 rc 0/0 00000100:00100000:3.0:1789762918.106895:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 572 00000100:00100000:3.0:1789762918.106903:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322568550453 time 322568630965 state 0x2 ref 0 00000100:00100000:0.0:1789762918.108858:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762918.108889:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140818560 00000100:00100000:1.0:1789762918.108897:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140818560 00000100:00100000:1.0:1789762918.108931:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322568550453 time 322568630965 state 0x0 ref 1 00000100:00100000:1.0:1789762918.108940:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322618630965 time 322568630965 state 0x1 ref 1 00000100:00100000:0.0:1789762918.145589:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322618630965 time 322618741311 state 0x0 ref 1 00000100:00100000:0.0:1789762918.145610:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140818560:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762918.145652:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 79691776, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x26009 00010000:00010000:0.0:1789762918.145670:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570b58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.145683:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1789762918.145686:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762918.145690:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.145701:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762918.157676:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967886 is committed 00002000:00010000:3.0:1789762918.157710:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:3.0:1789762918.157715:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 155657 -> 157705 00010000:00010000:3.0:1789762918.157723:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.157744:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570b58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.157751:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570b58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.157755:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762918.157759:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570b58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.157766:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570b58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.157779:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570b58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.157784:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005d19c2/0xd08452c77c570b58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762918.157877:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140818560:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12273us (49040us total) trans 4294967886 rc 0/0 00000100:00100000:3.0:1789762918.157886:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 573 00000100:00100000:3.0:1789762918.157894:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322618630965 time 322618741311 state 0x2 ref 0 00000100:00100000:2.0:1789762918.160088:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762918.160129:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140818688 00000100:00100000:3.0:1789762918.160144:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140818688 00000100:00100000:3.0:1789762918.160206:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322618630965 time 322618741311 state 0x0 ref 1 00000100:00100000:3.0:1789762918.160221:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322668741311 time 322618741311 state 0x1 ref 1 00000100:00100000:1.0:1789762918.195676:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322668741311 time 322668830603 state 0x0 ref 1 00000100:00100000:1.0:1789762918.195693:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140818688:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762918.195743:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 80740352, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x26809 00010000:00010000:1.0:1789762918.195750:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570b5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.195762:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1789762918.195765:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762918.195770:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570b5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.195780:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570b5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762918.207081:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967887 is committed 00002000:00010000:3.0:1789762918.207119:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 80740352 -> 81788928 00002000:00010000:3.0:1789762918.207124:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 157705 -> 159753 00010000:00010000:3.0:1789762918.207145:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570b5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.207155:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570b5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.207161:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570b5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.207166:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762918.207170:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570b5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.207177:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570b5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.207189:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570b5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.207194:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570b5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762918.207262:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140818688:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11572us (47184us total) trans 4294967887 rc 0/0 00000100:00100000:3.0:1789762918.207270:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 574 00000100:00100000:3.0:1789762918.207278:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322668741311 time 322668830603 state 0x2 ref 0 00000100:00100000:3.0:1789762918.209476:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762918.209516:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140818816 00000100:00100000:2.0:1789762918.209525:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140818816 00000100:00100000:2.0:1789762918.209581:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322668741311 time 322668830603 state 0x0 ref 1 00000100:00100000:2.0:1789762918.209596:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322718830603 time 322668830603 state 0x1 ref 1 00000100:00100000:3.0:1789762918.245773:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322718830603 time 322718922271 state 0x0 ref 1 00000100:00100000:3.0:1789762918.245809:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140818816:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762918.245875:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 81788928, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x27009 00010000:00010000:3.0:1789762918.245882:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.245896:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1789762918.245899:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762918.245904:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.245914:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762918.257118:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 81788928 -> 82837504 00000001:00080000:2.0:1789762918.257118:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967888 is committed 00002000:00010000:1.0:1789762918.257125:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 159753 -> 161801 00010000:00010000:1.0:1789762918.257138:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.257150:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.257161:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.257183:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fc00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762918.257188:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.257195:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.257210:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.257215:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015a9225/0xd08452c77c570b66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762918.257272:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140818816:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11483us (47794us total) trans 4294967888 rc 0/0 00000100:00100000:1.0:1789762918.257278:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 575 00000100:00100000:1.0:1789762918.257287:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322718830603 time 322718922271 state 0x2 ref 0 00000100:00100000:3.0:1789762918.259431:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762918.259485:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140818944 00000100:00100000:0.0:1789762918.259493:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140818944 00000100:00100000:0.0:1789762918.259528:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322718830603 time 322718922271 state 0x0 ref 1 00000100:00100000:0.0:1789762918.259554:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322768922271 time 322718922271 state 0x1 ref 1 00000100:00100000:0.0:1789762918.295868:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322768922271 time 322768994644 state 0x0 ref 1 00000100:00100000:0.0:1789762918.295891:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140818944:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762918.295947:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 82837504, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x27809 00010000:00010000:0.0:1789762918.295954:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570b6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.295969:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1789762918.295974:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762918.295981:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570b6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.295996:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570b6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762918.308027:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967889 is committed 00002000:00010000:3.0:1789762918.308044:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:3.0:1789762918.308050:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 161801 -> 163849 00010000:00010000:3.0:1789762918.308067:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570b6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.308076:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570b6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.308083:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570b6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.308088:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762918.308091:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570b6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.308098:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.308113:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570b6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.308121:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570b6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762918.308202:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140818944:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12318us (48771us total) trans 4294967889 rc 0/0 00000100:00100000:3.0:1789762918.308222:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 576 00000100:00100000:3.0:1789762918.308231:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322768922271 time 322768994644 state 0x2 ref 0 00000100:00100000:3.0:1789762918.310626:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762918.310682:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140819072 00000100:00100000:1.0:1789762918.310690:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140819072 00000100:00100000:1.0:1789762918.310741:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322768922271 time 322768994644 state 0x0 ref 1 00000100:00100000:1.0:1789762918.310752:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322818994644 time 322768994644 state 0x1 ref 1 00000100:00100000:1.0:1789762918.345903:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322818994644 time 322819058966 state 0x0 ref 1 00000100:00100000:1.0:1789762918.345929:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140819072:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762918.345967:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 83886080, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x28009 00010000:00010000:1.0:1789762918.345974:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.345985:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1789762918.345989:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762918.345993:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.346002:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762918.356524:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967890 is committed 00002000:00010000:1.0:1789762918.356528:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:1.0:1789762918.356545:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 163849 -> 165897 00010000:00010000:1.0:1789762918.356555:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.356565:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.356572:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.356577:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762918.356587:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.356594:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.356607:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.356614:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762918.356686:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140819072:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10759us (46059us total) trans 4294967890 rc 0/0 00000100:00100000:1.0:1789762918.356694:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 577 00000100:00100000:1.0:1789762918.356702:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322818994644 time 322819058966 state 0x2 ref 0 00000100:00100000:2.0:1789762918.358745:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762918.358782:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140819200 00000100:00100000:1.0:1789762918.358802:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140819200 00000100:00100000:1.0:1789762918.358850:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322818994644 time 322819058966 state 0x0 ref 1 00000100:00100000:1.0:1789762918.358861:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322869058966 time 322819058966 state 0x1 ref 1 00000100:00100000:3.0:1789762918.396026:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322869058966 time 322869171924 state 0x0 ref 1 00000100:00100000:3.0:1789762918.396044:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d151b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140819200:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762918.396099:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 84934656, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x28809 00010000:00010000:3.0:1789762918.396108:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570b7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.396123:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1789762918.396126:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762918.396131:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570b7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.396141:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570b7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762918.406930:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:0.0:1789762918.406936:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 165897 -> 167945 00000001:00080000:3.0:1789762918.406937:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967891 is committed 00010000:00010000:0.0:1789762918.406947:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570b7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.406964:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570b7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.406972:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570b7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.406977:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762918.406981:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570b7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.406994:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570b7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.407007:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570b7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.407012:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fc6d0b2/0xd08452c77c570b7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762918.407076:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d151b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140819200:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11036us (48331us total) trans 4294967891 rc 0/0 00000100:00100000:0.0:1789762918.407085:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 578 00000100:00100000:0.0:1789762918.407096:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322869058966 time 322869171924 state 0x2 ref 0 00000100:00100000:0.0:1789762918.409373:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762918.409430:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140819328 00000100:00100000:3.0:1789762918.409437:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140819328 00000100:00100000:3.0:1789762918.409477:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322869058966 time 322869171924 state 0x0 ref 1 00000100:00100000:3.0:1789762918.409492:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322919171924 time 322869171924 state 0x1 ref 1 00010000:00010000:2.0:1789762918.438964:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762918.446147:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322919171924 time 322919300826 state 0x0 ref 1 00000100:00100000:2.0:1789762918.446169:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140819328:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762918.446214:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 85983232, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x29009 00010000:00010000:2.0:1789762918.446233:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8c3f453/0xd08452c77c570b82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762918.446245:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1789762918.446249:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762918.446253:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8c3f453/0xd08452c77c570b82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762918.446263:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8c3f453/0xd08452c77c570b82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762918.456710:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967892 is committed 00002000:00010000:0.0:1789762918.456740:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:0.0:1789762918.456745:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 167945 -> 169993 00010000:00010000:0.0:1789762918.456754:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8c3f453/0xd08452c77c570b82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.456764:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8c3f453/0xd08452c77c570b82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.456771:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8c3f453/0xd08452c77c570b82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.456776:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762918.456779:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8c3f453/0xd08452c77c570b82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.456786:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8c3f453/0xd08452c77c570b82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.456799:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8c3f453/0xd08452c77c570b82 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.456804:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8c3f453/0xd08452c77c570b82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762918.456888:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140819328:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10726us (47514us total) trans 4294967892 rc 0/0 00000100:00100000:0.0:1789762918.456896:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 579 00000100:00100000:0.0:1789762918.456910:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322919171924 time 322919300826 state 0x2 ref 0 00000100:00100000:0.0:1789762918.459055:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762918.459105:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140819456 00000100:00100000:1.0:1789762918.459113:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140819456 00000100:00100000:1.0:1789762918.459147:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322919171924 time 322919300826 state 0x0 ref 1 00000100:00100000:1.0:1789762918.459167:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322969300826 time 322919300826 state 0x1 ref 1 00000100:00100000:0.0:1789762918.496245:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322969300826 time 322969399639 state 0x0 ref 1 00000100:00100000:0.0:1789762918.496275:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140819456:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762918.496319:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 87031808, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x29809 00010000:00010000:0.0:1789762918.496340:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c570b89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.496354:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1789762918.496359:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762918.496366:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c570b89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.496379:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c570b89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762918.507765:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967893 is committed 00002000:00010000:0.0:1789762918.507780:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 87031808 -> 88080384 00002000:00010000:0.0:1789762918.507785:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 169993 -> 172041 00010000:00010000:0.0:1789762918.507794:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c570b89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.507804:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c570b89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.507821:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c570b89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.507829:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762918.507853:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c570b89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.507865:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c570b89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.507894:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c570b89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.507900:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ea81a4d/0xd08452c77c570b89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762918.507965:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140819456:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11705us (48909us total) trans 4294967893 rc 0/0 00000100:00100000:0.0:1789762918.507973:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 580 00000100:00100000:0.0:1789762918.507981:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322969300826 time 322969399639 state 0x2 ref 0 00000100:00100000:2.0:1789762918.510274:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762918.510309:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140819584 00000100:00100000:0.0:1789762918.510328:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140819584 00000100:00100000:0.0:1789762918.510369:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 322969300826 time 322969399639 state 0x0 ref 1 00000100:00100000:0.0:1789762918.510400:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323019399639 time 322969399639 state 0x1 ref 1 00000100:00100000:1.0:1789762918.546361:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323019399639 time 323019505473 state 0x0 ref 1 00000100:00100000:1.0:1789762918.546379:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140819584:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762918.546413:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 88080384, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x2a009 00010000:00010000:1.0:1789762918.546420:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.546430:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1789762918.546433:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762918.546437:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.546447:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762918.556870:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:0.0:1789762918.556877:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 172041 -> 174089 00000001:00080000:3.0:1789762918.556881:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967894 is committed 00010000:00010000:0.0:1789762918.556888:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.556898:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.556905:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.556911:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762918.556915:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.556921:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.556944:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.556949:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d0ab47/0xd08452c77c570b90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762918.557023:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140819584:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10647us (46748us total) trans 4294967894 rc 0/0 00000100:00100000:0.0:1789762918.557031:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 581 00000100:00100000:0.0:1789762918.557040:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323019399639 time 323019505473 state 0x2 ref 0 00000100:00100000:2.0:1789762918.559294:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762918.559345:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140819712 00000100:00100000:0.0:1789762918.559354:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140819712 00000100:00100000:0.0:1789762918.559399:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323019399639 time 323019505473 state 0x0 ref 1 00000100:00100000:0.0:1789762918.559409:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323069505473 time 323019505473 state 0x1 ref 1 00000001:00080000:3.0:1789762918.581770:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967395 is committed 00000001:00080000:3.0:1789762918.581799:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967397 is committed 00000001:00080000:3.0:1789762918.581803:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967396 is committed 00000100:00100000:3.0:1789762918.596475:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323069505473 time 323069628244 state 0x0 ref 1 00000100:00100000:3.0:1789762918.596503:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140819712:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762918.596565:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 89128960, mtime: 0x6aad9d65, atime: 0x0, ctime: 0x6aad9d65, blocks: 0x2a809 00010000:00010000:3.0:1789762918.596573:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570b97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.596596:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1789762918.596599:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762918.596604:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570b97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.596615:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570b97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762918.608688:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967895 is committed 00002000:00010000:0.0:1789762918.608717:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:0.0:1789762918.608722:0:11722:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb mtime from disk: 1789762917 -> 1789762918 00002000:00010000:0.0:1789762918.608725:0:11722:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb ctime from disk: 1789762917 -> 1789762918 00002000:00010000:0.0:1789762918.608727:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 174089 -> 176137 00010000:00010000:0.0:1789762918.608737:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570b97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.608747:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570b97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.608754:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570b97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.608768:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762918.608772:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570b97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.608779:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570b97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.608793:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570b97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.608798:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094764945/0xd08452c77c570b97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762918.608891:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140819712:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12401us (49596us total) trans 4294967895 rc 0/0 00000100:00100000:0.0:1789762918.608899:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 582 00000100:00100000:0.0:1789762918.608908:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323069505473 time 323069628244 state 0x2 ref 0 00000100:00100000:3.0:1789762918.611217:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762918.611254:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140819840 00000100:00100000:0.0:1789762918.611261:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140819840 00000100:00100000:0.0:1789762918.611295:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323069505473 time 323069628244 state 0x0 ref 1 00000100:00100000:0.0:1789762918.611305:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323119628244 time 323069628244 state 0x1 ref 1 00000100:00100000:3.0:1789762918.646571:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323119628244 time 323119708718 state 0x0 ref 1 00000100:00100000:3.0:1789762918.646597:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140819840:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762918.646646:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 90177536, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x2b009 00010000:00010000:3.0:1789762918.646666:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570b9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.646680:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1789762918.646683:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762918.646688:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570b9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.646699:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570b9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762918.658001:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967896 is committed 00002000:00010000:0.0:1789762918.658050:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:0.0:1789762918.658061:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 176137 -> 178185 00010000:00010000:0.0:1789762918.658071:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570b9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.658081:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570b9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.658087:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570b9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.658092:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003fe00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762918.658096:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570b9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.658103:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570b9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.658117:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570b9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.658122:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eeaa51a/0xd08452c77c570b9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762918.658197:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140819840:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11605us (46977us total) trans 4294967896 rc 0/0 00000100:00100000:0.0:1789762918.658208:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 583 00000100:00100000:0.0:1789762918.658220:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323119628244 time 323119708718 state 0x2 ref 0 00000100:00100000:2.0:1789762918.660364:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762918.660397:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140819968 00000100:00100000:0.0:1789762918.660405:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140819968 00000100:00100000:0.0:1789762918.660449:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323119628244 time 323119708718 state 0x0 ref 1 00000100:00100000:0.0:1789762918.660460:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323169708718 time 323119708718 state 0x1 ref 1 00000100:00100000:1.0:1789762918.696615:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323169708718 time 323169768354 state 0x0 ref 1 00000100:00100000:1.0:1789762918.696635:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140819968:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762918.696679:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 91226112, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x2b809 00010000:00010000:1.0:1789762918.696685:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570ba5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.696711:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1789762918.696715:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762918.696719:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570ba5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.696730:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570ba5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762918.708179:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967897 is committed 00002000:00010000:0.0:1789762918.708198:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:0.0:1789762918.708203:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 178185 -> 180233 00010000:00010000:0.0:1789762918.708213:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570ba5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.708223:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570ba5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.708229:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570ba5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.708245:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762918.708248:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570ba5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.708255:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570ba5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.708268:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570ba5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.708284:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570ba5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762918.708338:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140819968:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11707us (47973us total) trans 4294967897 rc 0/0 00000100:00100000:0.0:1789762918.708346:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 584 00000100:00100000:0.0:1789762918.708355:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323169708718 time 323169768354 state 0x2 ref 0 00000100:00100000:3.0:1789762918.710493:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762918.710524:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140820096 00000100:00100000:0.0:1789762918.710543:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140820096 00000100:00100000:0.0:1789762918.710588:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323169708718 time 323169768354 state 0x0 ref 1 00000100:00100000:0.0:1789762918.710598:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323219768354 time 323169768354 state 0x1 ref 1 00000100:00100000:3.0:1789762918.746676:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323219768354 time 323219830346 state 0x0 ref 1 00000100:00100000:3.0:1789762918.746695:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140820096:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762918.746734:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 92274688, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x2c009 00010000:00010000:3.0:1789762918.746740:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570bac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.746752:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1789762918.746756:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762918.746761:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570bac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.746770:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570bac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762918.758395:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967898 is committed 00002000:00010000:0.0:1789762918.758412:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 92274688 -> 93323264 00002000:00010000:0.0:1789762918.758418:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 180233 -> 182281 00010000:00010000:0.0:1789762918.758427:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570bac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.758437:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570bac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.758443:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570bac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.758462:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762918.758467:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570bac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.758477:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570bac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.758496:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570bac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.758504:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b8d81e5/0xd08452c77c570bac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762918.758585:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140820096:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11882us (48079us total) trans 4294967898 rc 0/0 00000100:00100000:0.0:1789762918.758593:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 585 00000100:00100000:0.0:1789762918.758601:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323219768354 time 323219830346 state 0x2 ref 0 00000100:00100000:3.0:1789762918.760612:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762918.760646:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140820224 00000100:00100000:0.0:1789762918.760653:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140820224 00000100:00100000:0.0:1789762918.760687:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323219768354 time 323219830346 state 0x0 ref 1 00000100:00100000:0.0:1789762918.760698:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323269830346 time 323219830346 state 0x1 ref 1 00000100:00100000:3.0:1789762918.796763:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323269830346 time 323269906760 state 0x0 ref 1 00000100:00100000:3.0:1789762918.796793:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140820224:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762918.796869:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 93323264, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x2c809 00010000:00010000:3.0:1789762918.796879:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c570bb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.796896:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1789762918.796901:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762918.796907:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c570bb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.796922:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c570bb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762918.809259:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967899 is committed 00002000:00010000:0.0:1789762918.809261:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 93323264 -> 94371840 00002000:00010000:0.0:1789762918.809272:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 182281 -> 184329 00010000:00010000:0.0:1789762918.809283:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c570bb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.809293:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c570bb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.809309:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c570bb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.809314:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762918.809317:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c570bb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.809324:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c570bb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.809338:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c570bb3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.809343:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5045a74/0xd08452c77c570bb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762918.809398:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140820224:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12616us (48785us total) trans 4294967899 rc 0/0 00000100:00100000:0.0:1789762918.809406:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 586 00000100:00100000:0.0:1789762918.809415:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323269830346 time 323269906760 state 0x2 ref 0 00000100:00100000:1.0:1789762918.811582:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762918.811629:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140820352 00000100:00100000:0.0:1789762918.811637:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140820352 00000100:00100000:0.0:1789762918.811684:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323269830346 time 323269906760 state 0x0 ref 1 00000100:00100000:0.0:1789762918.811695:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323319906760 time 323269906760 state 0x1 ref 1 00000100:00100000:3.0:1789762918.846883:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323319906760 time 323320031906 state 0x0 ref 1 00000100:00100000:3.0:1789762918.846940:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140820352:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762918.846996:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 94371840, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x2d009 00010000:00010000:3.0:1789762918.847015:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c570bba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.847044:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1789762918.847048:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762918.847053:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c570bba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762918.847066:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c570bba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762918.859300:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967900 is committed 00002000:00010000:0.0:1789762918.859372:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 94371840 -> 95420416 00002000:00010000:0.0:1789762918.859377:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 184329 -> 186377 00010000:00010000:0.0:1789762918.859389:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c570bba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.859399:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c570bba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.859405:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c570bba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.859420:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762918.859424:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c570bba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.859430:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c570bba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.859444:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c570bba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.859460:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f07b40b3/0xd08452c77c570bba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762918.859548:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140820352:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12630us (47947us total) trans 4294967900 rc 0/0 00000100:00100000:0.0:1789762918.859559:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 587 00000100:00100000:0.0:1789762918.859572:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323319906760 time 323320031906 state 0x2 ref 0 00000100:00100000:0.0:1789762918.862103:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762918.862144:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140820480 00000100:00100000:3.0:1789762918.862152:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140820480 00000100:00100000:3.0:1789762918.862192:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323319906760 time 323320031906 state 0x0 ref 1 00000100:00100000:3.0:1789762918.862203:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323370031906 time 323320031906 state 0x1 ref 1 00000100:00100000:1.0:1789762918.896948:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323370031906 time 323370100289 state 0x0 ref 1 00000100:00100000:1.0:1789762918.896969:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140820480:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762918.897011:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 95420416, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x2d809 00010000:00010000:1.0:1789762918.897018:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570bc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.897030:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1789762918.897034:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762918.897038:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570bc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.897049:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570bc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762918.909221:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967901 is committed 00002000:00010000:0.0:1789762918.909239:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 95420416 -> 96468992 00002000:00010000:0.0:1789762918.909245:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 186377 -> 188425 00010000:00010000:0.0:1789762918.909254:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570bc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.909263:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570bc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.909270:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570bc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.909275:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762918.909278:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570bc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.909296:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570bc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.909317:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570bc1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.909322:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c570bc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762918.909389:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140820480:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12426us (47285us total) trans 4294967901 rc 0/0 00000100:00100000:0.0:1789762918.909397:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 588 00000100:00100000:0.0:1789762918.909405:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323370031906 time 323370100289 state 0x2 ref 0 00000100:00100000:2.0:1789762918.911454:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762918.911495:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140820608 00000100:00100000:0.0:1789762918.911502:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140820608 00000100:00100000:0.0:1789762918.911551:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323370031906 time 323370100289 state 0x0 ref 1 00000100:00100000:0.0:1789762918.911574:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323420100289 time 323370100289 state 0x1 ref 1 00000100:00100000:1.0:1789762918.947056:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323420100289 time 323420201051 state 0x0 ref 1 00000100:00100000:1.0:1789762918.947099:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140820608:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762918.947159:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 96468992, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x2e009 00010000:00010000:1.0:1789762918.947166:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570bc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.947180:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1789762918.947183:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762918.947188:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570bc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762918.947199:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570bc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762918.959314:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967902 is committed 00002000:00010000:0.0:1789762918.959353:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:0.0:1789762918.959359:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 188425 -> 190473 00010000:00010000:0.0:1789762918.959384:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570bc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.959397:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570bc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.959419:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570bc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.959424:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762918.959428:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570bc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.959434:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570bc8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.959461:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570bc8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.959466:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab5f7fbd/0xd08452c77c570bc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762918.959569:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140820608:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12463us (48101us total) trans 4294967902 rc 0/0 00000100:00100000:0.0:1789762918.959578:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 589 00000100:00100000:0.0:1789762918.959588:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323420100289 time 323420201051 state 0x2 ref 0 00000100:00100000:3.0:1789762918.962111:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762918.962145:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140820736 00000100:00100000:0.0:1789762918.962153:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140820736 00000100:00100000:0.0:1789762918.962192:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323420100289 time 323420201051 state 0x0 ref 1 00000100:00100000:0.0:1789762918.962213:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323470201051 time 323420201051 state 0x1 ref 1 00000100:00100000:0.0:1789762918.997105:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323470201051 time 323470253886 state 0x0 ref 1 00000100:00100000:0.0:1789762918.997130:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140820736:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762918.997185:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 97517568, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x2e809 00010000:00010000:0.0:1789762918.997195:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570bcf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.997213:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1789762918.997217:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762918.997223:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570bcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762918.997234:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570bcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762919.009480:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967903 is committed 00002000:00010000:0.0:1789762919.009519:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 97517568 -> 98566144 00002000:00010000:0.0:1789762919.009551:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 190473 -> 192521 00010000:00010000:0.0:1789762919.009564:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570bcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.009575:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570bcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.009594:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570bcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.009609:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.009613:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570bcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.009619:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570bcf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.009635:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570bcf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.009641:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570bcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.009711:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140820736:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12588us (47598us total) trans 4294967903 rc 0/0 00000100:00100000:0.0:1789762919.009720:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 590 00000100:00100000:0.0:1789762919.009730:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323470201051 time 323470253886 state 0x2 ref 0 00000100:00100000:2.0:1789762919.012300:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.012372:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140820864 00000100:00100000:0.0:1789762919.012393:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140820864 00000100:00080000:3.0:1789762919.012437:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762919.012446:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323470201051 time 323470253886 state 0x0 ref 1 00000100:00100000:0.0:1789762919.012477:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323520253886 time 323470253886 state 0x1 ref 1 00000100:00100000:1.0:1789762919.047173:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323520253886 time 323520316460 state 0x0 ref 1 00000100:00100000:1.0:1789762919.047197:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140820864:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762919.047246:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 98566144, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x2f009 00010000:00010000:1.0:1789762919.047253:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570bd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.047266:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1789762919.047269:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762919.047274:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570bd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.047299:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570bd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762919.058907:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967904 is committed 00002000:00010000:0.0:1789762919.058921:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:0.0:1789762919.058927:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 192521 -> 194569 00010000:00010000:0.0:1789762919.058939:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570bd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.058949:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570bd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.058956:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570bd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.058962:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.058965:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570bd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.058971:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570bd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.058986:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570bd6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.058991:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570bd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.059082:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140820864:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11890us (46780us total) trans 4294967904 rc 0/0 00000100:00100000:0.0:1789762919.059092:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 591 00000100:00100000:0.0:1789762919.059102:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323520253886 time 323520316460 state 0x2 ref 0 00000100:00100000:2.0:1789762919.061182:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.061222:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140820992 00000100:00100000:0.0:1789762919.061232:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140820992 00000100:00100000:0.0:1789762919.061275:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323520253886 time 323520316460 state 0x0 ref 1 00000100:00100000:0.0:1789762919.061286:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323570316460 time 323520316460 state 0x1 ref 1 00000100:00100000:3.0:1789762919.097246:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323570316460 time 323570400076 state 0x0 ref 1 00000100:00100000:3.0:1789762919.097267:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173c63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140820992:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762919.097312:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 99614720, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x2f809 00010000:00010000:3.0:1789762919.097332:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570bdd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.097347:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1789762919.097351:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762919.097356:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570bdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.097367:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570bdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762919.110255:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967905 is committed 00002000:00010000:0.0:1789762919.110266:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:0.0:1789762919.110272:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 194569 -> 196617 00010000:00010000:0.0:1789762919.110284:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570bdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.110294:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570bdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.110300:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570bdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.110305:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.110309:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570bdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.110322:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570bdd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.110337:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570bdd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.110342:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570bdd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.110403:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173c63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140820992:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13142us (49221us total) trans 4294967905 rc 0/0 00000100:00100000:0.0:1789762919.110412:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 592 00000100:00100000:0.0:1789762919.110421:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323570316460 time 323570400076 state 0x2 ref 0 00000100:00100000:2.0:1789762919.112559:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.112613:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140821120 00000100:00100000:0.0:1789762919.112623:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140821120 00000100:00100000:0.0:1789762919.112669:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323570316460 time 323570400076 state 0x0 ref 1 00000100:00100000:0.0:1789762919.112682:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323620400076 time 323570400076 state 0x1 ref 1 00000100:00100000:3.0:1789762919.147340:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323620400076 time 323620486018 state 0x0 ref 1 00000100:00100000:3.0:1789762919.147376:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140821120:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762919.147421:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 100663296, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x30009 00010000:00010000:3.0:1789762919.147429:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570be4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.147442:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1789762919.147446:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762919.147450:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570be4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.147464:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570be4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762919.158611:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967906 is committed 00002000:00010000:0.0:1789762919.158674:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:0.0:1789762919.158679:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 196617 -> 198667 00010000:00010000:0.0:1789762919.158689:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570be4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.158710:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570be4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.158717:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570be4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.158722:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ec00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.158725:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570be4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.158731:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570be4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.158745:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570be4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.158751:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570be4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.158809:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140821120:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11451us (46250us total) trans 4294967906 rc 0/0 00000100:00100000:0.0:1789762919.158816:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 593 00000100:00100000:0.0:1789762919.158825:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323620400076 time 323620486018 state 0x2 ref 0 00000100:00100000:0.0:1789762919.160931:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762919.160993:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140821248 00000100:00100000:1.0:1789762919.161002:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140821248 00000100:00100000:1.0:1789762919.161048:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323620400076 time 323620486018 state 0x0 ref 1 00000100:00100000:1.0:1789762919.161064:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323670486018 time 323620486018 state 0x1 ref 1 00000100:00100000:3.0:1789762919.197415:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323670486018 time 323670567142 state 0x0 ref 1 00000100:00100000:3.0:1789762919.197436:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140821248:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762919.197485:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 101711872, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x3080b 00010000:00010000:3.0:1789762919.197495:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570beb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.197511:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1789762919.197515:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762919.197520:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570beb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.197546:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570beb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762919.209098:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967907 is committed 00002000:00010000:0.0:1789762919.209157:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 101711872 -> 102760448 00002000:00010000:0.0:1789762919.209162:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 198667 -> 200715 00010000:00010000:0.0:1789762919.209174:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570beb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.209186:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570beb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.209197:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570beb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.209205:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ec00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.209211:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570beb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.209221:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570beb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.209241:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570beb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.209249:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570beb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.209317:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140821248:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11885us (48386us total) trans 4294967907 rc 0/0 00000100:00100000:0.0:1789762919.209328:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 594 00000100:00100000:0.0:1789762919.209347:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323670486018 time 323670567142 state 0x2 ref 0 00000100:00100000:0.0:1789762919.211263:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762919.211301:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140821376 00000100:00100000:3.0:1789762919.211307:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140821376 00000100:00100000:3.0:1789762919.211342:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323670486018 time 323670567142 state 0x0 ref 1 00000100:00100000:3.0:1789762919.211354:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323720567142 time 323670567142 state 0x1 ref 1 00000100:00100000:1.0:1789762919.247536:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323720567142 time 323720675470 state 0x0 ref 1 00000100:00100000:1.0:1789762919.247562:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140821376:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762919.247620:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 102760448, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x3100b 00010000:00010000:1.0:1789762919.247628:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570bf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.247642:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1789762919.247645:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762919.247650:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570bf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.247661:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570bf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762919.259013:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967908 is committed 00002000:00010000:0.0:1789762919.259059:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:0.0:1789762919.259065:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 200715 -> 202763 00010000:00010000:0.0:1789762919.259077:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570bf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.259090:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570bf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.259099:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570bf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.259107:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.259112:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570bf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.259122:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570bf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.259141:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570bf2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.259150:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfb19ad0/0xd08452c77c570bf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.259234:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140821376:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11679us (47969us total) trans 4294967908 rc 0/0 00000100:00100000:0.0:1789762919.259247:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 595 00000100:00100000:0.0:1789762919.259259:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323720567142 time 323720675470 state 0x2 ref 0 00000100:00100000:1.0:1789762919.261411:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.261454:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140821504 00000100:00100000:0.0:1789762919.261462:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140821504 00000100:00100000:0.0:1789762919.261507:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323720567142 time 323720675470 state 0x0 ref 1 00000100:00100000:0.0:1789762919.261522:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323770675470 time 323720675470 state 0x1 ref 1 00000100:00100000:0.0:1789762919.297603:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323770675470 time 323770751624 state 0x0 ref 1 00000100:00100000:0.0:1789762919.297630:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140821504:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762919.297701:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 103809024, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x3180b 00010000:00010000:0.0:1789762919.297711:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570bf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.297726:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1789762919.297731:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.297737:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.297752:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762919.310315:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967909 is committed 00002000:00010000:0.0:1789762919.310376:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:0.0:1789762919.310381:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 202763 -> 204811 00010000:00010000:0.0:1789762919.310393:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.310404:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570bf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.310414:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570bf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.310423:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.310428:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570bf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.310438:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570bf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.310457:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570bf9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.310466:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570bf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.310554:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140821504:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12930us (49138us total) trans 4294967909 rc 0/0 00000100:00100000:0.0:1789762919.310571:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 596 00000100:00100000:0.0:1789762919.310585:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323770675470 time 323770751624 state 0x2 ref 0 00000100:00100000:3.0:1789762919.311869:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.311898:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140821760 00000100:00100000:0.0:1789762919.311907:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140821760 00000100:00080000:3.0:1789762919.311957:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762919.311963:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:0.0:1789762919.311975:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+8:13455:x1876702140821760:12345-192.168.203.31@tcp:35:dd.500 00000001:00080000:0.0:1789762919.312199:0:8160:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967519 00000100:00100000:0.0:1789762919.312281:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+10:13455:x1876702140821760:12345-192.168.203.31@tcp:35:dd.500 Request processed in 307us (412us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789762919.312289:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000020:00080000:0.0:1789762919.312293:0:8160:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789762919.334977:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.335022:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140821888 00000100:00100000:0.0:1789762919.335032:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140821888 00000100:00100000:0.0:1789762919.335089:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1789762919.335099:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a04a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+6:6029:x1876702140821888:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762919.335114:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789762919.335132:0:5844:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb blocks from disk: 1 -> 16391 00010000:00010000:0.0:1789762919.335154:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c5707c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea43 expref: 6 pid: 10283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.335177:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762919.335224:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a04a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+5:6029:x1876702140821888:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 126us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762919.335233:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1789762919.356264:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.356327:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140822144 00000100:00100000:0.0:1789762919.356337:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140822144 00000100:00100000:0.0:1789762919.356383:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 263 00000100:00100000:0.0:1789762919.356392:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+10:13471:x1876702140822144:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762919.356412:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762919.356427:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570c00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ea9e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.356505:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570c07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.356517:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570c07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.356543:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570c07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762919.356553:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 104857600 00010000:00010000:0.0:1789762919.356653:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638000/0xd08452c77c570c00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x29:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea9e expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.356666:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570c07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea9e expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.356673:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff95d15055de00) 00010000:00010000:0.0:1789762919.356675:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789762919.356677:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d174638600, rc 0) 00000100:00100000:0.0:1789762919.356718:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+12:13471:x1876702140822144:12345-192.168.203.31@tcp:101:dd.500 Request processed in 328us (461us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789762919.356734:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 263 00000100:00100000:3.0:1789762919.357865:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762919.357945:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140822272 00000100:00100000:1.0:1789762919.357950:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140822272 00000100:00100000:1.0:1789762919.357981:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:1.0:1789762919.357988:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140822272:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:1.0:1789762919.357997:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762919.358007:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570c15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eaa5 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762919.358023:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 104857600, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x3200b 00010000:00010000:1.0:1789762919.358035:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1789762919.358039:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762919.358045:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570c15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaa5 expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.358055:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570c15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaa5 expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.358063:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d141524e00, rc 0) 00000100:00100000:1.0:1789762919.358089:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140822272:12345-192.168.203.31@tcp:101:dd.500 Request processed in 102us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762919.358094:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:1.0:1789762919.360180:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.360219:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140822400 00000100:00100000:0.0:1789762919.360224:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140822400 00000100:00100000:0.0:1789762919.360253:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 262065721003 time 262065809345 state 0x0 ref 1 00000100:00100000:0.0:1789762919.360260:0:6660:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x1, head sequence 6: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d044b75800 gen 0 rate 10 depth 3 token 0 deadline 262065721003 time 262065809345 state 0x0 ref 1 00000100:00100000:0.0:1789762919.360283:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 3 deadline 323883442720 time 323833442720 state 0x1 ref 1 00000100:00100000:0.0:1789762919.360311:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 2 deadline 323883442720 time 323833470402 state 0x0 ref 1 00000100:00100000:0.0:1789762919.360325:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140822400:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762919.360344:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c1c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.360351:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.360354:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.360357:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.360365:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.363914:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.363935:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c1c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.363942:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.363948:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.363952:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.363958:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.363970:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.363975:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.364015:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140822400:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3693us (3835us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762919.364022:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 597 00000100:00100000:0.0:1789762919.364029:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 2 deadline 323883442720 time 323833470402 state 0x2 ref 0 00000100:00100000:2.0:1789762919.365599:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.365641:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140822528 00000100:00100000:0.0:1789762919.365653:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140822528 00000100:00100000:0.0:1789762919.365682:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 2 deadline 323883442720 time 323833470402 state 0x0 ref 1 00000100:00100000:0.0:1789762919.365695:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 2 deadline 323883470402 time 323833470402 state 0x1 ref 1 00000100:00100000:0.0:1789762919.365724:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 1 deadline 323883470402 time 323838884647 state 0x0 ref 1 00000100:00100000:0.0:1789762919.365737:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140822528:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762919.365756:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570c23 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.365767:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.365771:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.365777:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570c23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.365789:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570c23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.368230:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570c23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.368240:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570c23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.368247:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570c23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.368260:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.368263:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570c23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.368270:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570c23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.368280:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570c23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.368286:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c570c23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.368323:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140822528:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2589us (2725us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762919.368329:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 598 00000100:00100000:0.0:1789762919.368337:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 1 deadline 323883470402 time 323838884647 state 0x2 ref 0 00000100:00100000:2.0:1789762919.369791:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.369866:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140822656 00000100:00100000:0.0:1789762919.369871:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140822656 00000100:00100000:0.0:1789762919.369895:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 1 deadline 323883470402 time 323838884647 state 0x0 ref 1 00000100:00100000:0.0:1789762919.369904:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 1 deadline 323888884647 time 323838884647 state 0x1 ref 1 00000100:00100000:0.0:1789762919.369929:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323888884647 time 323843092603 state 0x0 ref 1 00000100:00100000:0.0:1789762919.369945:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140822656:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762919.369959:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c2a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.369967:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.369970:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.369974:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c2a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.369981:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c2a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.371972:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c2a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.371980:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.371986:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.371991:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.371993:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.371998:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.372013:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.372019:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.372061:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140822656:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2117us (2270us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762919.372068:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 599 00000100:00100000:0.0:1789762919.372074:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323888884647 time 323843092603 state 0x2 ref 0 00000100:00100000:1.0:1789762919.373505:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.373546:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140822784 00000100:00100000:0.0:1789762919.373552:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140822784 00000100:00100000:0.0:1789762919.373575:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323888884647 time 323843092603 state 0x0 ref 1 00000100:00100000:0.0:1789762919.373583:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323893092603 time 323843092603 state 0x1 ref 1 00000100:00100000:0.0:1789762919.420063:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323893092603 time 323893212433 state 0x0 ref 1 00000100:00100000:0.0:1789762919.420084:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140822784:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762919.420132:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c31 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.420145:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.420160:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.420165:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c31 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.420176:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c31 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.422654:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c31 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.422664:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.422672:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.422678:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.422682:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.422689:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.422703:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.422709:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.422769:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140822784:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2691us (49265us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762919.422776:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 600 00000100:00100000:0.0:1789762919.422783:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323893092603 time 323893212433 state 0x2 ref 0 00000100:00100000:1.0:1789762919.424577:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762919.424616:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140822912 00000100:00100000:2.0:1789762919.424624:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140822912 00000100:00100000:2.0:1789762919.424659:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323893092603 time 323893212433 state 0x0 ref 1 00000100:00100000:2.0:1789762919.424670:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323943212433 time 323893212433 state 0x1 ref 1 00010000:00010000:2.0:1789762919.462943:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762919.470117:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323943212433 time 323943272331 state 0x0 ref 1 00000100:00100000:2.0:1789762919.470134:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140822912:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762919.470163:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c570c38 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.470175:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762919.470179:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762919.470183:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c570c38 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.470205:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c570c38 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.472580:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c570c38 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.472592:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c570c38 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.472599:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c570c38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.472604:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762919.472607:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c570c38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.472613:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c570c38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.472625:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c570c38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.472630:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c570c38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762919.472675:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140822912:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2545us (48098us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762919.472684:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 601 00000100:00100000:1.0:1789762919.472699:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323943212433 time 323943272331 state 0x2 ref 0 00000100:00100000:1.0:1789762919.474299:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.474352:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140823040 00000100:00100000:0.0:1789762919.474360:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140823040 00000100:00100000:0.0:1789762919.474394:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323943212433 time 323943272331 state 0x0 ref 1 00000100:00100000:0.0:1789762919.474404:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323993272331 time 323943272331 state 0x1 ref 1 00000100:00100000:3.0:1789762919.520230:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323993272331 time 323993385228 state 0x0 ref 1 00000100:00100000:3.0:1789762919.520247:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140823040:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762919.520273:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570c3f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.520283:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762919.520286:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762919.520290:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570c3f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.520299:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570c3f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.522564:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570c3f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.522576:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570c3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.522583:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570c3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.522589:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.522593:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570c3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.522599:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570c3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.522620:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570c3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.522626:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091b8a0df/0xd08452c77c570c3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.522670:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140823040:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2427us (48371us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762919.522677:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 602 00000100:00100000:0.0:1789762919.522684:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323993272331 time 323993385228 state 0x2 ref 0 00000100:00100000:1.0:1789762919.524276:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.524322:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140823168 00000100:00100000:0.0:1789762919.524330:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140823168 00000100:00100000:0.0:1789762919.524360:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323993272331 time 323993385228 state 0x0 ref 1 00000100:00100000:0.0:1789762919.524369:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324043385228 time 323993385228 state 0x1 ref 1 00000100:00100000:0.0:1789762919.570279:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324043385228 time 324043434649 state 0x0 ref 1 00000100:00100000:0.0:1789762919.570296:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140823168:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762919.570323:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c46 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.570333:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762919.570344:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.570349:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.570359:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.572692:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.572703:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.572709:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.572714:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.572717:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.572723:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.572735:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.572740:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.572794:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140823168:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2502us (48518us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762919.572803:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 603 00000100:00100000:0.0:1789762919.572811:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324043385228 time 324043434649 state 0x2 ref 0 00000100:00100000:1.0:1789762919.574287:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762919.574364:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140823296 00000100:00100000:2.0:1789762919.574371:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140823296 00000100:00100000:2.0:1789762919.574407:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324043385228 time 324043434649 state 0x0 ref 1 00000100:00100000:2.0:1789762919.574416:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324093434649 time 324043434649 state 0x1 ref 1 00000100:00100000:1.0:1789762919.620352:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324093434649 time 324093506927 state 0x0 ref 1 00000100:00100000:1.0:1789762919.620369:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140823296:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762919.620394:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570c4d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.620405:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762919.620408:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762919.620411:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570c4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762919.620420:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570c4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.622904:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570c4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.622916:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570c4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.622923:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570c4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.622928:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.622932:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570c4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.622938:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570c4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.622952:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570c4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.622957:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570c4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.623014:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140823296:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2650us (48728us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762919.623027:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 604 00000100:00100000:0.0:1789762919.623034:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324093434649 time 324093506927 state 0x2 ref 0 00000100:00100000:3.0:1789762919.624692:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.624729:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140823424 00000100:00100000:0.0:1789762919.624735:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140823424 00000100:00100000:0.0:1789762919.624767:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324093434649 time 324093506927 state 0x0 ref 1 00000100:00100000:0.0:1789762919.624777:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324143506927 time 324093506927 state 0x1 ref 1 00000100:00100000:2.0:1789762919.670426:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324143506927 time 324143580184 state 0x0 ref 1 00000100:00100000:2.0:1789762919.670446:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140823424:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762919.670487:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002760ef29/0xd08452c77c570c54 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.670499:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762919.670503:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762919.670507:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002760ef29/0xd08452c77c570c54 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.670517:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002760ef29/0xd08452c77c570c54 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.672992:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002760ef29/0xd08452c77c570c54 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.673007:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002760ef29/0xd08452c77c570c54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.673018:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002760ef29/0xd08452c77c570c54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.673026:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d043c23000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.673032:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002760ef29/0xd08452c77c570c54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.673043:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002760ef29/0xd08452c77c570c54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.673069:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002760ef29/0xd08452c77c570c54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.673086:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002760ef29/0xd08452c77c570c54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.673140:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140823424:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2698us (48449us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762919.673148:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 605 00000100:00100000:0.0:1789762919.673156:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324143506927 time 324143580184 state 0x2 ref 0 00000100:00100000:3.0:1789762919.674900:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.674931:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140823552 00000100:00100000:0.0:1789762919.674938:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140823552 00000100:00100000:0.0:1789762919.674970:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324143506927 time 324143580184 state 0x0 ref 1 00000100:00100000:0.0:1789762919.674980:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324193580184 time 324143580184 state 0x1 ref 1 00000100:00100000:0.0:1789762919.720469:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324193580184 time 324193624047 state 0x0 ref 1 00000100:00100000:0.0:1789762919.720486:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140823552:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762919.720514:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c5b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.720537:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.720549:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.720553:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.720562:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.723027:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.723044:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.723052:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.723058:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762919.723061:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.723068:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.723081:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.723086:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c570c5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762919.723139:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140823552:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2657us (48240us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762919.723148:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 606 00000100:00100000:2.0:1789762919.723155:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324193580184 time 324193624047 state 0x2 ref 0 00000100:00100000:3.0:1789762919.724885:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.724939:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140823680 00000100:00100000:0.0:1789762919.724947:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140823680 00000100:00100000:0.0:1789762919.724981:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324193580184 time 324193624047 state 0x0 ref 1 00000100:00100000:0.0:1789762919.724991:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324243624047 time 324193624047 state 0x1 ref 1 00000100:00100000:3.0:1789762919.770574:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324243624047 time 324243728499 state 0x0 ref 1 00000100:00100000:3.0:1789762919.770591:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140823680:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762919.770619:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c570c62 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.770630:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762919.770635:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762919.770641:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c570c62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.770664:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c570c62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.773022:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c570c62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.773037:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c570c62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.773048:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c570c62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.773057:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.773062:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c570c62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.773082:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c570c62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.773108:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c570c62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.773118:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055bcdd5f/0xd08452c77c570c62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.773166:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140823680:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2579us (48283us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762919.773173:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 607 00000100:00100000:0.0:1789762919.773181:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324243624047 time 324243728499 state 0x2 ref 0 00000100:00100000:0.0:1789762919.774753:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762919.774803:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140823808 00000100:00100000:2.0:1789762919.774816:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140823808 00000100:00100000:2.0:1789762919.774880:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324243624047 time 324243728499 state 0x0 ref 1 00000100:00100000:2.0:1789762919.774894:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324293728499 time 324243728499 state 0x1 ref 1 00000100:00100000:2.0:1789762919.820644:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324293728499 time 324293793267 state 0x0 ref 1 00000100:00100000:2.0:1789762919.820667:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140823808:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762919.820703:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c69 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.820717:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762919.820721:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762919.820725:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c69 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.820735:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c69 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.823188:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c69 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.823200:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.823208:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.823224:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d042baf200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762919.823228:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.823234:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.823252:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762919.823260:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762919.823317:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140823808:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2657us (48562us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762919.823326:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 608 00000100:00100000:2.0:1789762919.823335:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324293728499 time 324293793267 state 0x2 ref 0 00000100:00100000:1.0:1789762919.825206:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762919.825242:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140823936 00000100:00100000:2.0:1789762919.825250:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140823936 00000100:00100000:2.0:1789762919.825289:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324293728499 time 324293793267 state 0x0 ref 1 00000100:00100000:2.0:1789762919.825300:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324343793267 time 324293793267 state 0x1 ref 1 00000100:00100000:3.0:1789762919.870722:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324343793267 time 324343873086 state 0x0 ref 1 00000100:00100000:3.0:1789762919.870741:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140823936:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762919.870774:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036cbe427/0xd08452c77c570c70 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.870788:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762919.870791:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762919.870796:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036cbe427/0xd08452c77c570c70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.870807:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036cbe427/0xd08452c77c570c70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.873392:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036cbe427/0xd08452c77c570c70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.873401:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036cbe427/0xd08452c77c570c70 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.873408:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036cbe427/0xd08452c77c570c70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.873419:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0451be400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762919.873422:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036cbe427/0xd08452c77c570c70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.873430:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036cbe427/0xd08452c77c570c70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.873442:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036cbe427/0xd08452c77c570c70 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762919.873447:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036cbe427/0xd08452c77c570c70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762919.873493:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140823936:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2757us (48288us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762919.873503:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 609 00000100:00100000:3.0:1789762919.873514:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324343793267 time 324343873086 state 0x2 ref 0 00000100:00100000:3.0:1789762919.875287:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762919.875343:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140824064 00000100:00100000:0.0:1789762919.875351:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140824064 00000100:00100000:0.0:1789762919.875385:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324343793267 time 324343873086 state 0x0 ref 1 00000100:00100000:0.0:1789762919.875395:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324393873086 time 324343873086 state 0x1 ref 1 00000100:00100000:0.0:1789762919.920776:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324393873086 time 324393929592 state 0x0 ref 1 00000100:00100000:0.0:1789762919.920794:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140824064:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762919.920824:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c77 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.920866:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.920869:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.920874:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.920883:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.923277:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.923288:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.923294:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.923300:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d145f02400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.923304:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.923310:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.923323:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.923339:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.923384:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140824064:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2594us (48097us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762919.923392:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 610 00000100:00100000:0.0:1789762919.923400:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324393873086 time 324393929592 state 0x2 ref 0 00000100:00100000:0.0:1789762919.925241:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762919.925287:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140824192 00000100:00100000:2.0:1789762919.925301:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140824192 00000100:00100000:2.0:1789762919.925337:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324393873086 time 324393929592 state 0x0 ref 1 00000100:00100000:2.0:1789762919.925347:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324443929592 time 324393929592 state 0x1 ref 1 00000100:00100000:0.0:1789762919.970874:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324443929592 time 324444026651 state 0x0 ref 1 00000100:00100000:0.0:1789762919.970891:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140824192:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762919.970921:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c7e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.970934:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.970939:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762919.970945:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.970959:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.973248:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.973269:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.973279:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.973286:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d145f02400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762919.973290:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.973296:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.973307:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762919.973313:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762919.973357:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140824192:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2471us (48117us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762919.973364:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 611 00000100:00100000:0.0:1789762919.973371:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324443929592 time 324444026651 state 0x2 ref 0 00000100:00100000:0.0:1789762919.974999:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762919.975042:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140824320 00000100:00100000:3.0:1789762919.975050:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140824320 00000100:00100000:3.0:1789762919.975083:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324443929592 time 324444026651 state 0x0 ref 1 00000100:00100000:3.0:1789762919.975093:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324494026651 time 324444026651 state 0x1 ref 1 00000100:00100000:2.0:1789762920.020976:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324494026651 time 324494125829 state 0x0 ref 1 00000100:00100000:2.0:1789762920.021000:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140824320:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762920.021042:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c85 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.021060:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762920.021065:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762920.021071:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.021086:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.023906:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.023923:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.023931:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.023944:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d042baf200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762920.023949:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.023955:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.023970:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.023976:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f0f6a83/0xd08452c77c570c85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762920.024044:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140824320:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3052us (49043us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762920.024053:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 612 00000100:00100000:2.0:1789762920.024061:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324494026651 time 324494125829 state 0x2 ref 0 00000100:00100000:0.0:1789762920.026330:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762920.026409:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140824448 00000100:00100000:1.0:1789762920.026417:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140824448 00000100:00100000:1.0:1789762920.026457:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324494026651 time 324494125829 state 0x0 ref 1 00000100:00100000:1.0:1789762920.026468:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324544125829 time 324494125829 state 0x1 ref 1 00000100:00100000:0.0:1789762920.071064:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324544125829 time 324544212910 state 0x0 ref 1 00000100:00100000:0.0:1789762920.071086:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140824448:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762920.071122:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c8c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.071144:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.071148:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.071156:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.071170:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.073893:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.073907:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.073914:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.073929:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d145f02400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762920.073933:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.073939:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.073952:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.073957:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5db0e41/0xd08452c77c570c8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762920.074020:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140824448:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2940us (47689us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762920.074031:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 613 00000100:00100000:2.0:1789762920.074043:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324544125829 time 324544212910 state 0x2 ref 0 00000100:00100000:1.0:1789762920.075777:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762920.075818:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140824576 00000100:00100000:0.0:1789762920.075825:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140824576 00000100:00100000:0.0:1789762920.075874:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324544125829 time 324544212910 state 0x0 ref 1 00000100:00100000:0.0:1789762920.075886:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324594212910 time 324544212910 state 0x1 ref 1 00000001:00080000:3.0:1789762920.109939:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000004:00080000:3.0:1789762920.109960:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000004:00080000:3.0:1789762920.109980:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000100:00100000:1.0:1789762920.110063:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149040128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789762920.110066:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149040256:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789762920.110130:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762920.110158:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149040128 00000100:00100000:2.0:1789762920.110165:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149040128 00000100:00100000:3.0:1789762920.110171:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762920.110220:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149040256 00000100:00080000:3.0:1789762920.110221:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762920.110225:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149040256 00000100:00100000:2.0:1789762920.110227:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789762920.110240:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149040128:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1789762920.110259:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1789762920.110263:0:6655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:15 count 1 00000100:00100000:0.0:1789762920.110270:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789762920.110283:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149040256:12345-0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1789762920.110291:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 8388608, mtime: 0x6aad9d60, atime: 0x0, ctime: 0x6aad9d60, blocks: 0x4007 00010000:00010000:2.0:1789762920.110299:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570c93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789762920.110300:0:8803:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:10 count 1 00010000:00010000:2.0:1789762920.110321:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=324s v=(0 0) 00010000:00010000:2.0:1789762920.110325:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1789762920.110331:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 8388608, mtime: 0x6aad9d60, atime: 0x0, ctime: 0x6aad9d60, blocks: 0x4007 00010000:00010000:2.0:1789762920.110331:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.110343:0:8803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2dd63e2/0xd08452c77c570c9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.110349:0:6655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.110354:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=324s v=(0 0) 00010000:00010000:0.0:1789762920.110361:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762920.110362:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.110365:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2dd63e2/0xd08452c77c570c9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.110377:0:6655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.110383:0:8803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2dd63e2/0xd08452c77c570c9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.110391:0:8803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2dd63e2/0xd08452c77c570c9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.110395:0:6655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762920.110404:0:8803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2dd63e2/0xd08452c77c570c9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.110424:0:8803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789762920.110426:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789762920.110433:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.110442:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762920.110447:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762920.110447:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.110455:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2dd63e2/0xd08452c77c570c9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.110463:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570c93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.110465:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d145f02e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762920.110472:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2dd63e2/0xd08452c77c570c9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.110483:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2dd63e2/0xd08452c77c570c9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.110489:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570c93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.110496:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2dd63e2/0xd08452c77c570c9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.110499:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570c93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.110505:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2dd63e2/0xd08452c77c570c9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.110547:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762920.110551:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762920.110551:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762920.110558:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762920.110558:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762920.110568:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762920.111263:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149040128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1025us (1130us total) trans 4294967910 rc 0/0 00000100:00100000:2.0:1789762920.111273:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000004:00080000:1.0:1789762920.111284:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d044e53800/2, rc 0, transno 4294967910 00000100:00100000:0.0:1789762920.111285:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149040256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1003us (1113us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789762920.111292:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149040128:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789762920.111301:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789762920.111309:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967397 gen 2 00000004:00080000:3.0:1789762920.111314:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d044e54700, transno 4294967397 00000100:00100000:3.0:1789762920.111329:0:3278:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d043212a00 x1876702149040256/t4294967398(4294967398) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789762936 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789762920.111340:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d043212a00/2, rc 0, transno 4294967398 00000100:00100000:3.0:1789762920.111345:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149040256:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789762920.121112:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324594212910 time 324594265095 state 0x0 ref 1 00000100:00100000:0.0:1789762920.121126:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140824576:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762920.121146:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003e79579e/0xd08452c77c570ca1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.121161:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.121164:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.121168:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e79579e/0xd08452c77c570ca1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.121175:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e79579e/0xd08452c77c570ca1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.123592:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003e79579e/0xd08452c77c570ca1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.123601:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e79579e/0xd08452c77c570ca1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.123607:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e79579e/0xd08452c77c570ca1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.123611:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d145f02600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762920.123614:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e79579e/0xd08452c77c570ca1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.123619:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e79579e/0xd08452c77c570ca1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.123629:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e79579e/0xd08452c77c570ca1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.123644:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e79579e/0xd08452c77c570ca1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762920.123682:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140824576:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2558us (47906us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762920.123688:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 614 00000100:00100000:0.0:1789762920.123696:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324594212910 time 324594265095 state 0x2 ref 0 00000100:00100000:0.0:1789762920.125455:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762920.125503:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140824704 00000100:00100000:2.0:1789762920.125510:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140824704 00000100:00100000:2.0:1789762920.125563:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324594212910 time 324594265095 state 0x0 ref 1 00000100:00100000:2.0:1789762920.125577:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324644265095 time 324594265095 state 0x1 ref 1 00000100:00100000:2.0:1789762920.171204:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324644265095 time 324644336496 state 0x0 ref 1 00000100:00100000:2.0:1789762920.171237:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140824704:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762920.171271:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570ca8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.171284:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762920.171288:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762920.171293:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570ca8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.171304:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570ca8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.174005:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570ca8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.174015:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570ca8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.174022:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570ca8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.174027:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762920.174032:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570ca8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.174065:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570ca8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.174080:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570ca8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.174085:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570ca8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762920.174130:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140824704:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2900us (48677us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762920.174137:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 615 00000100:00100000:2.0:1789762920.174145:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324644265095 time 324644336496 state 0x2 ref 0 00000100:00100000:3.0:1789762920.176214:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762920.176282:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140824832 00000100:00100000:2.0:1789762920.176290:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140824832 00000100:00100000:2.0:1789762920.176325:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324644265095 time 324644336496 state 0x0 ref 1 00000100:00100000:2.0:1789762920.176336:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324694336496 time 324644336496 state 0x1 ref 1 00000100:00100000:3.0:1789762920.221305:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324694336496 time 324694450690 state 0x0 ref 1 00000100:00100000:3.0:1789762920.221333:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140824832:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762920.221373:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005582971c/0xd08452c77c570caf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.221401:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762920.221406:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762920.221413:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005582971c/0xd08452c77c570caf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.221429:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005582971c/0xd08452c77c570caf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.224716:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005582971c/0xd08452c77c570caf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.224730:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005582971c/0xd08452c77c570caf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.224747:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005582971c/0xd08452c77c570caf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.224753:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d042bafa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762920.224757:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005582971c/0xd08452c77c570caf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.224764:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005582971c/0xd08452c77c570caf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.224779:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005582971c/0xd08452c77c570caf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.224784:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005582971c/0xd08452c77c570caf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762920.224868:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140824832:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3542us (48652us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762920.224877:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 616 00000100:00100000:3.0:1789762920.224886:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324694336496 time 324694450690 state 0x2 ref 0 00000100:00100000:3.0:1789762920.226907:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762920.226954:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140824960 00000100:00100000:0.0:1789762920.226962:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140824960 00000100:00100000:0.0:1789762920.227010:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324694336496 time 324694450690 state 0x0 ref 1 00000100:00100000:0.0:1789762920.227022:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324744450690 time 324694450690 state 0x1 ref 1 00000100:00100000:1.0:1789762920.271382:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324744450690 time 324744533150 state 0x0 ref 1 00000100:00100000:1.0:1789762920.271414:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140824960:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762920.271448:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000070d55239/0xd08452c77c570cb6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.271462:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762920.271465:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762920.271471:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070d55239/0xd08452c77c570cb6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.271487:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070d55239/0xd08452c77c570cb6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.274370:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000070d55239/0xd08452c77c570cb6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.274381:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070d55239/0xd08452c77c570cb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.274388:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070d55239/0xd08452c77c570cb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.274394:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747ff800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762920.274398:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070d55239/0xd08452c77c570cb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.274404:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070d55239/0xd08452c77c570cb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.274427:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070d55239/0xd08452c77c570cb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.274434:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070d55239/0xd08452c77c570cb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762920.274488:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140824960:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3077us (47580us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762920.274498:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 617 00000100:00100000:1.0:1789762920.274509:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324744450690 time 324744533150 state 0x2 ref 0 00000100:00100000:0.0:1789762920.276212:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762920.276264:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140825088 00000100:00100000:2.0:1789762920.276272:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140825088 00000100:00100000:2.0:1789762920.276308:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324744450690 time 324744533150 state 0x0 ref 1 00000100:00100000:2.0:1789762920.276319:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324794533150 time 324744533150 state 0x1 ref 1 00000100:00100000:0.0:1789762920.321472:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324794533150 time 324794622479 state 0x0 ref 1 00000100:00100000:0.0:1789762920.321494:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140825088:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762920.321546:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c570cbd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.321561:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.321564:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.321581:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c570cbd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.321592:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c570cbd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.324200:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c570cbd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.324211:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c570cbd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.324218:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c570cbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.324223:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d182041a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762920.324226:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c570cbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.324232:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c570cbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.324245:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c570cbd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.324250:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009584b8b2/0xd08452c77c570cbd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762920.324305:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140825088:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2818us (48094us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762920.324313:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 618 00000100:00100000:0.0:1789762920.324322:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324794533150 time 324794622479 state 0x2 ref 0 00000100:00100000:0.0:1789762920.326067:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762920.326111:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140825216 00000100:00100000:3.0:1789762920.326119:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140825216 00000100:00100000:3.0:1789762920.326160:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324794533150 time 324794622479 state 0x0 ref 1 00000100:00100000:3.0:1789762920.326179:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324844622479 time 324794622479 state 0x1 ref 1 00000100:00100000:2.0:1789762920.371609:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324844622479 time 324844757036 state 0x0 ref 1 00000100:00100000:2.0:1789762920.371635:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140825216:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762920.371679:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cc4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.371695:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762920.371698:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762920.371703:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.371714:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.374479:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.374490:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cc4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.374498:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.374504:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762920.374508:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.374540:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cc4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.374553:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cc4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.374559:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cc4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762920.374608:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140825216:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2983us (48540us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762920.374617:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 619 00000100:00100000:2.0:1789762920.374626:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324844622479 time 324844757036 state 0x2 ref 0 00000100:00100000:3.0:1789762920.376441:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762920.376500:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140825344 00000100:00100000:1.0:1789762920.376510:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140825344 00000100:00100000:1.0:1789762920.376566:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324844622479 time 324844757036 state 0x0 ref 1 00000100:00100000:1.0:1789762920.376582:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324894757036 time 324844757036 state 0x1 ref 1 00000100:00100000:0.0:1789762920.421691:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324894757036 time 324894841049 state 0x0 ref 1 00000100:00100000:0.0:1789762920.421712:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140825344:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762920.421748:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570ccb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.421762:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.421766:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.421771:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570ccb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.421782:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570ccb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.424346:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570ccb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.424357:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570ccb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.424372:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570ccb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.424378:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762920.424381:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570ccb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.424387:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570ccb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.424400:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570ccb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.424406:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570ccb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762920.424453:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140825344:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2746us (48013us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762920.424460:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 620 00000100:00100000:0.0:1789762920.424468:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324894757036 time 324894841049 state 0x2 ref 0 00000100:00100000:0.0:1789762920.426155:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762920.426209:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140825472 00000100:00100000:1.0:1789762920.426218:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140825472 00000100:00100000:1.0:1789762920.426258:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324894757036 time 324894841049 state 0x0 ref 1 00000100:00100000:1.0:1789762920.426273:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324944841049 time 324894841049 state 0x1 ref 1 00000100:00100000:0.0:1789762920.471795:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324944841049 time 324944940500 state 0x0 ref 1 00000100:00100000:0.0:1789762920.471822:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140825472:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762920.471915:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570cd2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.471934:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.471939:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.471946:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.471961:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.474627:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.474640:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570cd2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.474650:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570cd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.474657:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003f800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762920.474662:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570cd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.474672:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570cd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.474690:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570cd2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.474699:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa1928d/0xd08452c77c570cd2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762920.474754:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140825472:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2940us (48597us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762920.474770:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 621 00000100:00100000:3.0:1789762920.474781:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324944841049 time 324944940500 state 0x2 ref 0 00000100:00100000:1.0:1789762920.476466:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762920.476531:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140825600 00000100:00100000:2.0:1789762920.476539:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140825600 00000100:00100000:2.0:1789762920.476584:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324944841049 time 324944940500 state 0x0 ref 1 00000100:00100000:2.0:1789762920.476595:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324994940500 time 324944940500 state 0x1 ref 1 00010000:00010000:2.0:1789762920.486963:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762920.521885:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324994940500 time 324995033602 state 0x0 ref 1 00000100:00100000:2.0:1789762920.521907:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140825600:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762920.521953:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cd9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.521967:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762920.521971:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762920.521975:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.521985:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.524387:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.524397:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.524404:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.524409:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762920.524413:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.524419:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.524441:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.524447:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762920.524495:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140825600:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2596us (48029us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762920.524501:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 622 00000100:00100000:2.0:1789762920.524509:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324994940500 time 324995033602 state 0x2 ref 0 00000100:00100000:0.0:1789762920.526209:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762920.526245:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140825728 00000100:00100000:2.0:1789762920.526252:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140825728 00000100:00100000:2.0:1789762920.526286:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 324994940500 time 324995033602 state 0x0 ref 1 00000100:00100000:2.0:1789762920.526297:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325045033602 time 324995033602 state 0x1 ref 1 00000100:00100000:3.0:1789762920.571960:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325045033602 time 325045109282 state 0x0 ref 1 00000100:00100000:3.0:1789762920.571984:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140825728:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762920.572017:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570ce0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.572032:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762920.572036:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762920.572042:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570ce0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.572057:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570ce0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.574594:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570ce0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.574605:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570ce0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.574613:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570ce0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.574619:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762920.574623:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570ce0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.574629:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570ce0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.574642:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570ce0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.574648:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051abacd/0xd08452c77c570ce0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762920.574696:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140825728:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2720us (48488us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762920.574703:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 623 00000100:00100000:1.0:1789762920.574711:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325045033602 time 325045109282 state 0x2 ref 0 00000100:00100000:3.0:1789762920.576287:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762920.576338:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140825856 00000100:00100000:0.0:1789762920.576346:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140825856 00000100:00100000:0.0:1789762920.576382:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325045033602 time 325045109282 state 0x0 ref 1 00000100:00100000:0.0:1789762920.576393:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325095109282 time 325045109282 state 0x1 ref 1 00000100:00100000:1.0:1789762920.622051:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325095109282 time 325095200891 state 0x0 ref 1 00000100:00100000:1.0:1789762920.622072:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140825856:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762920.622107:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570ce7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.622121:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762920.622125:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762920.622129:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570ce7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.622141:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570ce7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.625002:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570ce7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.625018:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570ce7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.625028:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570ce7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.625035:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1601d0600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762920.625038:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570ce7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.625053:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570ce7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.625067:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570ce7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.625073:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570ce7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762920.625124:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140825856:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3058us (48838us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762920.625132:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 624 00000100:00100000:1.0:1789762920.625139:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325095109282 time 325095200891 state 0x2 ref 0 00000100:00100000:0.0:1789762920.626882:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762920.626938:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140825984 00000100:00100000:2.0:1789762920.626948:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140825984 00000100:00100000:2.0:1789762920.626998:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325095109282 time 325095200891 state 0x0 ref 1 00000100:00100000:2.0:1789762920.627013:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325145200891 time 325095200891 state 0x1 ref 1 00000100:00100000:1.0:1789762920.672147:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325145200891 time 325145297270 state 0x0 ref 1 00000100:00100000:1.0:1789762920.672168:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140825984:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762920.672203:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570cee lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.672216:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762920.672220:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762920.672224:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570cee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.672253:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570cee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.675072:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570cee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.675081:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570cee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.675088:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570cee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.675093:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1601d0600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762920.675097:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570cee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.675103:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570cee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.675116:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570cee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.675123:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570cee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762920.675179:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140825984:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3017us (48297us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762920.675185:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 625 00000100:00100000:1.0:1789762920.675193:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325145200891 time 325145297270 state 0x2 ref 0 00000100:00100000:1.0:1789762920.677039:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762920.677090:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140826112 00000100:00100000:3.0:1789762920.677100:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140826112 00000100:00100000:3.0:1789762920.677146:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325145200891 time 325145297270 state 0x0 ref 1 00000100:00100000:3.0:1789762920.677161:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325195297270 time 325145297270 state 0x1 ref 1 00000100:00100000:2.0:1789762920.722233:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325195297270 time 325195382912 state 0x0 ref 1 00000100:00100000:2.0:1789762920.722268:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140826112:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762920.722303:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cf5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.722316:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762920.722320:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762920.722324:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.722334:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.724859:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.724871:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cf5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.724878:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.724883:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762920.724886:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.724903:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cf5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.724916:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cf5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.724921:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570cf5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762920.724970:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140826112:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2709us (47932us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762920.724977:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 626 00000100:00100000:2.0:1789762920.724985:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325195297270 time 325195382912 state 0x2 ref 0 00000100:00100000:3.0:1789762920.726779:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762920.726828:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140826240 00000100:00100000:1.0:1789762920.726855:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140826240 00000100:00100000:1.0:1789762920.726899:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325195297270 time 325195382912 state 0x0 ref 1 00000100:00100000:1.0:1789762920.726911:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325245382912 time 325195382912 state 0x1 ref 1 00000100:00100000:0.0:1789762920.772330:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325245382912 time 325245480112 state 0x0 ref 1 00000100:00100000:0.0:1789762920.772351:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140826240:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762920.772385:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6903419/0xd08452c77c570cfc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.772398:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.772414:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.772419:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6903419/0xd08452c77c570cfc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.772431:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6903419/0xd08452c77c570cfc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.775150:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6903419/0xd08452c77c570cfc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.775164:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6903419/0xd08452c77c570cfc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.775174:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6903419/0xd08452c77c570cfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.775182:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160053400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762920.775188:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6903419/0xd08452c77c570cfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.775205:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6903419/0xd08452c77c570cfc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.775223:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6903419/0xd08452c77c570cfc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.775232:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6903419/0xd08452c77c570cfc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762920.775289:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140826240:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2942us (48508us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762920.775297:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 627 00000100:00100000:2.0:1789762920.775308:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325245382912 time 325245480112 state 0x2 ref 0 00000100:00100000:3.0:1789762920.777303:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762920.777346:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140826368 00000100:00100000:1.0:1789762920.777355:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140826368 00000100:00100000:1.0:1789762920.777390:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325245382912 time 325245480112 state 0x0 ref 1 00000100:00100000:1.0:1789762920.777401:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325295480112 time 325245480112 state 0x1 ref 1 00000100:00100000:0.0:1789762920.822418:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325295480112 time 325295564351 state 0x0 ref 1 00000100:00100000:0.0:1789762920.822445:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140826368:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762920.822489:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000084da7aa/0xd08452c77c570d03 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.822506:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.822526:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762920.822537:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000084da7aa/0xd08452c77c570d03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.822552:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000084da7aa/0xd08452c77c570d03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.825396:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000084da7aa/0xd08452c77c570d03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.825409:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000084da7aa/0xd08452c77c570d03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.825428:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000084da7aa/0xd08452c77c570d03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.825434:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160052400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762920.825437:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000084da7aa/0xd08452c77c570d03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.825444:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000084da7aa/0xd08452c77c570d03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.825457:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000084da7aa/0xd08452c77c570d03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762920.825463:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000084da7aa/0xd08452c77c570d03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762920.825533:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140826368:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3095us (48229us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762920.825544:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 628 00000100:00100000:0.0:1789762920.825555:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325295480112 time 325295564351 state 0x2 ref 0 00000100:00100000:1.0:1789762920.827379:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762920.827465:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140826496 00000100:00100000:2.0:1789762920.827474:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140826496 00000100:00100000:2.0:1789762920.827526:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325295480112 time 325295564351 state 0x0 ref 1 00000100:00100000:2.0:1789762920.827538:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325345564351 time 325295564351 state 0x1 ref 1 00000100:00100000:2.0:1789762920.872477:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325345564351 time 325345627005 state 0x0 ref 1 00000100:00100000:2.0:1789762920.872498:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140826496:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762920.872547:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c570d0a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.872571:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762920.872575:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762920.872581:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c570d0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762920.872591:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c570d0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.875337:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c570d0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.875349:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c570d0a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.875367:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c570d0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.875372:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762920.875376:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c570d0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.875383:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c570d0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.875395:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c570d0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.875401:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a13dc52/0xd08452c77c570d0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762920.875449:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140826496:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2958us (48070us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762920.875455:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 629 00000100:00100000:1.0:1789762920.875463:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325345564351 time 325345627005 state 0x2 ref 0 00000100:00100000:1.0:1789762920.877139:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762920.877180:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140826624 00000100:00100000:2.0:1789762920.877187:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140826624 00000100:00100000:2.0:1789762920.877221:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325345564351 time 325345627005 state 0x0 ref 1 00000100:00100000:2.0:1789762920.877233:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325395627005 time 325345627005 state 0x1 ref 1 00000100:00100000:3.0:1789762920.922561:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325395627005 time 325395711631 state 0x0 ref 1 00000100:00100000:3.0:1789762920.922581:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140826624:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762920.922616:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c570d11 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.922630:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762920.922633:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762920.922638:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c570d11 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.922648:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c570d11 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.925271:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c570d11 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.925281:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c570d11 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.925287:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c570d11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.925291:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747ff000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762920.925294:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c570d11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.925310:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c570d11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.925323:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c570d11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762920.925327:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c570d11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762920.925372:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140826624:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2797us (48233us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762920.925379:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 630 00000100:00100000:3.0:1789762920.925387:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325395627005 time 325395711631 state 0x2 ref 0 00000100:00100000:3.0:1789762920.927107:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762920.927157:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140826752 00000100:00100000:0.0:1789762920.927166:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140826752 00000100:00100000:0.0:1789762920.927210:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325395627005 time 325395711631 state 0x0 ref 1 00000100:00100000:0.0:1789762920.927235:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325445711631 time 325395711631 state 0x1 ref 1 00000100:00100000:1.0:1789762920.972649:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325445711631 time 325445800270 state 0x0 ref 1 00000100:00100000:1.0:1789762920.972682:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140826752:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762920.972717:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d18 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.972731:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762920.972734:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762920.972739:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.972749:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.975541:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.975552:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.975560:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.975566:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762920.975569:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.975576:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.975597:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762920.975603:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d18 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762920.975649:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140826752:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2971us (48541us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762920.975657:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 631 00000100:00100000:1.0:1789762920.975665:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325445711631 time 325445800270 state 0x2 ref 0 00000100:00100000:3.0:1789762920.977320:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762920.977358:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140826880 00000100:00100000:1.0:1789762920.977367:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140826880 00000100:00100000:1.0:1789762920.977409:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325445711631 time 325445800270 state 0x0 ref 1 00000100:00100000:1.0:1789762920.977424:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325495800270 time 325445800270 state 0x1 ref 1 00000100:00100000:1.0:1789762921.022731:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325495800270 time 325495877129 state 0x0 ref 1 00000100:00100000:1.0:1789762921.022777:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140826880:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:3.0:1789762921.022798:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762921.022829:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d1f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.022882:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762921.022899:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762921.022917:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.022934:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.026013:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.026025:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d1f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.026033:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.026039:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762921.026043:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.026050:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.026064:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d1f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.026069:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d1f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762921.026139:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140826880:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3387us (48818us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762921.026147:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 632 00000100:00100000:1.0:1789762921.026156:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325495800270 time 325495877129 state 0x2 ref 0 00000100:00100000:3.0:1789762921.028878:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762921.028930:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140827008 00000100:00100000:1.0:1789762921.028941:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140827008 00000100:00100000:1.0:1789762921.029004:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325495800270 time 325495877129 state 0x0 ref 1 00000100:00100000:1.0:1789762921.029020:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325545877129 time 325495877129 state 0x1 ref 1 00000100:00100000:2.0:1789762921.072828:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325545877129 time 325545977568 state 0x0 ref 1 00000100:00100000:2.0:1789762921.072876:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140827008:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762921.072914:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570d26 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.072928:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762921.072932:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762921.072937:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570d26 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.072964:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570d26 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.075735:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570d26 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.075758:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570d26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.075765:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570d26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.075771:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762921.075775:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570d26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.075781:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570d26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.075797:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570d26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.075806:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570d26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762921.075915:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140827008:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3045us (47040us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762921.075934:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 633 00000100:00100000:0.0:1789762921.075942:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325545877129 time 325545977568 state 0x2 ref 0 00000100:00100000:3.0:1789762921.077720:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762921.077758:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140827136 00000100:00100000:0.0:1789762921.077766:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140827136 00000100:00100000:0.0:1789762921.077808:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325545877129 time 325545977568 state 0x0 ref 1 00000100:00100000:0.0:1789762921.077825:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325595977568 time 325545977568 state 0x1 ref 1 00000100:00100000:2.0:1789762921.122936:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325595977568 time 325596080853 state 0x0 ref 1 00000100:00100000:2.0:1789762921.122976:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140827136:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762921.123016:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570d2d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.123041:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762921.123044:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762921.123049:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570d2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.123061:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570d2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.125967:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570d2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.125982:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570d2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.125992:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570d2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.126010:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762921.126016:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570d2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.126026:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570d2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.126046:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570d2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.126056:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c570d2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762921.126130:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140827136:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3169us (48403us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762921.126150:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 634 00000100:00100000:2.0:1789762921.126163:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325595977568 time 325596080853 state 0x2 ref 0 00000100:00100000:2.0:1789762921.127031:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789762921.127035:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149040512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762921.127051:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149040768:0@lo:400:kworker.0 00000100:00100000:1.0:1789762921.127081:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149040640:0@lo:400:kworker.0 00000100:00100000:3.0:1789762921.127106:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762921.127107:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044e52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149040896:0@lo:400:kworker.0 00000100:00100000:2.0:1789762921.127113:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762921.127147:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762921.127161:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149040384:0@lo:400:kworker.0 00000100:00100000:3.0:1789762921.127164:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149041024:0@lo:400:kworker.0 00000100:00100000:0.0:1789762921.127174:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762921.127176:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149041152:0@lo:400:kworker.0 00000100:00100000:3.0:1789762921.127220:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762921.127230:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762921.127230:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762921.127233:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149040768 00000100:00100000:0.0:1789762921.127242:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149040768 00000100:00100000:3.0:1789762921.127276:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149040512 00000100:00100000:3.0:1789762921.127288:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149040512 00000100:00100000:1.0:1789762921.127309:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149040896 00000100:00100000:1.0:1789762921.127314:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149040896 00000100:00100000:2.0:1789762921.127317:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149040640 00000100:00100000:0.0:1789762921.127318:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149041024 00000100:00100000:0.0:1789762921.127323:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149041024 00000100:00100000:2.0:1789762921.127330:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149040640 00000100:00100000:3.0:1789762921.127343:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789762921.127354:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149041152 00000100:00100000:1.0:1789762921.127359:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149041152 00000100:00100000:3.0:1789762921.127360:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149040512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762921.127364:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789762921.127374:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789762921.127378:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149040768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762921.127385:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149041024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762921.127394:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00002000:00000024:3.0:1789762921.127403:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789762921.127404:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149040896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762921.127436:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1876702149040768:12345-0@lo:400:kworker.0 Request processed in 61us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762921.127444:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789762921.127448:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876702149041024:12345-0@lo:400:kworker.0 Request processed in 64us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762921.127457:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789762921.127466:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1876702149040512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762921.127474:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789762921.127477:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789762921.127490:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149040640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762921.127501:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149040896:12345-0@lo:400:kworker.0 Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762921.127525:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789762921.127536:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1876702149041024:0@lo:400:kworker.0 00000100:00100000:1.0:1789762921.127570:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789762921.127577:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1876702149040640:12345-0@lo:400:kworker.0 Request processed in 91us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762921.127579:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1742e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149040512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762921.127586:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149041152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762921.127593:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789762921.127622:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149040384 00000100:00100000:3.0:1789762921.127629:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149040384 00000100:00100000:1.0:1789762921.127632:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149041152:12345-0@lo:400:kworker.0 Request processed in 53us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762921.127640:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789762921.127653:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1876702149040768:0@lo:400:kworker.0 00000100:00080000:2.0:1789762921.127654:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762921.127687:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044e52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149040896:0@lo:400:kworker.0 00000100:00100000:3.0:1789762921.127688:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789762921.127702:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149040384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762921.127707:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1876702149040640:0@lo:400:kworker.0 00000100:00100000:0.0:1789762921.127728:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149041152:0@lo:400:kworker.0 00000100:00100000:3.0:1789762921.127746:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149040384:12345-0@lo:400:kworker.0 Request processed in 49us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762921.127752:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789762921.127781:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149040384:0@lo:400:kworker.0 00000100:00100000:2.0:1789762921.128531:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762921.128584:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140827264 00000100:00100000:1.0:1789762921.128589:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140827264 00000100:00100000:1.0:1789762921.128629:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325595977568 time 325596080853 state 0x0 ref 1 00000100:00100000:1.0:1789762921.128639:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325646080853 time 325596080853 state 0x1 ref 1 00000100:00100000:0.0:1789762921.173031:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325646080853 time 325646169674 state 0x0 ref 1 00000100:00100000:0.0:1789762921.173053:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140827264:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762921.173089:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d34 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.173102:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762921.173106:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762921.173110:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d34 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.173121:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d34 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.176141:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d34 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.176152:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.176159:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.176179:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762921.176184:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.176191:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.176217:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.176222:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762921.176269:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140827264:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3223us (47739us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762921.176289:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 635 00000100:00100000:0.0:1789762921.176298:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325646080853 time 325646169674 state 0x2 ref 0 00000100:00100000:0.0:1789762921.178116:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762921.178159:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140827392 00000100:00100000:2.0:1789762921.178166:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140827392 00000100:00100000:2.0:1789762921.178201:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325646080853 time 325646169674 state 0x0 ref 1 00000100:00100000:2.0:1789762921.178213:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325696169674 time 325646169674 state 0x1 ref 1 00000100:00100000:0.0:1789762921.223134:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325696169674 time 325696284519 state 0x0 ref 1 00000100:00100000:0.0:1789762921.223155:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140827392:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762921.223190:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d3b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.223215:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762921.223218:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762921.223223:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.223234:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.225990:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.226002:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.226010:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.226015:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762921.226019:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.226025:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.226046:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.226052:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c570d3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762921.226104:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140827392:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2955us (47988us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762921.226111:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 636 00000100:00100000:1.0:1789762921.226119:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325696169674 time 325696284519 state 0x2 ref 0 00000100:00100000:0.0:1789762921.227995:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762921.228037:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140827520 00000100:00100000:2.0:1789762921.228045:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140827520 00000100:00100000:2.0:1789762921.228096:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325696169674 time 325696284519 state 0x0 ref 1 00000100:00100000:2.0:1789762921.228108:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325746284519 time 325696284519 state 0x1 ref 1 00000100:00100000:3.0:1789762921.273191:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325746284519 time 325746342775 state 0x0 ref 1 00000100:00100000:3.0:1789762921.273210:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140827520:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762921.273256:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d42 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.273269:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762921.273273:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762921.273277:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.273289:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.276258:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.276270:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.276278:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.276284:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d145f03400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762921.276287:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.276294:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.276308:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.276314:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762921.276369:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140827520:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3163us (48374us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762921.276375:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 637 00000100:00100000:3.0:1789762921.276388:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325746284519 time 325746342775 state 0x2 ref 0 00000100:00100000:0.0:1789762921.278305:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762921.278340:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140827648 00000100:00100000:3.0:1789762921.278347:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140827648 00000100:00100000:3.0:1789762921.278392:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325746284519 time 325746342775 state 0x0 ref 1 00000100:00100000:3.0:1789762921.278403:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325796342775 time 325746342775 state 0x1 ref 1 00000100:00100000:1.0:1789762921.323329:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325796342775 time 325796478479 state 0x0 ref 1 00000100:00100000:1.0:1789762921.323349:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140827648:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762921.323385:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d49 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.323399:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762921.323403:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762921.323407:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d49 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.323418:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d49 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.326463:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d49 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.326472:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d49 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.326478:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.326483:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762921.326486:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.326493:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.326505:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.326524:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762921.326591:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140827648:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3248us (48287us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762921.326599:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 638 00000100:00100000:1.0:1789762921.326624:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325796342775 time 325796478479 state 0x2 ref 0 00000100:00100000:2.0:1789762921.328544:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762921.328599:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140827776 00000100:00100000:1.0:1789762921.328607:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140827776 00000100:00100000:1.0:1789762921.328653:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325796342775 time 325796478479 state 0x0 ref 1 00000100:00100000:1.0:1789762921.328663:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325846478479 time 325796478479 state 0x1 ref 1 00000100:00100000:0.0:1789762921.332131:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762921.332156:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762921.332171:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762921.332195:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762921.332211:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140828032 00000100:00100000:1.0:1789762921.332215:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140828288 00000100:00100000:0.0:1789762921.332230:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140828160 00000100:00100000:1.0:1789762921.332232:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140828288 00000100:00100000:2.0:1789762921.332234:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140828032 00000100:00100000:0.0:1789762921.332236:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140828160 00000100:00100000:3.0:1789762921.332241:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140827904 00000100:00100000:3.0:1789762921.332248:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140827904 00000100:00100000:0.0:1789762921.332296:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:1.0:1789762921.332312:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:3.0:1789762921.332312:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 299 00000100:00100000:0.0:1789762921.332314:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140828160:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762921.332325:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00100000:1.0:1789762921.332335:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140828288:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762921.332336:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140827904:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762921.332340:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+9:2342:x1876702140828032:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762921.332360:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140828160:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 55us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762921.332366:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:3.0:1789762921.332384:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140827904:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 58us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762921.332393:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140828288:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 67us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762921.332393:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 299 00000100:00100000:2.0:1789762921.332400:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+9:2342:x1876702140828032:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 63us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762921.332407:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:2.0:1789762921.332414:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00080000:1.0:1789762921.332447:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762921.332452:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762921.373415:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325846478479 time 325846553892 state 0x0 ref 1 00000100:00100000:1.0:1789762921.373439:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140827776:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762921.373477:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d50 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.373491:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762921.373494:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762921.373499:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.373541:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.376722:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.376733:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.376740:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.376746:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762921.376750:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.376756:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.376771:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.376777:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570d50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762921.376866:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140827776:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3435us (48321us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762921.376874:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 639 00000100:00100000:1.0:1789762921.376883:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325846478479 time 325846553892 state 0x2 ref 0 00000100:00100000:1.0:1789762921.378812:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762921.378856:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140828416 00000100:00100000:3.0:1789762921.378865:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140828416 00000100:00100000:3.0:1789762921.378903:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325846478479 time 325846553892 state 0x0 ref 1 00000100:00100000:3.0:1789762921.378914:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325896553892 time 325846553892 state 0x1 ref 1 00000100:00100000:2.0:1789762921.423502:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325896553892 time 325896650978 state 0x0 ref 1 00000100:00100000:2.0:1789762921.423540:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140828416:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762921.423577:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d57 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.423591:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762921.423595:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762921.423599:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d57 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.423611:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d57 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.426716:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d57 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.426728:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.426748:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.426753:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762921.426756:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.426762:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.426777:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.426786:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762921.426877:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140828416:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3343us (48062us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762921.426888:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 640 00000100:00100000:2.0:1789762921.426900:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325896553892 time 325896650978 state 0x2 ref 0 00000100:00100000:2.0:1789762921.428983:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762921.429037:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140828544 00000100:00100000:1.0:1789762921.429048:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140828544 00000100:00100000:1.0:1789762921.429092:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325896553892 time 325896650978 state 0x0 ref 1 00000100:00100000:1.0:1789762921.429103:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325946650978 time 325896650978 state 0x1 ref 1 00000100:00100000:2.0:1789762921.473614:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325946650978 time 325946763232 state 0x0 ref 1 00000100:00100000:2.0:1789762921.473651:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140828544:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762921.473686:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d5e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.473699:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762921.473703:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762921.473707:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d5e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.473718:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d5e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.476101:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d5e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.476111:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.476119:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.476124:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762921.476128:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.476134:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.476156:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.476162:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c570d5e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762921.476208:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140828544:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2565us (47227us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762921.476215:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 641 00000100:00100000:2.0:1789762921.476222:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325946650978 time 325946763232 state 0x2 ref 0 00000100:00100000:2.0:1789762921.478050:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762921.478094:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140828672 00000100:00100000:1.0:1789762921.478102:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140828672 00000100:00100000:1.0:1789762921.478137:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325946650978 time 325946763232 state 0x0 ref 1 00000100:00100000:1.0:1789762921.478148:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325996763232 time 325946763232 state 0x1 ref 1 00010000:00010000:2.0:1789762921.510979:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762921.523685:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325996763232 time 325996837021 state 0x0 ref 1 00000100:00100000:0.0:1789762921.523706:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140828672:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762921.523756:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d65 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.523769:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762921.523773:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762921.523777:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.523787:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.526315:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.526324:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.526331:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.526336:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762921.526340:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.526345:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.526378:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d65 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.526384:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762921.526431:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140828672:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2732us (48381us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762921.526440:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 642 00000100:00100000:0.0:1789762921.526451:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325996763232 time 325996837021 state 0x2 ref 0 00000100:00100000:2.0:1789762921.528632:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762921.528673:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140828800 00000100:00100000:0.0:1789762921.528681:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140828800 00000100:00100000:0.0:1789762921.528715:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 325996763232 time 325996837021 state 0x0 ref 1 00000100:00100000:0.0:1789762921.528726:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326046837021 time 325996837021 state 0x1 ref 1 00000100:00100000:0.0:1789762921.573744:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326046837021 time 326046894804 state 0x0 ref 1 00000100:00100000:0.0:1789762921.573765:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140828800:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762921.573799:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d6c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.573812:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762921.573825:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762921.573830:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d6c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.573864:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d6c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.577011:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d6c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.577020:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d6c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.577027:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.577044:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762921.577048:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.577054:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.577069:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.577075:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab0345a6/0xd08452c77c570d6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762921.577127:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140828800:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3369us (48496us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762921.577136:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 643 00000100:00100000:0.0:1789762921.577144:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326046837021 time 326046894804 state 0x2 ref 0 00000100:00100000:0.0:1789762921.579212:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762921.579267:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140828928 00000100:00100000:2.0:1789762921.579278:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140828928 00000100:00100000:2.0:1789762921.579327:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326046837021 time 326046894804 state 0x0 ref 1 00000100:00100000:2.0:1789762921.579343:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326096894804 time 326046894804 state 0x1 ref 1 00000100:00100000:3.0:1789762921.623869:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326096894804 time 326097016543 state 0x0 ref 1 00000100:00100000:3.0:1789762921.623893:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140828928:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762921.623928:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d73 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.623954:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762921.623958:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762921.623962:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.623974:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.626474:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.626487:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.626497:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.626515:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d145f03400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762921.626521:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.626536:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.626556:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.626578:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000768db76d/0xd08452c77c570d73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762921.626636:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140828928:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2749us (47431us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762921.626647:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 644 00000100:00100000:3.0:1789762921.626658:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326096894804 time 326097016543 state 0x2 ref 0 00000100:00100000:0.0:1789762921.628333:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762921.628365:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140829056 00000100:00100000:3.0:1789762921.628372:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140829056 00000100:00100000:3.0:1789762921.628408:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326096894804 time 326097016543 state 0x0 ref 1 00000100:00100000:3.0:1789762921.628418:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326147016543 time 326097016543 state 0x1 ref 1 00000100:00100000:0.0:1789762921.639003:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16a255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149041280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762921.639051:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762921.639092:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149041280 00000100:00100000:3.0:1789762921.639098:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149041280 00000100:00100000:3.0:1789762921.639145:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789762921.639156:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149041280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762921.639187:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526712832 pending 0 free 3746562048 avail 3744464896 00000100:00100000:3.0:1789762921.639229:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149041280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762921.639234:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789762921.639281:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16a255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149041280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762921.673958:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326147016543 time 326147109859 state 0x0 ref 1 00000100:00100000:1.0:1789762921.673975:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140829056:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762921.674006:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d7a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.674035:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762921.674039:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762921.674044:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.674054:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.676632:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.676645:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.676653:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.676659:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762921.676662:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.676669:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.676683:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.676699:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762921.676744:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140829056:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2773us (48411us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762921.676751:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 645 00000100:00100000:1.0:1789762921.676759:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326147016543 time 326147109859 state 0x2 ref 0 00000100:00100000:2.0:1789762921.678471:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762921.678538:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140829184 00000100:00100000:0.0:1789762921.678547:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140829184 00000100:00100000:0.0:1789762921.678589:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326147016543 time 326147109859 state 0x0 ref 1 00000100:00100000:0.0:1789762921.678602:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326197109859 time 326147109859 state 0x1 ref 1 00000100:00100000:1.0:1789762921.724060:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326197109859 time 326197209120 state 0x0 ref 1 00000100:00100000:1.0:1789762921.724087:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140829184:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762921.724128:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d81 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.724142:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762921.724146:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762921.724150:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.724163:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.726978:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.727007:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.727014:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.727019:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762921.727023:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.727029:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.727041:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.727045:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570d81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762921.727102:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140829184:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3022us (48631us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762921.727113:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 646 00000100:00100000:1.0:1789762921.727122:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326197109859 time 326197209120 state 0x2 ref 0 00000100:00100000:3.0:1789762921.728925:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762921.728958:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140829312 00000100:00100000:1.0:1789762921.728971:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140829312 00000100:00100000:1.0:1789762921.729005:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326197109859 time 326197209120 state 0x0 ref 1 00000100:00100000:1.0:1789762921.729016:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326247209120 time 326197209120 state 0x1 ref 1 00000100:00100000:0.0:1789762921.774175:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326247209120 time 326247320331 state 0x0 ref 1 00000100:00100000:0.0:1789762921.774203:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140829312:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762921.774244:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570d88 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.774261:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762921.774279:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762921.774286:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570d88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.774300:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570d88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.777344:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570d88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.777355:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570d88 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.777370:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570d88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.777376:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762921.777380:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570d88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.777386:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570d88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.777400:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570d88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.777406:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dde2b74/0xd08452c77c570d88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762921.777457:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140829312:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3264us (48532us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762921.777464:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 647 00000100:00100000:2.0:1789762921.777472:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326247209120 time 326247320331 state 0x2 ref 0 00000100:00100000:0.0:1789762921.779313:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762921.779363:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140829440 00000100:00100000:1.0:1789762921.779372:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140829440 00000100:00100000:1.0:1789762921.779407:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326247209120 time 326247320331 state 0x0 ref 1 00000100:00100000:1.0:1789762921.779418:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326297320331 time 326247320331 state 0x1 ref 1 00000100:00100000:2.0:1789762921.824257:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326297320331 time 326297407941 state 0x0 ref 1 00000100:00100000:2.0:1789762921.824278:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140829440:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762921.824323:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb719180/0xd08452c77c570d8f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.824337:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762921.824340:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762921.824344:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb719180/0xd08452c77c570d8f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.824355:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb719180/0xd08452c77c570d8f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.827160:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb719180/0xd08452c77c570d8f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.827169:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb719180/0xd08452c77c570d8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.827176:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb719180/0xd08452c77c570d8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.827181:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160053c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762921.827184:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb719180/0xd08452c77c570d8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.827190:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb719180/0xd08452c77c570d8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.827213:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb719180/0xd08452c77c570d8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762921.827218:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb719180/0xd08452c77c570d8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762921.827273:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140829440:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3002us (47961us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762921.827280:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 648 00000100:00100000:2.0:1789762921.827288:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326297320331 time 326297407941 state 0x2 ref 0 00000100:00100000:2.0:1789762921.828997:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762921.829045:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140829568 00000100:00100000:1.0:1789762921.829054:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140829568 00000100:00100000:1.0:1789762921.829092:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326297320331 time 326297407941 state 0x0 ref 1 00000100:00100000:1.0:1789762921.829103:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326347407941 time 326297407941 state 0x1 ref 1 00000100:00100000:3.0:1789762921.874353:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326347407941 time 326347503466 state 0x0 ref 1 00000100:00100000:3.0:1789762921.874386:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140829568:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762921.874421:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570d96 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.874435:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762921.874438:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762921.874442:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570d96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.874453:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570d96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.876890:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570d96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.876899:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570d96 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.876906:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570d96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.876912:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762921.876915:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570d96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.876921:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570d96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.876942:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570d96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.876948:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570d96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762921.876995:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140829568:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2614us (47999us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762921.877002:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 649 00000100:00100000:3.0:1789762921.877009:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326347407941 time 326347503466 state 0x2 ref 0 00000100:00100000:3.0:1789762921.878579:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762921.878630:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140829696 00000100:00100000:2.0:1789762921.878638:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140829696 00000100:00100000:2.0:1789762921.878676:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326347407941 time 326347503466 state 0x0 ref 1 00000100:00100000:2.0:1789762921.878687:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326397503466 time 326347503466 state 0x1 ref 1 00000100:00100000:0.0:1789762921.924445:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326397503466 time 326397595256 state 0x0 ref 1 00000100:00100000:0.0:1789762921.924467:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140829696:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762921.924500:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c570d9d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.924531:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762921.924536:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762921.924542:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c570d9d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762921.924556:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c570d9d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.927160:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c570d9d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.927175:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c570d9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.927186:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c570d9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.927194:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762921.927207:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c570d9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.927215:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c570d9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.927227:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c570d9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762921.927233:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c570d9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762921.927285:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140829696:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2823us (48704us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762921.927294:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 650 00000100:00100000:1.0:1789762921.927306:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326397503466 time 326397595256 state 0x2 ref 0 00000100:00100000:3.0:1789762921.928915:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762921.928970:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140829824 00000100:00100000:2.0:1789762921.928979:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140829824 00000100:00100000:2.0:1789762921.929017:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326397503466 time 326397595256 state 0x0 ref 1 00000100:00100000:2.0:1789762921.929028:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326447595256 time 326397595256 state 0x1 ref 1 00000100:00100000:3.0:1789762921.974542:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326447595256 time 326447697466 state 0x0 ref 1 00000100:00100000:3.0:1789762921.974559:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140829824:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762921.974585:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570da4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.974596:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762921.974599:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762921.974603:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570da4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.974624:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570da4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.977268:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570da4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.977277:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570da4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.977283:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570da4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.977288:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762921.977291:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570da4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.977297:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570da4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.977309:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570da4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762921.977314:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570da4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762921.977365:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140829824:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2811us (48451us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762921.977372:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 651 00000100:00100000:3.0:1789762921.977380:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326447595256 time 326447697466 state 0x2 ref 0 00000100:00100000:3.0:1789762921.978919:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762921.978974:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140829952 00000100:00100000:0.0:1789762921.978982:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140829952 00000100:00100000:0.0:1789762921.979020:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326447595256 time 326447697466 state 0x0 ref 1 00000100:00100000:0.0:1789762921.979032:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326497697466 time 326447697466 state 0x1 ref 1 00000100:00100000:1.0:1789762922.024636:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326497697466 time 326497787047 state 0x0 ref 1 00000100:00100000:1.0:1789762922.024654:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140829952:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762922.024686:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570dab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.024699:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762922.024702:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762922.024706:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570dab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.024727:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570dab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.027348:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570dab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.027360:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570dab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.027366:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570dab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.027370:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762922.027374:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570dab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.027380:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570dab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.027391:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570dab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.027396:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570dab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762922.027456:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140829952:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2806us (48537us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762922.027463:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 652 00000100:00100000:1.0:1789762922.027472:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326497697466 time 326497787047 state 0x2 ref 0 00000100:00100000:3.0:1789762922.029541:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762922.029577:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140830080 00000100:00100000:1.0:1789762922.029585:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140830080 00000100:00100000:1.0:1789762922.029621:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326497697466 time 326497787047 state 0x0 ref 1 00000100:00100000:1.0:1789762922.029632:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326547787047 time 326497787047 state 0x1 ref 1 00000100:00100000:1.0:1789762922.074705:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326547787047 time 326547850789 state 0x0 ref 1 00000100:00100000:1.0:1789762922.074730:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140830080:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762922.074766:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570db2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.074779:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762922.074783:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762922.074787:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570db2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.074798:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570db2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.077290:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570db2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.077303:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570db2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.077313:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570db2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.077322:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762922.077328:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570db2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.077338:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570db2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.077354:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570db2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.077360:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570db2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762922.077405:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140830080:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2681us (47864us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762922.077411:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 653 00000100:00100000:1.0:1789762922.077424:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326547787047 time 326547850789 state 0x2 ref 0 00000100:00100000:3.0:1789762922.079100:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762922.079139:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140830208 00000100:00100000:1.0:1789762922.079148:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140830208 00000100:00100000:1.0:1789762922.079181:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326547787047 time 326547850789 state 0x0 ref 1 00000100:00100000:1.0:1789762922.079191:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326597850789 time 326547850789 state 0x1 ref 1 00000100:00100000:2.0:1789762922.124790:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326597850789 time 326597941428 state 0x0 ref 1 00000100:00100000:2.0:1789762922.124820:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140830208:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762922.124879:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570db9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.124892:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762922.124896:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762922.124900:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570db9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.124910:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570db9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.127614:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570db9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.127625:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570db9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.127632:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570db9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.127637:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1488a6000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762922.127641:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570db9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.127658:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570db9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.127670:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570db9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.127675:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570db9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762922.127732:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140830208:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2917us (48630us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762922.127739:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 654 00000100:00100000:2.0:1789762922.127748:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326597850789 time 326597941428 state 0x2 ref 0 00000100:00100000:3.0:1789762922.129470:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762922.129559:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140830336 00000100:00100000:1.0:1789762922.129567:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140830336 00000100:00100000:1.0:1789762922.129606:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326597850789 time 326597941428 state 0x0 ref 1 00000100:00100000:1.0:1789762922.129618:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326647941428 time 326597941428 state 0x1 ref 1 00000100:00100000:2.0:1789762922.174907:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326647941428 time 326648057242 state 0x0 ref 1 00000100:00100000:2.0:1789762922.174930:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140830336:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762922.174967:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570dc0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.174981:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762922.174986:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762922.174993:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570dc0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.175026:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570dc0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.177804:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570dc0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.177815:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570dc0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.177822:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570dc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.177828:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1488a6000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762922.177851:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570dc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.177858:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570dc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.177873:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570dc0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.177880:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c25c252a/0xd08452c77c570dc0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762922.177947:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140830336:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3023us (48478us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762922.177955:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 655 00000100:00100000:2.0:1789762922.177963:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326647941428 time 326648057242 state 0x2 ref 0 00000100:00100000:3.0:1789762922.179684:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762922.179728:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140830464 00000100:00100000:1.0:1789762922.179736:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140830464 00000100:00100000:1.0:1789762922.179772:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326647941428 time 326648057242 state 0x0 ref 1 00000100:00100000:1.0:1789762922.179783:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326698057242 time 326648057242 state 0x1 ref 1 00000100:00100000:0.0:1789762922.224998:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326698057242 time 326698146533 state 0x0 ref 1 00000100:00100000:0.0:1789762922.225020:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140830464:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762922.225055:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570dc7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.225070:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762922.225084:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762922.225091:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570dc7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.225105:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570dc7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.227786:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570dc7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.227801:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570dc7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.227812:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570dc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.227820:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762922.227825:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570dc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.227855:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570dc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.227889:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570dc7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.227898:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570dc7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762922.227955:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140830464:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2940us (48270us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762922.227964:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 656 00000100:00100000:3.0:1789762922.227974:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326698057242 time 326698146533 state 0x2 ref 0 00000100:00100000:3.0:1789762922.229707:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762922.229750:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140830592 00000100:00100000:2.0:1789762922.229757:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140830592 00000100:00100000:2.0:1789762922.229793:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326698057242 time 326698146533 state 0x0 ref 1 00000100:00100000:2.0:1789762922.229804:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326748146533 time 326698146533 state 0x1 ref 1 00000100:00100000:0.0:1789762922.275081:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326748146533 time 326748229431 state 0x0 ref 1 00000100:00100000:0.0:1789762922.275103:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140830592:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762922.275141:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570dce lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.275157:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762922.275162:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762922.275168:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570dce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.275198:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570dce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.277981:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570dce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.277993:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570dce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.278000:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570dce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.278005:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762922.278009:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570dce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.278015:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570dce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.278030:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570dce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.278035:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c570dce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762922.278093:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140830592:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2996us (48386us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762922.278100:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 657 00000100:00100000:0.0:1789762922.278108:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326748146533 time 326748229431 state 0x2 ref 0 00000100:00100000:3.0:1789762922.279772:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762922.279830:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140830720 00000100:00100000:2.0:1789762922.279859:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140830720 00000100:00100000:2.0:1789762922.279902:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326748146533 time 326748229431 state 0x0 ref 1 00000100:00100000:2.0:1789762922.279913:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326798229431 time 326748229431 state 0x1 ref 1 00000100:00100000:3.0:1789762922.325176:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326798229431 time 326798330243 state 0x0 ref 1 00000100:00100000:3.0:1789762922.325193:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140830720:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762922.325220:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570dd5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.325231:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762922.325234:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762922.325238:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.325260:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.327986:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.327998:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.328006:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570dd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.328017:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762922.328021:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570dd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.328027:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570dd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.328038:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570dd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.328043:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d072f81/0xd08452c77c570dd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762922.328087:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140830720:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2898us (48316us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762922.328095:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 658 00000100:00100000:1.0:1789762922.328102:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326798229431 time 326798330243 state 0x2 ref 0 00000100:00100000:2.0:1789762922.329712:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762922.329748:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140830848 00000100:00100000:3.0:1789762922.329756:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140830848 00000100:00100000:3.0:1789762922.329791:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326798229431 time 326798330243 state 0x0 ref 1 00000100:00100000:3.0:1789762922.329801:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326848330243 time 326798330243 state 0x1 ref 1 00000100:00100000:1.0:1789762922.375271:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326848330243 time 326848426359 state 0x0 ref 1 00000100:00100000:1.0:1789762922.375289:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140830848:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762922.375316:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ddc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.375339:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762922.375342:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762922.375346:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ddc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.375355:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ddc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.378078:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ddc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.378090:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ddc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.378097:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.378103:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762922.378106:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.378112:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.378125:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ddc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.378141:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ddc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762922.378186:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140830848:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2902us (48474us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762922.378193:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 659 00000100:00100000:1.0:1789762922.378200:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326848330243 time 326848426359 state 0x2 ref 0 00000100:00100000:0.0:1789762922.379878:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762922.379911:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140830976 00000100:00100000:1.0:1789762922.379919:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140830976 00000100:00100000:1.0:1789762922.379950:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326848330243 time 326848426359 state 0x0 ref 1 00000100:00100000:1.0:1789762922.379960:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326898426359 time 326848426359 state 0x1 ref 1 00000100:00100000:1.0:1789762922.425385:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326898426359 time 326898536007 state 0x0 ref 1 00000100:00100000:1.0:1789762922.425404:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140830976:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762922.425438:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570de3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.425452:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762922.425455:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762922.425460:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570de3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.425486:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570de3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.428280:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570de3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.428292:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570de3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.428299:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570de3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.428304:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762922.428307:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570de3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.428325:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570de3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.428337:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570de3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.428342:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570de3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762922.428418:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140830976:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3018us (48540us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762922.428426:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 660 00000100:00100000:1.0:1789762922.428435:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326898426359 time 326898536007 state 0x2 ref 0 00000100:00100000:3.0:1789762922.430200:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762922.430257:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140831104 00000100:00100000:1.0:1789762922.430265:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140831104 00000100:00100000:1.0:1789762922.430303:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326898426359 time 326898536007 state 0x0 ref 1 00000100:00100000:1.0:1789762922.430319:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326948536007 time 326898536007 state 0x1 ref 1 00000100:00100000:2.0:1789762922.475455:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326948536007 time 326948607714 state 0x0 ref 1 00000100:00100000:2.0:1789762922.475476:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140831104:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762922.475523:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570dea lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.475550:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762922.475554:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762922.475558:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570dea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.475569:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570dea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.478566:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570dea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.478577:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570dea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.478584:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570dea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.478589:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ec00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762922.478593:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570dea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.478600:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570dea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.478613:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570dea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.478629:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016075eb4/0xd08452c77c570dea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762922.478680:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140831104:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3211us (48481us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762922.478688:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 661 00000100:00100000:0.0:1789762922.478696:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326948536007 time 326948607714 state 0x2 ref 0 00000100:00100000:3.0:1789762922.480521:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762922.480573:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140831232 00000100:00100000:1.0:1789762922.480581:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140831232 00000100:00100000:1.0:1789762922.480625:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326948536007 time 326948607714 state 0x0 ref 1 00000100:00100000:1.0:1789762922.480641:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326998607714 time 326948607714 state 0x1 ref 1 00000100:00100000:2.0:1789762922.525556:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326998607714 time 326998705935 state 0x0 ref 1 00000100:00100000:2.0:1789762922.525578:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140831232:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762922.525612:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570df1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.525626:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762922.525629:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762922.525634:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570df1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.525645:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570df1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.528521:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570df1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.528533:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570df1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.528552:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570df1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.528557:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003ee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762922.528560:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570df1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.528566:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570df1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.528580:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570df1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.528592:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000170d1c60/0xd08452c77c570df1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762922.528641:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140831232:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3070us (48120us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762922.528648:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 662 00000100:00100000:0.0:1789762922.528656:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326998607714 time 326998705935 state 0x2 ref 0 00000100:00100000:3.0:1789762922.530682:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762922.530723:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140831360 00000100:00100000:1.0:1789762922.530731:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140831360 00000100:00100000:1.0:1789762922.530768:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 326998607714 time 326998705935 state 0x0 ref 1 00000100:00100000:1.0:1789762922.530779:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327048705935 time 326998705935 state 0x1 ref 1 00010000:00010000:1.0:1789762922.534906:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762922.575627:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327048705935 time 327048781613 state 0x0 ref 1 00000100:00100000:3.0:1789762922.575644:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140831360:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762922.575672:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570df8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.575683:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762922.575686:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762922.575690:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570df8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.575699:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570df8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.578583:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570df8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.578593:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570df8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.578600:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570df8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.578606:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762922.578609:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570df8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.578615:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570df8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.578628:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570df8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.578640:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d4e2f8/0xd08452c77c570df8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762922.578686:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140831360:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3047us (48005us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762922.578693:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 663 00000100:00100000:0.0:1789762922.578700:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327048705935 time 327048781613 state 0x2 ref 0 00000100:00100000:2.0:1789762922.580615:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762922.580650:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140831488 00000100:00100000:0.0:1789762922.580656:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140831488 00000100:00100000:0.0:1789762922.580687:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327048705935 time 327048781613 state 0x0 ref 1 00000100:00100000:0.0:1789762922.580696:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327098781613 time 327048781613 state 0x1 ref 1 00000100:00100000:0.0:1789762922.625703:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327098781613 time 327098852087 state 0x0 ref 1 00000100:00100000:0.0:1789762922.625726:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140831488:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762922.625763:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c570dff lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.625778:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762922.625782:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762922.625789:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c570dff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.625822:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c570dff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.628526:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c570dff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.628538:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c570dff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.628546:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c570dff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.628551:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762922.628554:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c570dff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.628560:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c570dff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.628573:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c570dff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.628577:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c570dff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762922.628626:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140831488:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2906us (48011us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762922.628633:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 664 00000100:00100000:1.0:1789762922.628641:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327098781613 time 327098852087 state 0x2 ref 0 00000100:00100000:2.0:1789762922.630695:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762922.630744:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140831616 00000100:00100000:0.0:1789762922.630753:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140831616 00000100:00100000:0.0:1789762922.630791:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327098781613 time 327098852087 state 0x0 ref 1 00000100:00100000:0.0:1789762922.630806:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327148852087 time 327098852087 state 0x1 ref 1 00000100:00100000:3.0:1789762922.675770:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327148852087 time 327148924214 state 0x0 ref 1 00000100:00100000:3.0:1789762922.675793:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140831616:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762922.675829:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570e06 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.675857:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762922.675860:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762922.675864:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570e06 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.675874:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570e06 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.678469:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570e06 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.678478:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570e06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.678494:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570e06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.678511:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d16003e000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762922.678522:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570e06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.678530:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570e06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.678543:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570e06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762922.678549:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023875c5e/0xd08452c77c570e06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762922.678595:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140831616:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2809us (47901us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762922.678602:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 665 00000100:00100000:3.0:1789762922.678609:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327148852087 time 327148924214 state 0x2 ref 0 00000100:00100000:3.0:1789762922.680153:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762922.680203:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140831744 00000100:00100000:0.0:1789762922.680211:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140831744 00000100:00100000:0.0:1789762922.680263:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327148852087 time 327148924214 state 0x0 ref 1 00000100:00100000:0.0:1789762922.680279:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327198924214 time 327148924214 state 0x1 ref 1 00000100:00100000:1.0:1789762922.725873:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327198924214 time 327199027895 state 0x0 ref 1 00000100:00100000:1.0:1789762922.725891:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140831744:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762922.725932:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e0d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.725945:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762922.725948:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762922.725952:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e0d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.725971:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e0d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.728483:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e0d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.728495:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.728513:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.728519:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762922.728522:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.728546:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.728558:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.728564:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762922.728608:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140831744:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2721us (48455us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762922.728615:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 666 00000100:00100000:1.0:1789762922.728623:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327198924214 time 327199027895 state 0x2 ref 0 00000100:00100000:3.0:1789762922.730298:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762922.730365:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140831872 00000100:00100000:1.0:1789762922.730373:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140831872 00000100:00100000:1.0:1789762922.730416:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327198924214 time 327199027895 state 0x0 ref 1 00000100:00100000:1.0:1789762922.730426:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327249027895 time 327199027895 state 0x1 ref 1 00000100:00100000:1.0:1789762922.775934:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327249027895 time 327249088291 state 0x0 ref 1 00000100:00100000:1.0:1789762922.775952:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140831872:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762922.775980:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e14 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.775999:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762922.776002:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762922.776007:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e14 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.776016:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e14 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.778654:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e14 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.778672:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.778682:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.778688:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762922.778692:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.778698:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.778711:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.778727:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762922.778773:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140831872:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2826us (48475us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762922.778780:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 667 00000100:00100000:1.0:1789762922.778788:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327249027895 time 327249088291 state 0x2 ref 0 00000100:00100000:3.0:1789762922.780423:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762922.780470:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140832000 00000100:00100000:1.0:1789762922.780480:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140832000 00000100:00100000:1.0:1789762922.780535:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327249027895 time 327249088291 state 0x0 ref 1 00000100:00100000:1.0:1789762922.780549:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327299088291 time 327249088291 state 0x1 ref 1 00000100:00100000:2.0:1789762922.826058:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327299088291 time 327299207449 state 0x0 ref 1 00000100:00100000:2.0:1789762922.826093:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140832000:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762922.826131:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c570e1b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.826145:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762922.826148:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762922.826153:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c570e1b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762922.826164:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c570e1b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.829282:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c570e1b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.829294:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c570e1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.829301:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c570e1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.829307:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762922.829317:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c570e1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.829325:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c570e1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.829344:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c570e1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.829353:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c570e1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762922.829411:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140832000:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3323us (48988us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762922.829420:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 668 00000100:00100000:0.0:1789762922.829429:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327299088291 time 327299207449 state 0x2 ref 0 00000100:00100000:2.0:1789762922.831622:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762922.831673:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140832128 00000100:00100000:1.0:1789762922.831681:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140832128 00000100:00100000:1.0:1789762922.831725:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327299088291 time 327299207449 state 0x0 ref 1 00000100:00100000:1.0:1789762922.831736:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327349207449 time 327299207449 state 0x1 ref 1 00000100:00100000:0.0:1789762922.876197:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327349207449 time 327349345663 state 0x0 ref 1 00000100:00100000:0.0:1789762922.876219:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140832128:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762922.876256:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e22 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.876270:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762922.876286:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762922.876291:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.876316:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.879418:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.879430:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.879437:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.879442:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762922.879446:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.879453:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.879468:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.879474:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762922.879552:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140832128:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3339us (47930us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762922.879560:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 669 00000100:00100000:0.0:1789762922.879567:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327349207449 time 327349345663 state 0x2 ref 0 00000100:00100000:0.0:1789762922.881397:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762922.881437:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140832256 00000100:00100000:1.0:1789762922.881446:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140832256 00000100:00100000:1.0:1789762922.881482:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327349207449 time 327349345663 state 0x0 ref 1 00000100:00100000:1.0:1789762922.881493:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327399345663 time 327349345663 state 0x1 ref 1 00000100:00100000:0.0:1789762922.926289:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327399345663 time 327399439532 state 0x0 ref 1 00000100:00100000:0.0:1789762922.926309:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140832256:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762922.926343:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e29 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.926356:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762922.926359:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762922.926364:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.926375:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.929144:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.929155:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e29 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.929162:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.929166:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762922.929169:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.929175:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.929188:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.929192:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021182758/0xd08452c77c570e29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762922.929240:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140832256:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2937us (47843us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762922.929248:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 670 00000100:00100000:1.0:1789762922.929256:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327399345663 time 327399439532 state 0x2 ref 0 00000100:00100000:0.0:1789762922.930956:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762922.931042:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140832384 00000100:00100000:2.0:1789762922.931050:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140832384 00000100:00100000:2.0:1789762922.931086:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327399345663 time 327399439532 state 0x0 ref 1 00000100:00100000:2.0:1789762922.931097:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327449439532 time 327399439532 state 0x1 ref 1 00000100:00100000:0.0:1789762922.976370:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327449439532 time 327449522401 state 0x0 ref 1 00000100:00100000:0.0:1789762922.976388:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140832384:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762922.976437:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570e30 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.976450:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762922.976453:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762922.976458:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570e30 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762922.976468:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570e30 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.979296:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570e30 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.979308:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570e30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.979316:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570e30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.979321:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762922.979325:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570e30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.979331:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570e30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.979345:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570e30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762922.979350:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012f25d4d/0xd08452c77c570e30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762922.979396:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140832384:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3012us (48440us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762922.979404:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 671 00000100:00100000:1.0:1789762922.979412:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327449439532 time 327449522401 state 0x2 ref 0 00000100:00100000:2.0:1789762922.981143:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762922.981196:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140832512 00000100:00100000:0.0:1789762922.981203:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140832512 00000100:00100000:0.0:1789762922.981236:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327449439532 time 327449522401 state 0x0 ref 1 00000100:00100000:0.0:1789762922.981246:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327499522401 time 327449522401 state 0x1 ref 1 00000100:00100000:3.0:1789762923.026465:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327499522401 time 327499613132 state 0x0 ref 1 00000100:00100000:3.0:1789762923.026515:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140832512:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:1.0:1789762923.026549:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762923.026557:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c570e37 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.026592:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762923.026596:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762923.026601:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c570e37 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.026612:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c570e37 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.029394:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c570e37 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.029405:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c570e37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.029411:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c570e37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.029416:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762923.029419:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c570e37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.029425:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c570e37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.029437:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c570e37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.029466:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c570e37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762923.029529:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140832512:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3048us (48386us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762923.029537:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 672 00000100:00100000:3.0:1789762923.029545:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327499522401 time 327499613132 state 0x2 ref 0 00000100:00100000:3.0:1789762923.031852:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762923.031894:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140832640 00000100:00100000:1.0:1789762923.031902:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140832640 00000100:00100000:1.0:1789762923.031939:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327499522401 time 327499613132 state 0x0 ref 1 00000100:00100000:1.0:1789762923.031950:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327549613132 time 327499613132 state 0x1 ref 1 00000100:00100000:1.0:1789762923.076544:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327549613132 time 327549686413 state 0x0 ref 1 00000100:00100000:1.0:1789762923.076568:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140832640:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762923.076608:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e3e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.076622:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762923.076626:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762923.076631:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e3e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.076642:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e3e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.079610:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e3e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.079620:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.079637:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.079643:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762923.079647:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.079662:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.079677:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.079683:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762923.079734:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140832640:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3173us (47901us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762923.079741:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 673 00000100:00100000:1.0:1789762923.079756:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327549613132 time 327549686413 state 0x2 ref 0 00000100:00100000:3.0:1789762923.081637:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762923.081673:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140832768 00000100:00100000:1.0:1789762923.081681:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140832768 00000100:00100000:1.0:1789762923.081719:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327549613132 time 327549686413 state 0x0 ref 1 00000100:00100000:1.0:1789762923.081739:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327599686413 time 327549686413 state 0x1 ref 1 00000100:00100000:1.0:1789762923.126595:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327599686413 time 327599742730 state 0x0 ref 1 00000100:00100000:1.0:1789762923.126620:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140832768:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762923.126659:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e45 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.126674:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762923.126677:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762923.126682:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.126692:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.129311:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.129320:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.129326:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.129346:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762923.129349:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.129356:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.129368:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.129373:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762923.129424:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140832768:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2811us (47788us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762923.129430:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 674 00000100:00100000:1.0:1789762923.129438:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327599686413 time 327599742730 state 0x2 ref 0 00000100:00100000:3.0:1789762923.131105:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762923.131156:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140832896 00000100:00100000:1.0:1789762923.131165:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140832896 00000100:00100000:1.0:1789762923.131205:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327599686413 time 327599742730 state 0x0 ref 1 00000100:00100000:1.0:1789762923.131229:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327649742730 time 327599742730 state 0x1 ref 1 00000100:00100000:2.0:1789762923.176675:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327649742730 time 327649819306 state 0x0 ref 1 00000100:00100000:2.0:1789762923.176705:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140832896:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762923.176741:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c570e4c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.176776:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762923.176780:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762923.176785:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c570e4c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.176796:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c570e4c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.179976:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c570e4c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.179989:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c570e4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.179996:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c570e4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.180001:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fe000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762923.180005:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c570e4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.180011:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c570e4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.180025:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c570e4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.180042:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c570e4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762923.180098:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140832896:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3404us (48992us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762923.180106:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 675 00000100:00100000:2.0:1789762923.180115:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327649742730 time 327649819306 state 0x2 ref 0 00000100:00100000:3.0:1789762923.182196:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762923.182245:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140833024 00000100:00100000:1.0:1789762923.182262:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140833024 00000100:00100000:1.0:1789762923.182306:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327649742730 time 327649819306 state 0x0 ref 1 00000100:00100000:1.0:1789762923.182321:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327699819306 time 327649819306 state 0x1 ref 1 00000100:00100000:0.0:1789762923.226741:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327699819306 time 327699892217 state 0x0 ref 1 00000100:00100000:0.0:1789762923.226761:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140833024:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762923.226796:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e53 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.226811:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762923.226814:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762923.226819:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.226857:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.229636:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.229645:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.229651:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.229657:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cca00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762923.229660:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.229666:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.229678:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.229683:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762923.229740:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140833024:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2983us (47543us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762923.229750:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 676 00000100:00100000:0.0:1789762923.229761:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327699819306 time 327699892217 state 0x2 ref 0 00000100:00100000:0.0:1789762923.231696:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762923.231744:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140833152 00000100:00100000:1.0:1789762923.231754:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140833152 00000100:00100000:1.0:1789762923.231795:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327699819306 time 327699892217 state 0x0 ref 1 00000100:00100000:1.0:1789762923.231809:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327749892217 time 327699892217 state 0x1 ref 1 00000100:00100000:0.0:1789762923.276815:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327749892217 time 327749967703 state 0x0 ref 1 00000100:00100000:0.0:1789762923.276859:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140833152:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762923.276891:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e5a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.276903:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762923.276907:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762923.276911:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e5a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.276922:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e5a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.279556:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e5a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.279569:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e5a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.279579:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.279588:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cca00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762923.279594:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.279604:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.279639:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e5a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.279648:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092ebcf10/0xd08452c77c570e5a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762923.279704:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140833152:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2873us (48007us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762923.279713:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 677 00000100:00100000:1.0:1789762923.279723:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327749892217 time 327749967703 state 0x2 ref 0 00000100:00100000:0.0:1789762923.281381:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762923.281456:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140833280 00000100:00100000:2.0:1789762923.281463:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140833280 00000100:00100000:2.0:1789762923.281515:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327749892217 time 327749967703 state 0x0 ref 1 00000100:00100000:2.0:1789762923.281526:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327799967703 time 327749967703 state 0x1 ref 1 00000100:00100000:0.0:1789762923.326902:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327799967703 time 327800053449 state 0x0 ref 1 00000100:00100000:0.0:1789762923.326923:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140833280:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762923.326973:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570e61 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.326986:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762923.326990:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762923.326994:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570e61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.327005:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570e61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.329819:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570e61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.329857:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570e61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.329869:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570e61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.329878:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cc600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762923.329883:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570e61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.329894:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570e61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.329927:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570e61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.329936:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0adcb7c/0xd08452c77c570e61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762923.329994:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140833280:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3076us (48611us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762923.330004:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 678 00000100:00100000:0.0:1789762923.330016:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327799967703 time 327800053449 state 0x2 ref 0 00000100:00100000:0.0:1789762923.331878:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762923.331923:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140833408 00000100:00100000:2.0:1789762923.331931:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140833408 00000100:00100000:2.0:1789762923.331969:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327799967703 time 327800053449 state 0x0 ref 1 00000100:00100000:2.0:1789762923.331984:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327850053449 time 327800053449 state 0x1 ref 1 00000100:00100000:1.0:1789762923.377050:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327850053449 time 327850198865 state 0x0 ref 1 00000100:00100000:1.0:1789762923.377072:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140833408:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762923.377108:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e68 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.377122:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762923.377125:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762923.377130:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e68 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.377141:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e68 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.379928:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e68 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.379939:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.379947:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.379953:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762923.379957:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.379964:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.379987:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.379993:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762923.380041:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140833408:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2976us (48163us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762923.380050:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 679 00000100:00100000:1.0:1789762923.380064:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327850053449 time 327850198865 state 0x2 ref 0 00000100:00100000:2.0:1789762923.381818:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762923.381876:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140833536 00000100:00100000:1.0:1789762923.381884:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140833536 00000100:00100000:1.0:1789762923.381921:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327850053449 time 327850198865 state 0x0 ref 1 00000100:00100000:1.0:1789762923.381932:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327900198865 time 327850198865 state 0x1 ref 1 00000100:00100000:1.0:1789762923.427109:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327900198865 time 327900259922 state 0x0 ref 1 00000100:00100000:1.0:1789762923.427127:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140833536:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762923.427162:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e6f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.427175:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762923.427178:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762923.427183:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e6f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.427194:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e6f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.429797:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e6f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.429810:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e6f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.429825:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.429847:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762923.429851:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.429858:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.429871:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.429876:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762923.429922:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140833536:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2799us (48106us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762923.429929:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 680 00000100:00100000:1.0:1789762923.429937:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327900198865 time 327900259922 state 0x2 ref 0 00000100:00100000:3.0:1789762923.431676:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762923.431723:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140833664 00000100:00100000:0.0:1789762923.431731:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140833664 00000100:00100000:0.0:1789762923.431780:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327900198865 time 327900259922 state 0x0 ref 1 00000100:00100000:0.0:1789762923.431796:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327950259922 time 327900259922 state 0x1 ref 1 00000100:00100000:3.0:1789762923.477227:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327950259922 time 327950376502 state 0x0 ref 1 00000100:00100000:3.0:1789762923.477247:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140833664:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762923.477282:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570e76 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.477296:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762923.477299:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762923.477303:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570e76 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.477330:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570e76 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.480093:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570e76 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.480104:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570e76 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.480112:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570e76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.480117:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762923.480121:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570e76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.480127:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570e76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.480140:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570e76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.480145:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d620a534/0xd08452c77c570e76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762923.480211:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140833664:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2968us (48533us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762923.480219:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 681 00000100:00100000:3.0:1789762923.480228:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327950259922 time 327950376502 state 0x2 ref 0 00000100:00100000:3.0:1789762923.482029:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762923.482080:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140833792 00000100:00100000:1.0:1789762923.482088:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140833792 00000100:00100000:1.0:1789762923.482127:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 327950259922 time 327950376502 state 0x0 ref 1 00000100:00100000:1.0:1789762923.482149:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328000376502 time 327950376502 state 0x1 ref 1 00000100:00100000:2.0:1789762923.527332:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328000376502 time 328000483674 state 0x0 ref 1 00000100:00100000:2.0:1789762923.527353:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140833792:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762923.527398:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570e7d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.527411:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762923.527414:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762923.527419:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570e7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.527429:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570e7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.529871:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570e7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.529886:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570e7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.529894:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570e7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.529906:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1488a6200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762923.529910:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570e7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.529916:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570e7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.529930:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570e7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.529935:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570e7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762923.529991:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140833792:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2645us (47963us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762923.529999:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 682 00000100:00100000:0.0:1789762923.530007:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328000376502 time 328000483674 state 0x2 ref 0 00000100:00100000:3.0:1789762923.531612:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762923.531657:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140833920 00000100:00100000:1.0:1789762923.531664:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140833920 00000100:00100000:1.0:1789762923.531699:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328000376502 time 328000483674 state 0x0 ref 1 00000100:00100000:1.0:1789762923.531709:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328050483674 time 328000483674 state 0x1 ref 1 00010000:00010000:3.0:1789762923.558946:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762923.577392:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328050483674 time 328050544453 state 0x0 ref 1 00000100:00100000:2.0:1789762923.577414:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140833920:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762923.577458:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e84 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.577471:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762923.577477:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762923.577483:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e84 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.577505:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e84 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.580277:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e84 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.580294:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.580301:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.580307:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1488a6a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762923.580310:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.580317:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.580330:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.580336:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762923.580387:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140833920:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2981us (48775us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762923.580394:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 683 00000100:00100000:2.0:1789762923.580402:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328050483674 time 328050544453 state 0x2 ref 0 00000100:00100000:2.0:1789762923.582078:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762923.582115:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140834048 00000100:00100000:3.0:1789762923.582124:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140834048 00000100:00100000:3.0:1789762923.582159:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328050483674 time 328050544453 state 0x0 ref 1 00000100:00100000:3.0:1789762923.582170:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328100544453 time 328050544453 state 0x1 ref 1 00000100:00100000:2.0:1789762923.627489:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328100544453 time 328100638174 state 0x0 ref 1 00000100:00100000:2.0:1789762923.627527:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140834048:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762923.627568:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e8b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.627584:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762923.627587:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762923.627591:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.627602:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.630151:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.630167:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.630178:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.630186:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1488a6a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762923.630191:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.630201:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.630219:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.630241:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eed2f47/0xd08452c77c570e8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762923.630312:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140834048:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2793us (48233us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762923.630323:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 684 00000100:00100000:1.0:1789762923.630335:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328100544453 time 328100638174 state 0x2 ref 0 00000100:00100000:0.0:1789762923.632028:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762923.632073:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140834176 00000100:00100000:2.0:1789762923.632081:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140834176 00000100:00100000:2.0:1789762923.632116:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328100544453 time 328100638174 state 0x0 ref 1 00000100:00100000:2.0:1789762923.632126:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328150638174 time 328100638174 state 0x1 ref 1 00000100:00100000:0.0:1789762923.677585:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328150638174 time 328150736932 state 0x0 ref 1 00000100:00100000:0.0:1789762923.677604:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140834176:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762923.677634:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570e92 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.677657:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762923.677660:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762923.677665:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570e92 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.677676:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570e92 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.680215:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570e92 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.680224:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570e92 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.680230:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570e92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.680236:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1601d0600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762923.680239:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570e92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.680245:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570e92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.680261:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570e92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.680275:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbb9f163/0xd08452c77c570e92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762923.680320:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140834176:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2722us (48294us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762923.680327:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 685 00000100:00100000:0.0:1789762923.680334:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328150638174 time 328150736932 state 0x2 ref 0 00000100:00100000:0.0:1789762923.681957:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762923.682010:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140834304 00000100:00100000:2.0:1789762923.682020:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140834304 00000100:00100000:2.0:1789762923.682061:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328150638174 time 328150736932 state 0x0 ref 1 00000100:00100000:2.0:1789762923.682075:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328200736932 time 328150736932 state 0x1 ref 1 00000001:00080000:2.0:1789762923.697381:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967398 is committed 00000100:00100000:1.0:1789762923.727665:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328200736932 time 328200818257 state 0x0 ref 1 00000100:00100000:1.0:1789762923.727682:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140834304:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762923.727714:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e99 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.727726:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762923.727730:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762923.727734:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.727744:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.730263:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.730288:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.730295:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.730300:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762923.730303:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.730309:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.730322:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.730327:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570e99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762923.730374:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140834304:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2695us (48416us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762923.730382:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 686 00000100:00100000:1.0:1789762923.730389:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328200736932 time 328200818257 state 0x2 ref 0 00000100:00100000:2.0:1789762923.732087:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762923.732122:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140834432 00000100:00100000:1.0:1789762923.732135:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140834432 00000100:00100000:1.0:1789762923.732167:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328200736932 time 328200818257 state 0x0 ref 1 00000100:00100000:1.0:1789762923.732177:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328250818257 time 328200818257 state 0x1 ref 1 00000100:00100000:1.0:1789762923.777717:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328250818257 time 328250870727 state 0x0 ref 1 00000100:00100000:1.0:1789762923.777735:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140834432:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762923.777765:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ea0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.777777:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762923.777780:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762923.777784:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ea0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.777793:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ea0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.780151:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ea0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.780162:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ea0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.780169:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.780183:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1821f9200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762923.780187:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.780194:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ea0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.780208:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ea0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762923.780214:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e6d74e/0xd08452c77c570ea0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762923.780259:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140834432:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2529us (48172us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762923.780267:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 687 00000100:00100000:1.0:1789762923.780274:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328250818257 time 328250870727 state 0x2 ref 0 00000100:00100000:2.0:1789762923.781960:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762923.782012:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140834560 00000100:00100000:0.0:1789762923.782019:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140834560 00000100:00100000:0.0:1789762923.782053:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328250818257 time 328250870727 state 0x0 ref 1 00000100:00100000:0.0:1789762923.782063:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328300870727 time 328250870727 state 0x1 ref 1 00000100:00100000:3.0:1789762923.827785:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328300870727 time 328300936276 state 0x0 ref 1 00000100:00100000:3.0:1789762923.827805:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140834560:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762923.827855:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570ea7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.827869:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762923.827873:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762923.827880:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570ea7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.827916:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570ea7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.830629:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570ea7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.830640:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570ea7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.830647:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570ea7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.830651:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1488a6200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762923.830655:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570ea7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.830660:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570ea7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.830672:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570ea7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762923.830677:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9239207/0xd08452c77c570ea7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762923.830737:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140834560:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2937us (48776us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762923.830744:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 688 00000100:00100000:3.0:1789762923.830751:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328300870727 time 328300936276 state 0x2 ref 0 00000100:00100000:2.0:1789762923.832583:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762923.832634:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140834688 00000100:00100000:1.0:1789762923.832642:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140834688 00000100:00100000:1.0:1789762923.832677:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328300870727 time 328300936276 state 0x0 ref 1 00000100:00100000:1.0:1789762923.832687:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328350936276 time 328300936276 state 0x1 ref 1 00000100:00100000:2.0:1789762923.877898:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328350936276 time 328351049343 state 0x0 ref 1 00000100:00100000:2.0:1789762923.877918:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140834688:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762923.877952:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.877966:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762923.877970:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762923.877974:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.877984:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.880460:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.880471:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.880479:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.880513:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762923.880518:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.880526:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.880541:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.880547:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762923.880597:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140834688:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2686us (48015us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762923.880604:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 689 00000100:00100000:2.0:1789762923.880611:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328350936276 time 328351049343 state 0x2 ref 0 00000100:00100000:2.0:1789762923.882257:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762923.882299:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140834816 00000100:00100000:1.0:1789762923.882311:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140834816 00000100:00100000:1.0:1789762923.882345:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328350936276 time 328351049343 state 0x0 ref 1 00000100:00100000:1.0:1789762923.882355:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328401049343 time 328351049343 state 0x1 ref 1 00000100:00100000:2.0:1789762923.928019:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328401049343 time 328401167723 state 0x0 ref 1 00000100:00100000:2.0:1789762923.928044:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140834816:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762923.928078:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eb5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.928102:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762923.928105:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762923.928110:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eb5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.928120:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eb5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.930461:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eb5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.930473:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eb5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.930479:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.930484:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762923.930508:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.930516:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.930528:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762923.930533:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e184ba/0xd08452c77c570eb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762923.930582:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140834816:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2546us (48325us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762923.930589:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 690 00000100:00100000:0.0:1789762923.930597:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328401049343 time 328401167723 state 0x2 ref 0 00000100:00100000:0.0:1789762923.932570:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762923.932616:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140834944 00000100:00100000:3.0:1789762923.932625:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140834944 00000100:00100000:3.0:1789762923.932668:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328401049343 time 328401167723 state 0x0 ref 1 00000100:00100000:3.0:1789762923.932683:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328451167723 time 328401167723 state 0x1 ref 1 00000100:00100000:2.0:1789762923.978104:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328451167723 time 328451255082 state 0x0 ref 1 00000100:00100000:2.0:1789762923.978125:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140834944:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762923.978157:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c570ebc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.978170:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762923.978174:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762923.978178:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c570ebc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.978188:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c570ebc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.981193:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c570ebc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.981218:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c570ebc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.981225:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c570ebc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.981231:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762923.981235:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c570ebc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.981242:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c570ebc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.981255:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c570ebc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762923.981260:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000564f95be/0xd08452c77c570ebc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762923.981305:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140834944:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3188us (48736us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762923.981313:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 691 00000100:00100000:2.0:1789762923.981321:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328451167723 time 328451255082 state 0x2 ref 0 00000100:00100000:1.0:1789762923.983111:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762923.983148:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140835072 00000100:00100000:2.0:1789762923.983162:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140835072 00000100:00100000:2.0:1789762923.983197:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328451167723 time 328451255082 state 0x0 ref 1 00000100:00100000:2.0:1789762923.983207:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328501255082 time 328451255082 state 0x1 ref 1 00000100:00100000:0.0:1789762924.028179:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328501255082 time 328501329654 state 0x0 ref 1 00000100:00100000:0.0:1789762924.028201:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140835072:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762924.028235:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570ec3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.028249:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762924.028252:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762924.028269:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570ec3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.028281:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570ec3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.030775:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570ec3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.030788:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570ec3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.030798:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570ec3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.030806:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762924.030809:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570ec3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.030816:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570ec3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.030830:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570ec3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.030853:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c570ec3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762924.030922:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140835072:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2726us (47810us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762924.030932:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 692 00000100:00100000:0.0:1789762924.030941:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328501255082 time 328501329654 state 0x2 ref 0 00000100:00100000:0.0:1789762924.032992:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762924.033043:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140835200 00000100:00100000:2.0:1789762924.033051:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140835200 00000100:00100000:2.0:1789762924.033088:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328501255082 time 328501329654 state 0x0 ref 1 00000100:00100000:2.0:1789762924.033099:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328551329654 time 328501329654 state 0x1 ref 1 00000100:00100000:1.0:1789762924.078300:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328551329654 time 328551450965 state 0x0 ref 1 00000100:00100000:1.0:1789762924.078320:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140835200:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762924.078354:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570eca lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.078368:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762924.078371:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762924.078376:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570eca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.078387:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570eca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.080811:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570eca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.080825:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570eca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.080873:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570eca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.080883:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762924.080888:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570eca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.080898:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570eca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.080915:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570eca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.080924:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570eca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762924.080978:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140835200:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2663us (47985us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762924.080988:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 693 00000100:00100000:1.0:1789762924.080999:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328551329654 time 328551450965 state 0x2 ref 0 00000100:00100000:2.0:1789762924.082683:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762924.082720:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140835328 00000100:00100000:1.0:1789762924.082727:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140835328 00000100:00100000:1.0:1789762924.082761:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328551329654 time 328551450965 state 0x0 ref 1 00000100:00100000:1.0:1789762924.082779:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328601450965 time 328551450965 state 0x1 ref 1 00000100:00100000:1.0:1789762924.128401:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328601450965 time 328601550694 state 0x0 ref 1 00000100:00100000:1.0:1789762924.128422:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140835328:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:1.0:1789762924.128458:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570ed1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.128472:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762924.128476:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762924.128480:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570ed1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.128506:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570ed1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.131034:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570ed1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.131045:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570ed1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.131053:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570ed1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.131068:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762924.131072:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570ed1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.131078:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570ed1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.131091:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570ed1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.131096:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c570ed1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762924.131143:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140835328:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2727us (48461us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762924.131150:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 694 00000100:00100000:1.0:1789762924.131158:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328601450965 time 328601550694 state 0x2 ref 0 00000100:00100000:3.0:1789762924.133064:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762924.133110:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140835456 00000100:00100000:0.0:1789762924.133119:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140835456 00000100:00100000:0.0:1789762924.133159:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328601450965 time 328601550694 state 0x0 ref 1 00000100:00100000:0.0:1789762924.133169:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328651550694 time 328601550694 state 0x1 ref 1 00000100:00100000:3.0:1789762924.178468:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328651550694 time 328651620230 state 0x0 ref 1 00000100:00100000:3.0:1789762924.178495:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140835456:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762924.178528:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c570ed8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.178541:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762924.178544:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762924.178548:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c570ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.178558:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c570ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.181072:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c570ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.181087:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c570ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.181097:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c570ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.181106:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762924.181111:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c570ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.181122:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c570ed8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.181138:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c570ed8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.181148:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c570ed8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762924.181204:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140835456:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2721us (48139us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762924.181213:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 695 00000100:00100000:3.0:1789762924.181230:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328651550694 time 328651620230 state 0x2 ref 0 00000100:00100000:3.0:1789762924.183637:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762924.183694:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140835584 00000100:00100000:1.0:1789762924.183705:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140835584 00000100:00100000:1.0:1789762924.183753:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328651550694 time 328651620230 state 0x0 ref 1 00000100:00100000:1.0:1789762924.183766:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328701620230 time 328651620230 state 0x1 ref 1 00000100:00100000:2.0:1789762924.228575:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328701620230 time 328701724814 state 0x0 ref 1 00000100:00100000:2.0:1789762924.228596:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140835584:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762924.228633:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2b39d1e/0xd08452c77c570edf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762924.228646:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762924.228650:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762924.228654:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b39d1e/0xd08452c77c570edf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762924.228665:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2b39d1e/0xd08452c77c570edf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.231554:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2b39d1e/0xd08452c77c570edf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.231564:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b39d1e/0xd08452c77c570edf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.231571:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2b39d1e/0xd08452c77c570edf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.231576:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762924.231579:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b39d1e/0xd08452c77c570edf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.231596:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b39d1e/0xd08452c77c570edf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.231609:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2b39d1e/0xd08452c77c570edf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.231614:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2b39d1e/0xd08452c77c570edf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762924.231667:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140835584:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3078us (48041us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762924.231675:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 696 00000100:00100000:0.0:1789762924.231683:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328701620230 time 328701724814 state 0x2 ref 0 00000100:00100000:3.0:1789762924.253984:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762924.254046:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140835712 00000100:00100000:2.0:1789762924.254055:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140835712 00000100:00100000:2.0:1789762924.254108:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:2.0:1789762924.254116:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77777931-b235-4c03-82d2-4b1d12553008+6:5571:x1876702140835712:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762924.254128:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762924.254160:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000421477df/0xd08452c77c570c15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaa5 expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762924.254180:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762924.254218:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77777931-b235-4c03-82d2-4b1d12553008+5:5571:x1876702140835712:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 104us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762924.254224:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:2.0:1789762924.261647:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762924.261689:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140835840 00000100:00100000:3.0:1789762924.261695:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140835840 00000100:00100000:3.0:1789762924.261737:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 264 00000100:00100000:3.0:1789762924.261744:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+9:11955:x1876702140835840:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1789762924.261758:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762924.261771:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c570ee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eaac expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789762924.261788:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789762924.261852:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c570eed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.261865:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c570eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.261874:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c570eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762924.261902:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 16384 00000004:00200000:3.0:1789762924.261905:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762924.261918:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c570eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.261941:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c570ee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaac expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.261968:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c570eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaac expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.261987:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff95d151e90c00) 00010000:00010000:3.0:1789762924.261989:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762924.261991:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a895000, rc 0) 00000100:00100000:3.0:1789762924.262022:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+10:11955:x1876702140835840:12345-192.168.203.31@tcp:101:bash.0 Request processed in 279us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762924.262027:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 264 00000100:00100000:0.0:1789762924.265984:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762924.266040:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140836096 00000100:00100000:1.0:1789762924.266047:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140836096 00000100:00100000:1.0:1789762924.266081:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 265 00000100:00100000:1.0:1789762924.266087:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+10:13484:x1876702140836096:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:1.0:1789762924.266096:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762924.266104:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c570ef4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eab3 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762924.266156:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 16384 00010000:00010000:1.0:1789762924.266263:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c570ef4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eab3 expref: 12 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.266272:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d900) 00010000:00010000:1.0:1789762924.266274:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789762924.266277:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c570ef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eab3 expref: 12 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762924.266285:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030c00, rc 0) 00000100:00100000:1.0:1789762924.266312:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+11:13484:x1876702140836096:12345-192.168.203.31@tcp:101:rm.0 Request processed in 226us (330us total) trans 4294967522 rc 301/301 00000100:00100000:1.0:1789762924.266317:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 265 00000100:00100000:1.0:1789762924.267712:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762924.267758:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140836224 00000100:00100000:2.0:1789762924.267764:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140836224 00000100:00100000:2.0:1789762924.267799:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:2.0:1789762924.267808:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15177c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+11:13484:x1876702140836224:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:0.0:1789762924.269612:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15177c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+11:13484:x1876702140836224:12345-192.168.203.31@tcp:37:rm.0 Request processed in 1804us (1899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762924.269619:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:0.0:1789762924.270744:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762924.270785:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140836480 00000100:00100000:3.0:1789762924.270792:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140836480 00000100:00100000:3.0:1789762924.270826:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:3.0:1789762924.270855:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+11:13484:x1876702140836480:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:3.0:1789762924.270972:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+12:13484:x1876702140836480:12345-192.168.203.31@tcp:35:rm.0 Request processed in 137us (226us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789762924.270982:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:1.0:1789762924.271733:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762924.271768:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140836736 00000100:00100000:3.0:1789762924.271774:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140836736 00000100:00100000:3.0:1789762924.271801:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 266 00000100:00100000:3.0:1789762924.271807:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+12:13484:x1876702140836736:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1789762924.271817:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762924.271825:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c570f02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eaba expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.271881:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c570f09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.271889:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c570f09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x29:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.271902:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c570f09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x29:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762924.271909:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 16384 00010000:00010000:3.0:1789762924.271954:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c570f02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaba expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.271964:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c570f09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x29:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaba expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.271969:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff95d151e90c00) 00010000:00010000:3.0:1789762924.271971:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789762924.271973:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a894400, rc 0) 00000100:00100000:3.0:1789762924.272000:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+14:13484:x1876702140836736:12345-192.168.203.31@tcp:101:rm.0 Request processed in 193us (269us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789762924.272004:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 266 00000100:00100000:2.0:1789762924.272911:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762924.272952:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140836864 00000100:00100000:0.0:1789762924.272958:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140836864 00000100:00100000:0.0:1789762924.272991:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 267 00000100:00100000:0.0:1789762924.273000:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+14:13484:x1876702140836864:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:0.0:1789762924.273031:0:13232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7597981696 avail 7586447360 00000100:00100000:0.0:1789762924.273080:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+14:13484:x1876702140836864:12345-192.168.203.31@tcp:41:rm.0 Request processed in 82us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762924.273088:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 267 00000100:00100000:0.0:1789762924.273925:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762924.274000:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140837120 00000100:00100000:2.0:1789762924.274005:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140837120 00000100:00100000:2.0:1789762924.274033:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:2.0:1789762924.274039:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+14:13484:x1876702140837120:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:2.0:1789762924.274196:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+15:13484:x1876702140837120:12345-192.168.203.31@tcp:35:rm.0 Request processed in 156us (271us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789762924.274211:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:1.0:1789762924.275041:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762924.275074:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140837376 00000100:00100000:3.0:1789762924.275079:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140837376 00000100:00100000:3.0:1789762924.275106:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 268 00000100:00100000:3.0:1789762924.275113:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+15:13484:x1876702140837376:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:3.0:1789762924.275135:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789762924.275147:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174638600/0xd08452c77c570c07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea9e expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.275160:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f000/0xd08452c77c570928 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea97 expref: 14 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.275177:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff95d15055de00) 00010000:00010000:3.0:1789762924.275187:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c570eed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaac expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.275192:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff95d151e90c00) 00010000:00010000:3.0:1789762924.275194:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762924.275203:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c570f17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.275210:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c570f17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.275215:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c570f17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.275223:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c570f1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.275227:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c570f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.275232:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c570f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.275459:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570f25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.275465:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570f25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.275477:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570f25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789762924.276248:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].17, 64 off9280 00000004:00080000:3.0:1789762924.276257:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328749422623ns, next at 329749420721ns, rc = 0 00010000:00010000:3.0:1789762924.276289:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894800/0xd08452c77c570f2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276296:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894800/0xd08452c77c570f2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276302:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894800/0xd08452c77c570f2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276307:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894800/0xd08452c77c570f2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276312:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894800/0xd08452c77c570f2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276316:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894800/0xd08452c77c570f2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276330:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762924.276339:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570f25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276343:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570f25 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276347:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570f25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276356:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762924.276359:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570f25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276364:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570f25 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276370:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff95d15055d800) 00010000:00010000:3.0:1789762924.276372:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789762924.276374:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570f25 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276379:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570f25 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276389:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c570f17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276393:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c570f17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762924.276394:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762924.276402:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c570f17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762924.276403:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894800/0xd08452c77c570f2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276412:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762924.276417:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c570f17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762924.276418:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762924.276425:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894800/0xd08452c77c570f2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276426:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c570f17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762924.276443:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894800/0xd08452c77c570f2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276465:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff95d151e90c00) 00010000:00010000:2.0:1789762924.276468:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff95d15055d800) 00010000:00010000:3.0:1789762924.276468:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762924.276473:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789762924.276474:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c570f17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762924.276478:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894800/0xd08452c77c570f2c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.276481:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895400/0xd08452c77c570f17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762924.276499:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894800/0xd08452c77c570f2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762924.276507:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085729dbc reply state 00000000ff5d270d transno 4294967526 ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c570f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762924.276514:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762924.276514:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789762924.276517:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762924.276519:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762924.276548:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+14:13484:x1876702140837376:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1436us (1510us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789762924.276554:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 268 00010000:00010000:3.0:1789762924.277033:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c570f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.277039:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c570f1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.277043:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c570f1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.277046:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762924.277048:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c570f1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.277053:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c570f1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.277068:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x4009f790 (ffff95d15055db00) 00010000:00010000:3.0:1789762924.277070:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762924.277072:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c570f1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.277076:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c570f1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762924.277562:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762924.277624:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140837632 00000100:00100000:3.0:1789762924.277628:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140837632 00000100:00100000:3.0:1789762924.277650:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:3.0:1789762924.277655:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+13:13484:x1876702140837632:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:3.0:1789762924.277730:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+14:13484:x1876702140837632:12345-192.168.203.31@tcp:35:rm.0 Request processed in 74us (169us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1789762924.277735:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:2.0:1789762924.278414:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762924.278459:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140837888 00000100:00100000:0.0:1789762924.278465:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140837888 00000100:00100000:0.0:1789762924.278503:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 269 00000100:00100000:0.0:1789762924.278510:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+14:13484:x1876702140837888:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:0.0:1789762924.278531:0:6681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789762924.278541:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894400/0xd08452c77c570f09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x29:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaba expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.278554:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d174639800/0xd08452c77c57090c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea90 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.278561:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff95d151e90c00) 00010000:00010000:0.0:1789762924.278569:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d16003f400/0xd08452c77c5708aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ea7b expref: 12 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.278576:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d900) 00010000:00010000:0.0:1789762924.278580:0:6681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762924.278590:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99600/0xd08452c77c570f33 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.278596:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99600/0xd08452c77c570f33 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.278601:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99600/0xd08452c77c570f33 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.278615:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570f3a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.278620:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570f3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.278625:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570f3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.278804:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.278810:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.278815:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762924.279147:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 16384 00010000:00010000:0.0:1789762924.279155:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.279160:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f41 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.279164:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.279168:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762924.279170:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.279182:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f41 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.279189:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff95d151e90700) 00010000:00010000:0.0:1789762924.279190:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789762924.279192:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f41 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.279196:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f41 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.279207:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99600/0xd08452c77c570f33 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.279211:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99600/0xd08452c77c570f33 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.279216:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99600/0xd08452c77c570f33 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.279219:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762924.279221:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99600/0xd08452c77c570f33 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.279224:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99600/0xd08452c77c570f33 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.279228:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90e00) 00010000:00010000:0.0:1789762924.279230:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762924.279231:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99600/0xd08452c77c570f33 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762924.279241:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99600/0xd08452c77c570f33 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762924.279249:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b97b36a0 reply state 0000000026eb51da transno 4294967528 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570f3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762924.279253:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762924.279294:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+13:13484:x1876702140837888:12345-192.168.203.31@tcp:36:rm.0 Request processed in 784us (881us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1789762924.279299:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 269 00010000:00010000:3.0:1789762924.279829:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570f3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.279852:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570f3a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.279858:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570f3a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.279863:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762924.279865:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570f3a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.279869:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570f3a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.279883:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d151e90800) 00010000:00010000:3.0:1789762924.279885:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762924.279888:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570f3a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762924.279892:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570f3a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762924.583924:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789762924.719742:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967910 is committed 00000004:00080000:2.0:1789762925.095285:0:14792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329568449322ns, next at 329749420721ns, rc = 0 00000001:00080000:3.0:1789762925.103759:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000004:00080000:3.0:1789762925.103776:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 22 committed 00000004:00080000:3.0:1789762925.103796:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 21 committed 00000100:00100000:2.0:1789762925.103903:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789762925.103922:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149041408:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789762925.103975:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762925.104003:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149041408 00000100:00100000:3.0:1789762925.104012:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149041408 00000100:00080000:1.0:1789762925.104048:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762925.104076:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789762925.104087:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149041408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789762925.104114:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:17 count 1 00002000:00010000:3.0:1789762925.104141:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 104857600, mtime: 0x6aad9d66, atime: 0x0, ctime: 0x6aad9d66, blocks: 0x3200b 00010000:00010000:3.0:1789762925.104150:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570f48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762925.104167:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1789762925.104171:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762925.104178:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570f48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762925.104195:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570f48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762925.104218:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570f48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762925.104224:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570f48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762925.104239:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762925.104256:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762925.104263:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570f48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762925.104273:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762925.104277:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570f48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762925.104285:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570f48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762925.104300:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570f48 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762925.104305:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b956c0ba/0xd08452c77c570f48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762925.104318:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762925.104320:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762925.104321:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762925.104628:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149041408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 543us (651us total) trans 4294967911 rc 0/0 00000100:00100000:3.0:1789762925.104634:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789762925.104657:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967910 gen 2 00000004:00080000:2.0:1789762925.104662:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d044e53800, transno 4294967910 00000100:00100000:2.0:1789762925.104676:0:3278:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d174167b80 x1876702149041408/t4294967911(4294967911) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789762941 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789762925.104684:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d174167b80/2, rc 0, transno 4294967911 00000100:00100000:2.0:1789762925.104692:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149041408:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789762925.104812:0:14792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329577977758ns, next at 321480199524ns, rc = 0 00000004:00080000:1.0:1789762925.110670:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00010000:00010000:3.0:1789762925.607094:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762926.247044:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149041536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762926.247064:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149041664:0@lo:400:kworker.0 00000100:00100000:2.0:1789762926.247083:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149041792:0@lo:400:kworker.0 00000100:00100000:0.0:1789762926.247129:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149041920:0@lo:400:kworker.0 00000100:00100000:3.0:1789762926.247171:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762926.247189:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762926.247189:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762926.247248:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149041664 00000100:00100000:0.0:1789762926.247258:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149041664 00000100:00100000:3.0:1789762926.247280:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149042048:0@lo:400:kworker.0 00000100:00100000:2.0:1789762926.247282:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149042304:0@lo:400:kworker.0 00000100:00100000:1.0:1789762926.247293:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702149042176:0@lo:400:kworker.0 00000100:00100000:0.0:1789762926.247322:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1789762926.247336:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149041664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762926.247357:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762926.247373:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762926.247376:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149041536 00000100:00100000:3.0:1789762926.247384:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149041536 00000100:00100000:0.0:1789762926.247427:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149041664:12345-0@lo:400:kworker.0 Request processed in 92us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762926.247438:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789762926.247449:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149042304 00000100:00100000:1.0:1789762926.247455:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149041664:0@lo:400:kworker.0 00000100:00100000:3.0:1789762926.247467:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789762926.247470:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149042304 00000100:00100000:3.0:1789762926.247495:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149041536:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762926.247503:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149041792 00000100:00100000:0.0:1789762926.247511:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149041792 00002000:00000024:3.0:1789762926.247546:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762926.247581:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149042176 00000100:00100000:0.0:1789762926.247593:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149042176 00000100:00100000:2.0:1789762926.247594:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789762926.247595:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762926.247606:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149041536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762926.247614:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789762926.247632:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149042304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762926.247653:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149041920 00000100:00080000:3.0:1789762926.247653:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762926.247660:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149041920 00000100:00080000:3.0:1789762926.247673:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762926.247685:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762926.247706:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789762926.247716:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149041792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762926.247743:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789762926.247750:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149042304:12345-0@lo:400:kworker.0 Request processed in 130us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762926.247762:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789762926.247764:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702149042176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762926.247772:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789762926.247781:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149041920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762926.247789:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149041792:12345-0@lo:400:kworker.0 Request processed in 71us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762926.247809:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789762926.247820:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967398 gen 2 00000004:00080000:2.0:1789762926.247826:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d043212a00, transno 4294967398 00000100:00100000:2.0:1789762926.247930:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149042304:0@lo:400:kworker.0 00000100:00100000:0.0:1789762926.247951:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149041920:12345-0@lo:400:kworker.0 Request processed in 170us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762926.247959:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149041792:0@lo:400:kworker.0 00000100:00100000:0.0:1789762926.247963:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789762926.247973:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702149042176:12345-0@lo:400:kworker.0 Request processed in 206us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762926.247990:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789762926.248006:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149041920:0@lo:400:kworker.0 00000100:00100000:0.0:1789762926.248045:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762926.248063:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702149042176:0@lo:400:kworker.0 00000100:00100000:1.0:1789762926.248092:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149042048 00000100:00100000:1.0:1789762926.248102:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149042048 00000100:00100000:0.0:1789762926.248112:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149041536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762926.248159:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789762926.248171:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149042048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762926.248231:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149042048:12345-0@lo:400:kworker.0 Request processed in 62us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762926.248242:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789762926.248273:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149042048:0@lo:400:kworker.0 00000100:00100000:0.0:1789762926.452487:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762926.452542:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762926.452562:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140838144 00000100:00100000:1.0:1789762926.452575:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140838144 00000100:00100000:3.0:1789762926.452580:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140838016 00000100:00100000:0.0:1789762926.452582:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762926.452587:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140838016 00000100:00100000:0.0:1789762926.452636:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762926.452658:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 301 00000100:00100000:1.0:1789762926.452659:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 240 00000100:00100000:2.0:1789762926.452661:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140838400 00000100:00100000:2.0:1789762926.452669:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140838400 00000100:00100000:1.0:1789762926.452674:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140838144:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762926.452675:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140838016:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762926.452686:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762926.452710:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140838272 00000100:00100000:2.0:1789762926.452714:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140838272 00000100:00100000:0.0:1789762926.452727:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:0.0:1789762926.452741:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140838400:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762926.452748:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:3.0:1789762926.452765:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140838016:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 94us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762926.452767:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140838144:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 96us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762926.452783:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 301 00000100:00100000:2.0:1789762926.452784:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140838272:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762926.452794:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 240 00000100:00100000:0.0:1789762926.452802:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140838400:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 51us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762926.452813:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:1.0:1789762926.452816:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140838528 00000100:00100000:1.0:1789762926.452822:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140838528 00000100:00100000:2.0:1789762926.452829:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140838272:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 49us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762926.452873:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00080000:3.0:1789762926.452874:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762926.452881:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762926.452885:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762926.452886:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:1.0:1789762926.452895:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140838528:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762926.452931:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140838528:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 37us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762926.452937:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 241 00010000:00010000:3.0:1789762926.630991:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762926.759008:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149042432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762926.759095:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762926.759147:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149042432 00000100:00100000:3.0:1789762926.759157:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149042432 00000100:00100000:3.0:1789762926.759229:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789762926.759239:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149042432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762926.759282:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526712832 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789762926.759336:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149042432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762926.759344:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789762926.759391:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149042432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762927.654999:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762928.678952:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762929.703031:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789762929.848622:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967911 is committed 00010000:00010000:3.0:1789762930.726910:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762931.367031:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149042560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762931.367031:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16019bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149042816:0@lo:400:kworker.0 00000100:00100000:3.0:1789762931.367039:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16019ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149042688:0@lo:400:kworker.0 00000100:00100000:1.0:1789762931.367059:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d160199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149042944:0@lo:400:kworker.0 00000100:00100000:3.0:1789762931.367123:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762931.367130:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762931.367135:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762931.367147:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149042688 00000100:00100000:1.0:1789762931.367154:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149042688 00000100:00100000:3.0:1789762931.367184:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d160198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702149043200:0@lo:400:kworker.0 00000100:00100000:2.0:1789762931.367185:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d160198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149043328:0@lo:400:kworker.0 00000100:00100000:0.0:1789762931.367196:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16019a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149043072:0@lo:400:kworker.0 00000100:00100000:1.0:1789762931.367199:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789762931.367213:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149042688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762931.367226:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762931.367232:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762931.367254:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762931.367277:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149042688:12345-0@lo:400:kworker.0 Request processed in 65us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762931.367279:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16019ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149042688:0@lo:400:kworker.0 00000100:00100000:1.0:1789762931.367291:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789762931.367292:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149042816 00000100:00100000:2.0:1789762931.367298:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149042816 00000100:00100000:0.0:1789762931.367313:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149042560 00000100:00100000:0.0:1789762931.367319:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149042560 00000100:00100000:3.0:1789762931.367332:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149043328 00000100:00100000:2.0:1789762931.367335:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149043200 00000100:00100000:1.0:1789762931.367337:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762931.367339:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149043328 00000100:00100000:2.0:1789762931.367340:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149043200 00000100:00100000:0.0:1789762931.367384:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789762931.367386:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149042944 00000100:00100000:3.0:1789762931.367389:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149043072 00000100:00100000:1.0:1789762931.367392:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789762931.367394:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149042944 00000100:00100000:3.0:1789762931.367394:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149043072 00000100:00100000:0.0:1789762931.367400:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149042560:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762931.367403:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149042816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762931.367430:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789762931.367453:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789762931.367456:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149043328:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789762931.367462:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762931.367463:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149042816:12345-0@lo:400:kworker.0 Request processed in 63us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762931.367467:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702149043200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762931.367480:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789762931.367500:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149043328:12345-0@lo:400:kworker.0 Request processed in 50us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762931.367504:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789762931.367513:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789762931.367519:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149042944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762931.367537:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789762931.367538:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702149043200:12345-0@lo:400:kworker.0 Request processed in 71us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762931.367539:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149042560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762931.367551:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149043072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762931.367556:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789762931.367560:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149042944:12345-0@lo:400:kworker.0 Request processed in 43us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762931.367562:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789762931.367576:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789762931.367595:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149043072:12345-0@lo:400:kworker.0 Request processed in 48us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762931.367601:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1789762931.367619:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762931.367626:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762931.367628:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d160199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149042944:0@lo:400:kworker.0 00000100:00080000:0.0:1789762931.367632:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762931.367639:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d160198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702149043200:0@lo:400:kworker.0 00000100:00100000:0.0:1789762931.367667:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967911 gen 2 00000100:00100000:1.0:1789762931.367668:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d160198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149043328:0@lo:400:kworker.0 00000004:00080000:0.0:1789762931.367675:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d174167b80, transno 4294967911 00000100:00100000:1.0:1789762931.367680:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16019bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149042816:0@lo:400:kworker.0 00000100:00100000:0.0:1789762931.367701:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16019a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149043072:0@lo:400:kworker.0 00000100:00100000:0.0:1789762931.367726:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149042560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762931.572727:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762931.572761:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762931.572789:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762931.572796:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140838656 00000100:00100000:3.0:1789762931.572808:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140838784 00000100:00100000:0.0:1789762931.572809:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140838656 00000100:00100000:3.0:1789762931.572814:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140838784 00000100:00100000:2.0:1789762931.572820:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762931.572880:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762931.572889:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140839040 00000100:00100000:1.0:1789762931.572896:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140839040 00000100:00080000:2.0:1789762931.572917:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762931.572917:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140839168 00000100:00100000:0.0:1789762931.572922:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 303 00000100:00080000:2.0:1789762931.572926:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762931.572926:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140839168 00000100:00100000:0.0:1789762931.572936:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140838656:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762931.572940:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140838912 00000100:00100000:1.0:1789762931.572946:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140838912 00000100:00100000:3.0:1789762931.572989:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00100000:2.0:1789762931.572994:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:1.0:1789762931.573006:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:2.0:1789762931.573013:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140839040:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762931.573016:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140838656:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 81us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762931.573021:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140838784:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762931.573026:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140838912:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762931.573036:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 303 00000100:00100000:2.0:1789762931.573074:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140839040:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 67us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762931.573077:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140838912:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 57us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762931.573087:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140838784:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 81us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762931.573090:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:1.0:1789762931.573105:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:3.0:1789762931.573107:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00080000:2.0:1789762931.573121:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762931.573153:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 246 00000100:00100000:3.0:1789762931.573165:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140839168:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762931.573192:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140839168:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 31us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762931.573218:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 246 00010000:00010000:2.0:1789762931.751002:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762931.879068:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789762931.879092:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149043456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762931.879181:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762931.879252:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149043456 00000100:00100000:3.0:1789762931.879262:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149043456 00000100:00100000:3.0:1789762931.879323:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789762931.879335:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149043456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762931.879388:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526712832 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762931.879441:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149043456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762931.879467:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789762931.879526:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149043456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789762932.775001:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762933.799090:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762934.823016:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762935.847116:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762936.487052:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789762936.487085:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149043584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762936.487135:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789762936.487161:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16019bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149043712:0@lo:400:kworker.0 00000100:00100000:2.0:1789762936.487205:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d160198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149043840:0@lo:400:kworker.0 00000100:00100000:3.0:1789762936.487211:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762936.487243:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762936.487288:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762936.487308:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d160199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149043968:0@lo:400:kworker.0 00000100:00100000:3.0:1789762936.487325:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d160198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702149044224:0@lo:400:kworker.0 00000100:00100000:0.0:1789762936.487331:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16019a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149044096:0@lo:400:kworker.0 00000100:00100000:2.0:1789762936.487335:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d16019ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149044352:0@lo:400:kworker.0 00000100:00100000:0.0:1789762936.487432:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762936.487457:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762936.487466:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149043584 00000100:00100000:2.0:1789762936.487476:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149043584 00000100:00100000:0.0:1789762936.487507:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762936.487545:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149043840 00000100:00100000:1.0:1789762936.487557:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149043840 00000100:00100000:2.0:1789762936.487578:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789762936.487590:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149044096 00000100:00100000:2.0:1789762936.487592:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149043584:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762936.487596:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149044096 00000100:00100000:0.0:1789762936.487619:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149043712 00000100:00100000:0.0:1789762936.487632:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149043712 00002000:00000024:2.0:1789762936.487641:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762936.487678:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149044352 00000100:00100000:3.0:1789762936.487684:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149044352 00000100:00100000:0.0:1789762936.487691:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789762936.487691:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149044224 00000100:00100000:1.0:1789762936.487712:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149044224 00000100:00100000:2.0:1789762936.487713:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149043584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762936.487721:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149043712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762936.487727:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789762936.487740:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789762936.487744:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149044096:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789762936.487773:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789762936.487781:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789762936.487786:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762936.487792:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3276:x1876702149043712:12345-0@lo:400:kworker.0 Request processed in 81us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762936.487803:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789762936.487819:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149044096:12345-0@lo:400:kworker.0 Request processed in 75us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762936.487858:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789762936.487868:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789762936.487878:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149044352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762936.487891:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789762936.487905:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789762936.487928:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16019a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149044096:0@lo:400:kworker.0 00000100:00100000:3.0:1789762936.487929:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702149044224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762936.487933:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149043840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762936.487936:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149044352:12345-0@lo:400:kworker.0 Request processed in 58us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762936.487970:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16019bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3276:1876702149043712:0@lo:400:kworker.0 00000100:00100000:2.0:1789762936.487970:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789762936.488007:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702149044224:12345-0@lo:400:kworker.0 Request processed in 89us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762936.488017:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789762936.488024:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d160198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702149044224:0@lo:400:kworker.0 00000100:00100000:0.0:1789762936.488026:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d16019ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149044352:0@lo:400:kworker.0 00000100:00100000:3.0:1789762936.488060:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762936.488065:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149043584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762936.488092:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149043968 00000100:00100000:0.0:1789762936.488097:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149043968 00000100:00080000:2.0:1789762936.488123:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762936.488137:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149043840:12345-0@lo:400:kworker.0 Request processed in 221us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762936.488154:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789762936.488169:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149043968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762936.488181:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789762936.488230:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d160198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149043840:0@lo:400:kworker.0 00000100:00100000:3.0:1789762936.488248:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149043968:12345-0@lo:400:kworker.0 Request processed in 82us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762936.488255:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789762936.488291:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d160199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149043968:0@lo:400:kworker.0 00000100:00100000:3.0:1789762936.692877:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762936.692935:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762936.692967:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140839296 00000100:00100000:2.0:1789762936.692986:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140839296 00000100:00100000:3.0:1789762936.692994:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762936.693049:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140839552 00000100:00100000:0.0:1789762936.693067:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140839552 00000100:00100000:2.0:1789762936.693082:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 305 00000100:00100000:2.0:1789762936.693102:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140839296:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762936.693127:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140839424 00000100:00100000:1.0:1789762936.693162:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140839424 00000100:00100000:0.0:1789762936.693181:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:0.0:1789762936.693207:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140839552:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762936.693227:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140839296:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 119us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762936.693235:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 305 00000100:00080000:3.0:1789762936.693242:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762936.693254:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762936.693289:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 250 00000100:00100000:1.0:1789762936.693310:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140839424:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762936.693327:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140839552:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 130us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762936.693339:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:1.0:1789762936.693423:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140839424:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 93us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762936.693437:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 250 00000100:00100000:0.0:1789762936.697370:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762936.697439:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762936.697460:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140839680 00000100:00100000:2.0:1789762936.697470:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140839680 00000100:00080000:0.0:1789762936.697534:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762936.697535:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140839808 00000100:00100000:3.0:1789762936.697550:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140839808 00000100:00100000:2.0:1789762936.697560:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:2.0:1789762936.697580:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2341:x1876702140839680:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:2.0:1789762936.697616:0:8803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd08452c77c570745 00000100:00080000:0.0:1789762936.697641:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789762936.697645:0:8803:0:(import.c:65:import_set_state_nolock()) ffff95d042aa0000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789762936.697655:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:3.0:1789762936.697685:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140839808:12345-192.168.203.31@tcp:400:kworker.0 00000001:00000004:2.0:1789762936.697713:0:8803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967398 00010000:00010000:0.0:1789762936.697732:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762936.697785:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140839808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 100us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762936.697806:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:2.0:1789762936.698109:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+2:2341:x1876702140839680:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 539us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762936.698134:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 142 00010000:00010000:3.0:1789762936.871137:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762936.999160:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149044480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762936.999266:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762936.999388:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149044480 00000100:00100000:3.0:1789762936.999427:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149044480 00000100:00100000:3.0:1789762936.999523:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789762936.999546:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149044480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762936.999603:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526712832 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762936.999738:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149044480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762936.999754:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789762936.999829:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149044480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762937.895096:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762938.918981:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789762939.057699:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:0.0:1789762939.057711:0:7606:0:(genops.c:885:class_export_put()) final put ffff95d042aa0800/77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:3.0:1789762939.057757:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d042aa0800/77777931-b235-4c03-82d2-4b1d12553008 for lustre-OST0001 00000020:00000080:3.0:1789762939.057808:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d042aa0000 for lustre-OST0001 00010000:00010000:0.0:1789762939.942982:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762940.967012:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762941.607038:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789762941.607061:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149044608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762941.607139:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762941.607168:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149044992:0@lo:400:kworker.0 00000100:00100000:2.0:1789762941.607224:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762941.607236:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149044736:0@lo:400:kworker.0 00000100:00100000:2.0:1789762941.607264:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789762941.607277:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149044864:0@lo:400:kworker.0 00000100:00100000:1.0:1789762941.607288:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762941.607324:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762941.607386:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702149045248:0@lo:400:kworker.0 00000100:00100000:3.0:1789762941.607416:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149044992 00000100:00100000:2.0:1789762941.607419:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149044864 00000100:00100000:0.0:1789762941.607432:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149045120:0@lo:400:kworker.0 00000100:00100000:2.0:1789762941.607433:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149044864 00000100:00100000:1.0:1789762941.607434:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762941.607490:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149045248 00000100:00100000:2.0:1789762941.607495:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149045248 00000100:00100000:1.0:1789762941.607510:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149044736 00000100:00100000:1.0:1789762941.607516:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149044736 00000100:00100000:2.0:1789762941.607533:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789762941.607541:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762941.607553:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149044864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762941.607570:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789762941.607585:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149044736:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789762941.607639:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762941.607646:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149044864:12345-0@lo:400:kworker.0 Request processed in 99us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762941.607657:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789762941.607659:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149044736:12345-0@lo:400:kworker.0 Request processed in 77us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762941.607673:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789762941.607678:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149045120 00000100:00100000:0.0:1789762941.607687:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149045120 00000100:00100000:2.0:1789762941.607696:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789762941.607710:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702149045248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762941.607740:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702149045248:12345-0@lo:400:kworker.0 Request processed in 37us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762941.607752:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789762941.607801:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149044736:0@lo:400:kworker.0 00000100:00100000:0.0:1789762941.607811:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789762941.607829:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149044992 00000100:00100000:2.0:1789762941.607877:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149044864:0@lo:400:kworker.0 00000100:00100000:0.0:1789762941.607893:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149045120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762941.607899:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702149045248:0@lo:400:kworker.0 00000100:00080000:1.0:1789762941.607980:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762941.607994:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762941.608027:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149045120:12345-0@lo:400:kworker.0 Request processed in 199us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762941.608055:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789762941.608061:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149044608 00000100:00100000:3.0:1789762941.608069:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789762941.608073:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149044608 00000100:00100000:3.0:1789762941.608096:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149044992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762941.608156:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789762941.608172:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149044608:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762941.608182:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149045120:0@lo:400:kworker.0 00000100:00080000:1.0:1789762941.608202:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789762941.608210:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762941.608232:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149044992:12345-0@lo:400:kworker.0 Request processed in 143us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762941.608245:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789762941.608286:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149044608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762941.608293:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789762941.608322:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149044608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762941.608392:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149044992:0@lo:400:kworker.0 00000100:00100000:0.0:1789762941.812352:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762941.812413:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762941.812439:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762941.812463:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140840064 00000100:00100000:2.0:1789762941.812473:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140839936 00000100:00100000:1.0:1789762941.812477:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140840064 00000100:00100000:0.0:1789762941.812484:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762941.812484:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140839936 00000100:00100000:3.0:1789762941.812518:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140840192 00000100:00100000:3.0:1789762941.812543:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140840192 00000100:00100000:0.0:1789762941.812544:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140840320 00000100:00100000:0.0:1789762941.812550:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140840320 00000100:00100000:2.0:1789762941.812558:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 307 00000100:00100000:2.0:1789762941.812577:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a10b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140839936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762941.812588:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 255 00000100:00100000:1.0:1789762941.812600:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140840064:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762941.812617:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 256 00000100:00100000:3.0:1789762941.812623:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:0.0:1789762941.812630:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140840320:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762941.812639:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140840192:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762941.812671:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a10b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140839936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 104us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762941.812678:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 307 00000100:00100000:1.0:1789762941.812690:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140840064:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 85us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762941.812692:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2343:x1876702140840320:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 62us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762941.812708:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140840192:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 66us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762941.812716:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 255 00000100:00100000:0.0:1789762941.812728:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 256 00000100:00080000:2.0:1789762941.812732:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762941.812734:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00080000:2.0:1789762941.812738:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789762941.991049:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762942.119117:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149045376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762942.119217:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762942.119311:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149045376 00000100:00100000:3.0:1789762942.119324:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149045376 00000100:00100000:3.0:1789762942.119414:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789762942.119476:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149045376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762942.119522:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526712832 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762942.119591:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149045376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762942.119597:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789762942.119707:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149045376:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762943.014951:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762943.807753:0:15313:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:2.0:1789762943.807765:0:15313:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:2.0:1789762943.807772:0:15313:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762943.807780:0:15313:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:2.0:1789762943.807785:0:15313:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:2.0:1789762943.807788:0:15313:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d1742b9a00 rate 20 gen 0 00000100:00100000:2.0:1789762943.807791:0:15313:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762943.807795:0:15313:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:2.0:1789762943.807798:0:15313:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:2.0:1789762943.807801:0:15313:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d1742b9e00 rate 20 gen 0 00000100:00100000:2.0:1789762943.807952:0:15313:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:2.0:1789762943.807956:0:15313:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:2.0:1789762943.807961:0:15313:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762943.807965:0:15313:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:2.0:1789762943.807968:0:15313:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:2.0:1789762943.807970:0:15313:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d1742b9600 rate 10 gen 0 00000100:00100000:2.0:1789762943.807973:0:15313:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762943.807975:0:15313:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:2.0:1789762943.807979:0:15313:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:2.0:1789762943.807982:0:15313:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff95d1742b9100 rate 10 gen 0 00000100:00100000:3.0:1789762943.818371:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762943.818420:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140840448 00000100:00100000:2.0:1789762943.818431:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140840448 00000100:00080000:3.0:1789762943.818472:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762943.818495:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 270 00000100:00100000:2.0:1789762943.818506:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+5:13963:x1876702140840448:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:2.0:1789762943.818523:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762943.818586:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c570f4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eac1 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.818650:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c570f56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.818661:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c570f56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.818676:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c570f56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762943.818713:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762943.818717:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762943.818734:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c570f56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.818766:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c570f4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eac1 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.818781:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c570f56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eac1 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.818788:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04200) 00010000:00010000:2.0:1789762943.818791:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762943.818793:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d144cf6600, rc 0) 00000100:00100000:2.0:1789762943.818863:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+6:13963:x1876702140840448:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 360us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762943.818869:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 270 00000100:00100000:1.0:1789762943.820233:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762943.820298:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140840704 00000100:00100000:2.0:1789762943.820304:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140840704 00000100:00100000:2.0:1789762943.820336:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 271 00000100:00100000:2.0:1789762943.820358:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+6:13963:x1876702140840704:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:2.0:1789762943.820389:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762943.820406:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c570f56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eac1 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.820423:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04200) 00010000:00010000:2.0:1789762943.820432:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762943.820619:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c570f5d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.820628:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c570f5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.820642:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c570f5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.820674:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c570f64 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.820683:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c570f64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.820691:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c570f64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762943.821989:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 16384 00010000:00010000:2.0:1789762943.821998:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c570f5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.822007:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c570f5d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.822015:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c570f5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.822023:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762943.822028:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c570f5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.822034:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c570f5d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.822041:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04800) 00010000:00010000:2.0:1789762943.822042:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762943.822051:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c570f5d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.822056:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c570f5d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762943.822067:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046aa3eef reply state 00000000f00c8de0 transno 4294967529 ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c570f64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762943.822073:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762943.822119:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+7:13963:x1876702140840704:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 1775us (1888us total) trans 4294967529 rc 0/0 00000100:00100000:2.0:1789762943.822124:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 271 00010000:00010000:3.0:1789762943.822703:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c570f64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.822712:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c570f64 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.822717:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c570f64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.822721:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762943.822724:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c570f64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.822739:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c570f64 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.822747:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d142a04e00) 00010000:00010000:3.0:1789762943.822749:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762943.822751:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c570f64 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.822755:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c570f64 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762943.828125:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762943.828170:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140840832 00000100:00100000:2.0:1789762943.828177:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140840832 00000100:00100000:2.0:1789762943.828219:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 272 00000100:00100000:2.0:1789762943.828231:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+6:13964:x1876702140840832:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762943.828245:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762943.828257:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c570f6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eac8 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.828290:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c570f72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.828299:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c570f72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.828305:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c570f72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762943.828323:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762943.828332:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762943.828364:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c570f72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.828383:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c570f6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eac8 expref: 8 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.828396:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c570f72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eac8 expref: 7 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.828402:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04800) 00010000:00010000:2.0:1789762943.828404:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762943.828406:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d144cf6600, rc 0) 00000100:00100000:2.0:1789762943.828441:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+7:13964:x1876702140840832:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 215us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762943.828447:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 272 00000100:00100000:1.0:1789762943.829474:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762943.829509:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140841088 00000100:00100000:0.0:1789762943.829515:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140841088 00000100:00100000:0.0:1789762943.829547:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 273 00000100:00100000:0.0:1789762943.829554:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+7:13964:x1876702140841088:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789762943.829562:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762943.829564:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789762943.829576:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c570f72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eac8 expref: 7 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829587:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04800) 00010000:00010000:0.0:1789762943.829594:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762943.829605:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c570f79 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eacf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829678:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c570f80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829686:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c570f80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829692:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c570f80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829700:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570f87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829705:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829718:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829792:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829799:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829804:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762943.829809:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 16384 00010000:00010000:0.0:1789762943.829818:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829822:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829826:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829830:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762943.829855:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829860:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829867:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d151e90400) 00010000:00010000:0.0:1789762943.829869:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762943.829877:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829882:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c570f8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829895:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c570f80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829899:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c570f80 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829903:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c570f80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829907:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762943.829909:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c570f80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829912:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c570f80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829917:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90300) 00010000:00010000:0.0:1789762943.829918:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762943.829920:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c570f80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829924:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c570f80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829929:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829933:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570f87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829942:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570f87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829946:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762943.829949:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570f87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829952:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570f87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829958:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d151e90c00) 00010000:00010000:0.0:1789762943.829959:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762943.829961:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570f87 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829965:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570f87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829982:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c570f79 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eacf expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829988:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90300) 00010000:00010000:0.0:1789762943.829990:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762943.829992:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c570f79 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eacf expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.829999:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c99c00, rc 0) 00000100:00100000:0.0:1789762943.830034:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+6:13964:x1876702140841088:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 480us (559us total) trans 0 rc 301/301 00000100:00100000:0.0:1789762943.830052:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 273 00000100:00100000:2.0:1789762943.831062:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762943.831106:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140841216 00000100:00100000:1.0:1789762943.831111:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140841216 00000100:00100000:1.0:1789762943.831143:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 274 00000100:00100000:1.0:1789762943.831155:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+6:13964:x1876702140841216:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789762943.831166:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762943.831183:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c570f95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ead6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.831219:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c570f9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.831227:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c570f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.831234:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c570f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762943.831259:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789762943.831263:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762943.831277:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c570f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.831298:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c570f95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ead6 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.831318:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c570f9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ead6 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.831324:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:1.0:1789762943.831326:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762943.831328:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030c00, rc 0) 00000100:00100000:1.0:1789762943.831371:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+7:13964:x1876702140841216:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 220us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762943.831377:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 274 00000100:00100000:3.0:1789762943.832427:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762943.832462:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140841472 00000100:00100000:0.0:1789762943.832467:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140841472 00000100:00100000:0.0:1789762943.832501:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 275 00000100:00100000:0.0:1789762943.832509:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+7:13964:x1876702140841472:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789762943.832517:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762943.832527:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99800/0xd08452c77c570fa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eadd expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832557:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570faa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832565:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832571:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832581:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99200/0xd08452c77c570fb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832586:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99200/0xd08452c77c570fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832592:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99200/0xd08452c77c570fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762943.832639:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 16384 00010000:00010000:0.0:1789762943.832695:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832715:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570faa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832721:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570faa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832728:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762943.832732:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570faa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832740:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570faa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832752:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:0.0:1789762943.832755:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762943.832759:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570faa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832766:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570faa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832778:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99200/0xd08452c77c570fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832785:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99200/0xd08452c77c570fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832792:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99200/0xd08452c77c570fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832797:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762943.832808:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99200/0xd08452c77c570fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832815:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99200/0xd08452c77c570fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832824:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d151e90800) 00010000:00010000:0.0:1789762943.832827:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762943.832858:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99200/0xd08452c77c570fb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832866:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99200/0xd08452c77c570fb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832908:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99800/0xd08452c77c570fa3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eadd expref: 9 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832916:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:0.0:1789762943.832918:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789762943.832921:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99800/0xd08452c77c570fa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eadd expref: 9 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.832929:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c99800, rc 0) 00000100:00100000:0.0:1789762943.832961:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+8:13964:x1876702140841472:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 454us (536us total) trans 4294967530 rc 301/301 00000100:00100000:0.0:1789762943.832966:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 275 00000100:00100000:1.0:1789762943.834016:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762943.834045:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140841728 00000100:00100000:3.0:1789762943.834050:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140841728 00000100:00100000:3.0:1789762943.834085:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 276 00000100:00100000:3.0:1789762943.834095:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+8:13964:x1876702140841728:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:3.0:1789762943.834133:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570fbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.834142:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.834149:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762943.834267:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2f8a38d reply state 00000000b337067f transno 4294967531 ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762943.834275:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762943.834286:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 16384 00000100:00100000:3.0:1789762943.834341:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+10:13964:x1876702140841728:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 248us (327us total) trans 4294967531 rc 0/0 00000100:00100000:3.0:1789762943.834362:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 276 00010000:00010000:1.0:1789762943.834957:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.834967:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570fbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.834972:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570fbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.834977:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762943.834988:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570fbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.834993:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570fbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.835002:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d15055db00) 00010000:00010000:1.0:1789762943.835005:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789762943.835008:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570fbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.835015:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895c00/0xd08452c77c570fbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762943.835360:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762943.835399:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140841984 00000100:00100000:3.0:1789762943.835404:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140841984 00000100:00100000:3.0:1789762943.835478:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:3.0:1789762943.835487:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+9:13964:x1876702140841984:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1789762943.835587:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+10:13964:x1876702140841984:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 103us (228us total) trans 4294967532 rc 0/0 00000100:00100000:3.0:1789762943.835595:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:2.0:1789762943.840015:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762943.840059:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140842112 00000100:00100000:1.0:1789762943.840065:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140842112 00000100:00100000:1.0:1789762943.840099:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 277 00000100:00100000:1.0:1789762943.840108:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+10:13965:x1876702140842112:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:1.0:1789762943.840119:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762943.840129:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c570fc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eae4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840167:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c570fcd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840178:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c570fcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840190:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c570fcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840213:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c570fd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840219:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c570fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840224:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c570fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840285:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c570fdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840295:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c570fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840304:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c570fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762943.840321:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 16384 00000004:00200000:1.0:1789762943.840324:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762943.840335:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c570fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840353:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c570fcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840359:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c570fcd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840364:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c570fcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840376:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762943.840379:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c570fcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840384:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c570fcd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840392:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:1.0:1789762943.840394:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762943.840397:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c570fcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840401:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c570fcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840412:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c570fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840416:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c570fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840420:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c570fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840424:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762943.840426:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c570fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840430:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c570fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840444:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d14abf2600) 00010000:00010000:1.0:1789762943.840446:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762943.840448:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c570fd4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840452:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c570fd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840476:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c570fc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eae4 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840485:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c570fdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eae4 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.840490:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:1.0:1789762943.840492:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762943.840494:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030800, rc 0) 00000100:00100000:1.0:1789762943.840537:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+11:13965:x1876702140842112:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 430us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762943.840545:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 277 00000100:00100000:1.0:1789762943.841510:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762943.841545:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140842368 00000100:00100000:2.0:1789762943.841551:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140842368 00000100:00100000:2.0:1789762943.841581:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 278 00000100:00100000:2.0:1789762943.841589:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+11:13965:x1876702140842368:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:2.0:1789762943.841611:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762943.841621:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c570fdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eae4 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.841632:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:2.0:1789762943.841637:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762943.841655:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c570fe2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.841664:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c570fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.841673:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c570fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762943.841795:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b66ca2e0 reply state 00000000b1918dfb transno 4294967533 ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c570fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762943.841802:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762943.841807:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 16384 00000100:00100000:2.0:1789762943.841897:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+12:13965:x1876702140842368:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 308us (388us total) trans 4294967533 rc 0/0 00000100:00100000:2.0:1789762943.841904:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 278 00010000:00010000:3.0:1789762943.842506:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c570fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.842516:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c570fe2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.842521:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c570fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.842526:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762943.842528:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c570fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.842534:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c570fe2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.842543:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d142a04200) 00010000:00010000:3.0:1789762943.842545:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789762943.842548:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c570fe2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762943.842559:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c570fe2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762943.856616:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762943.856658:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140842496 00000100:00100000:0.0:1789762943.856666:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140842496 00000100:00100000:0.0:1789762943.856709:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 279 00000100:00100000:0.0:1789762943.856722:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+11:13969:x1876702140842496:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762943.856748:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762943.856764:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99200/0xd08452c77c570fe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eaeb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.856806:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570ff0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.856815:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.856822:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.856830:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c570ff7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.856896:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c570ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.856902:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c570ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.856967:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570ffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.856973:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.856978:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762943.856990:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 16384 00000004:00200000:0.0:1789762943.856997:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762943.857010:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857018:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857024:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570ff0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857031:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857037:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762943.857040:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857047:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857059:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:0.0:1789762943.857062:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762943.857067:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570ff0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857073:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98200/0xd08452c77c570ff0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857083:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c570ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857086:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c570ff7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857098:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c570ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857101:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762943.857103:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c570ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857107:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c570ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857112:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d151e90800) 00010000:00010000:0.0:1789762943.857114:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762943.857116:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c570ff7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857119:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c570ff7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857140:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99200/0xd08452c77c570fe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaeb expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857148:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaeb expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.857153:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d151e90300) 00010000:00010000:0.0:1789762943.857154:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789762943.857156:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c98a00, rc 0) 00000100:00100000:0.0:1789762943.857196:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+12:13969:x1876702140842496:12345-192.168.203.31@tcp:101:dd.500 Request processed in 479us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762943.857207:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 279 00000100:00100000:2.0:1789762943.858177:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762943.858218:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140842752 00000100:00100000:1.0:1789762943.858223:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140842752 00000100:00100000:1.0:1789762943.858252:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 280 00000100:00100000:1.0:1789762943.858258:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+12:13969:x1876702140842752:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:1.0:1789762943.858266:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762943.858280:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c571005 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eaf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.858340:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c57100c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.858363:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c57100c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.858373:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c57100c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.858388:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571013 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.858396:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.858404:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762943.858587:0:7131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1522ff800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876702149045504:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789762943.858628:0:7131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762943.858664:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149045504 00000100:00100000:2.0:1789762943.858669:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149045504 00000100:00100000:3.0:1789762943.858675:0:7131:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d17af6d180 going to sleep for 11 seconds 00000100:00080000:0.0:1789762943.858716:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762943.858721:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789762943.858730:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:7131:x1876702149045504:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789762943.858763:0:8803:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:1.0:1789762943.858908:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12:0x0], index 0: 0 00000004:00080000:1.0:1789762943.858919:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc:0x0], index 1: 0 00010000:00010000:1.0:1789762943.859084:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c57101a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859093:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c57101a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859098:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c57101a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859119:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c57100c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859129:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c57100c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859133:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c57100c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859136:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762943.859139:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c57100c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859144:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c57100c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859152:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d151e90300) 00010000:00010000:1.0:1789762943.859154:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762943.859157:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c57100c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859161:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c57100c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762943.859171:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046aaee0d reply state 000000002e0868a2 transno 4294967534 ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762943.859177:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789762943.859196:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031600/0xd08452c77c571005 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaf2 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859209:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c57101a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaf2 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859224:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff95d14abf2800) 00010000:00010000:1.0:1789762943.859226:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762943.859228:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030a00, rc 0) 00000100:00100000:1.0:1789762943.859263:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+15:13969:x1876702140842752:12345-192.168.203.31@tcp:101:dd.500 Request processed in 1005us (1087us total) trans 4294967534 rc 0/0 00000100:00100000:1.0:1789762943.859267:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 280 00010000:00010000:1.0:1789762943.859870:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859880:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571013 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859886:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571013 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859891:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762943.859894:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571013 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859899:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571013 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859910:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0xf4d4877e (ffff95d14abf2600) 00010000:00010000:1.0:1789762943.859914:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762943.859917:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571013 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.859922:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571013 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762943.861856:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762943.861897:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140842880 00000100:00100000:0.0:1789762943.861902:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140842880 00000100:00080000:1.0:1789762943.861939:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762943.861949:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:0.0:1789762943.861959:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:13969:x1876702140842880:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762943.861967:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762943.861978:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571028 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eaf9 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762943.861992:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789762943.862005:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789762943.862009:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762943.862016:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571028 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaf9 expref: 6 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.862028:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571028 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaf9 expref: 6 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.862040:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c99e00, rc 0) 00000100:00100000:0.0:1789762943.862082:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+6:13969:x1876702140842880:12345-192.168.203.31@tcp:101:dd.500 Request processed in 123us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762943.862088:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:3.0:1789762943.869362:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762943.869405:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140843008 00000100:00100000:0.0:1789762943.869412:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140843008 00002000:00100000:0.0:1789762943.869443:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x12:0x0] (0->1048575) req@ffff95d1522fea00 x1876702140843008/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:724/0 lens 488/0 e 0 to 0 dl 1789762954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762943.869460:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fea00 with x1876702140843008 ext(0->1048575) 00002000:00010000:0.0:1789762943.869464:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fea00 00000100:00100000:0.0:1789762943.869479:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323770675470 time 323770751624 state 0x0 ref 1 00000100:00100000:0.0:1789762943.869486:0:6659:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x1, head sequence 8: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 323770675470 time 323770751624 state 0x0 ref 1 00000100:00100000:0.0:1789762943.869501:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 3 deadline 348442660791 time 348342660791 state 0x1 ref 1 00000100:00100000:3.0:1789762943.869549:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 348442660791 time 348342707308 state 0x0 ref 1 00000100:00100000:3.0:1789762943.869563:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140843008:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762943.869691:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7131:x1876702149045504:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10960us (11059us total) trans 4294967912 rc 0/0 00000100:00100000:2.0:1789762943.869699:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789762943.869723:0:7131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1522ff800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876702149045504:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789762943.869737:0:7131:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x12:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:2.0:1789762943.875244:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+8:2342:x1876702140843008:12345-192.168.203.31@tcp:4:dd.500 Request processed in 5681us (5881us total) trans 4294967913 rc 0/0 00000100:00100000:2.0:1789762943.875253:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 697 00000100:00100000:2.0:1789762943.875261:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 348442660791 time 348342707308 state 0x2 ref 0 00002000:00100000:2.0:1789762943.875277:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x12:0x0] (0->1048575) req@ffff95d1522fea00 x1876702140843008/t4294967913(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:724/0 lens 488/448 e 0 to 0 dl 1789762954 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762943.875285:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fea00 with x1876702140843008 ext(0->1048575) 00002000:00010000:2.0:1789762943.875289:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fea00 00000100:00100000:3.0:1789762943.876047:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762943.876087:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140843136 00000100:00100000:1.0:1789762943.876093:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140843136 00002000:00100000:1.0:1789762943.876116:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x12:0x0] (1048576->2097151) req@ffff95d1522fd500 x1876702140843136/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:724/0 lens 488/0 e 0 to 0 dl 1789762954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762943.876123:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fd500 with x1876702140843136 ext(1048576->2097151) 00002000:00010000:1.0:1789762943.876126:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fd500 00000100:00100000:1.0:1789762943.876135:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 348442660791 time 348342707308 state 0x0 ref 1 00000100:00100000:1.0:1789762943.876143:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 348442707308 time 348342707308 state 0x1 ref 1 00000100:00100000:1.0:1789762943.876163:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 1 deadline 348442707308 time 348349326412 state 0x0 ref 1 00000100:00100000:1.0:1789762943.876172:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+8:2343:x1876702140843136:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762943.878583:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+10:2343:x1876702140843136:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2410us (2534us total) trans 4294967914 rc 0/0 00000100:00100000:1.0:1789762943.878590:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 698 00000100:00100000:1.0:1789762943.878596:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 1 deadline 348442707308 time 348349326412 state 0x2 ref 0 00002000:00100000:1.0:1789762943.878605:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x12:0x0] (1048576->2097151) req@ffff95d1522fd500 x1876702140843136/t4294967914(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:724/0 lens 488/448 e 0 to 0 dl 1789762954 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762943.878612:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fd500 with x1876702140843136 ext(1048576->2097151) 00002000:00010000:1.0:1789762943.878622:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fd500 00000100:00100000:3.0:1789762943.883056:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762943.883089:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140843264 00000100:00100000:2.0:1789762943.883096:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140843264 00002000:00100000:2.0:1789762943.883119:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x12:0x0] (2097152->3145727) req@ffff95d1522fd180 x1876702140843264/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:724/0 lens 488/0 e 0 to 0 dl 1789762954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762943.883128:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fd180 with x1876702140843264 ext(2097152->3145727) 00002000:00010000:2.0:1789762943.883131:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fd180 00000100:00100000:2.0:1789762943.883139:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 1 deadline 348442707308 time 348349326412 state 0x0 ref 1 00000100:00100000:2.0:1789762943.883147:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 1 deadline 348449326412 time 348349326412 state 0x1 ref 1 00000100:00100000:2.0:1789762943.883169:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348449326412 time 348356332702 state 0x0 ref 1 00000100:00100000:2.0:1789762943.883178:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+10:2343:x1876702140843264:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762943.885617:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+12:2343:x1876702140843264:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2437us (2560us total) trans 4294967915 rc 0/0 00000100:00100000:1.0:1789762943.885625:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 699 00000100:00100000:1.0:1789762943.885632:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348449326412 time 348356332702 state 0x2 ref 0 00002000:00100000:1.0:1789762943.885643:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x12:0x0] (2097152->3145727) req@ffff95d1522fd180 x1876702140843264/t4294967915(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:724/0 lens 488/448 e 0 to 0 dl 1789762954 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762943.885652:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fd180 with x1876702140843264 ext(2097152->3145727) 00002000:00010000:1.0:1789762943.885657:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fd180 00000100:00100000:3.0:1789762943.890521:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762943.890563:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140843392 00000100:00100000:1.0:1789762943.890569:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140843392 00002000:00100000:1.0:1789762943.890589:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x12:0x0] (3145728->4194303) req@ffff95d1522fdf80 x1876702140843392/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:724/0 lens 488/0 e 0 to 0 dl 1789762954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762943.890596:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fdf80 with x1876702140843392 ext(3145728->4194303) 00002000:00010000:1.0:1789762943.890599:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fdf80 00000100:00100000:1.0:1789762943.890607:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348449326412 time 348356332702 state 0x0 ref 1 00000100:00100000:1.0:1789762943.890614:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348456332702 time 348356332702 state 0x1 ref 1 00000100:00100000:2.0:1789762943.890748:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762943.890813:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140843520 00000100:00100000:3.0:1789762943.890818:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140843520 00000100:00100000:3.0:1789762943.890880:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:3.0:1789762943.890888:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1876702140843520:12345-192.168.203.31@tcp:8:dd.500 00010000:00080000:3.0:1789762943.890909:0:6656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp t0 exp 0000000000000000 cur 348 last 0 00000020:00000080:3.0:1789762943.890930:0:6656:0:(genops.c:1385:class_connect()) connect: client 77777931-b235-4c03-82d2-4b1d12553008, cookie 0xd08452c77c57102f 00002000:00100000:3.0:1789762943.890940:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 77777931-b235-4c03-82d2-4b1d12553008/ffff95d151b39800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 30670848 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789762943.890954:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789762943.891080:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789762943.891101:0:6656:0:(import.c:65:import_set_state_nolock()) ffff95d151b3a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789762943.891133:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2341:x1876702140843520:12345-192.168.203.31@tcp:8:dd.500 Request processed in 246us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762943.891146:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:3.0:1789762943.891941:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762943.891984:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140843648 00000100:00100000:1.0:1789762943.891988:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140843648 00000100:00100000:1.0:1789762943.892030:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00080000:0.0:1789762943.892034:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762943.892040:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+6:13969:x1876702140843648:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:1.0:1789762943.892049:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762943.892069:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d69de3a/0xd08452c77c571036 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb00 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762943.892088:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789762943.892109:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=348s v=(0 0) 00010000:00010000:1.0:1789762943.892113:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762943.892120:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d69de3a/0xd08452c77c571036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb00 expref: 7 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.892134:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d69de3a/0xd08452c77c571036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb00 expref: 7 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762943.892143:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140031600, rc 0) 00000100:00100000:1.0:1789762943.892168:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+7:13969:x1876702140843648:12345-192.168.203.31@tcp:101:dd.500 Request processed in 132us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762943.892173:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:2.0:1789762943.899240:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762943.899287:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140843776 00000100:00100000:3.0:1789762943.899294:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140843776 00002000:00100000:3.0:1789762943.899317:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->1048575) req@ffff95d174787b80 x1876702140843776/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:724/0 lens 488/0 e 0 to 0 dl 1789762954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762943.899325:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174787b80 with x1876702140843776 ext(0->1048575) 00002000:00010000:3.0:1789762943.899328:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174787b80 00000100:00100000:3.0:1789762943.899337:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348456332702 time 348356332702 state 0x1 ref 2 00000100:00100000:3.0:1789762943.905428:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762943.905468:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140843904 00000100:00100000:1.0:1789762943.905473:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140843904 00002000:00100000:1.0:1789762943.905494:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc:0x0] (1048576->2097151) req@ffff95d1522ffb80 x1876702140843904/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:724/0 lens 488/0 e 0 to 0 dl 1789762954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762943.905502:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522ffb80 with x1876702140843904 ext(1048576->2097151) 00002000:00010000:1.0:1789762943.905505:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1522ffb80 00000100:00100000:1.0:1789762943.905514:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348456332702 time 348356332702 state 0x1 ref 3 00000100:00100000:1.0:1789762943.983227:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348556374480 time 348456374480 state 0x1 ref 3 00000100:00100000:1.0:1789762943.983268:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140843392:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762943.986248:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+14:2345:x1876702140843392:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2986us (95725us total) trans 4294967916 rc 0/0 00000100:00100000:1.0:1789762943.986257:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 700 00002000:00100000:1.0:1789762943.986267:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x12:0x0] (3145728->4194303) req@ffff95d1522fdf80 x1876702140843392/t4294967916(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:724/0 lens 488/448 e 0 to 0 dl 1789762954 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762943.986275:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fdf80 with x1876702140843392 ext(3145728->4194303) 00002000:00010000:1.0:1789762943.986281:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fdf80 00010000:00010000:0.0:1789762944.038948:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762944.083266:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348656417099 time 348556417099 state 0x1 ref 2 00000100:00100000:1.0:1789762944.083285:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140843776:12345-192.168.203.31@tcp:4:dd.500 00000001:00100000:0.0:1789762944.094859:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000100:00100000:1.0:1789762944.096430:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140843776:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13147us (197187us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789762944.096438:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 701 00002000:00100000:1.0:1789762944.096448:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc:0x0] (0->1048575) req@ffff95d174787b80 x1876702140843776/t4294967399(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:724/0 lens 488/448 e 0 to 0 dl 1789762954 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762944.096455:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174787b80 with x1876702140843776 ext(0->1048575) 00002000:00010000:1.0:1789762944.096461:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174787b80 00000100:00100000:2.0:1789762944.098612:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.098659:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140844032 00000100:00100000:0.0:1789762944.098667:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140844032 00002000:00100000:0.0:1789762944.098696:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (2097152->3145727) req@ffff95d174784e00 x1876702140844032/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762944.098703:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174784e00 with x1876702140844032 ext(2097152->3145727) 00002000:00010000:0.0:1789762944.098706:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174784e00 00000100:00100000:0.0:1789762944.098721:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348656417099 time 348556417099 state 0x1 ref 2 00000100:00100000:3.0:1789762944.104677:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.104754:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140844160 00000100:00100000:0.0:1789762944.104759:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140844160 00002000:00100000:0.0:1789762944.104784:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (3145728->4194303) req@ffff95d1522fc700 x1876702140844160/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762944.104792:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fc700 with x1876702140844160 ext(3145728->4194303) 00002000:00010000:0.0:1789762944.104795:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1522fc700 00000100:00100000:0.0:1789762944.104804:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348656417099 time 348556417099 state 0x1 ref 3 00000100:00100000:2.0:1789762944.110707:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.110781:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140844288 00000100:00100000:0.0:1789762944.110786:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140844288 00002000:00100000:0.0:1789762944.110806:0:14626:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x12:0x0] (4194304->5242879) req@ffff95d174786300 x1876702140844288/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762944.110814:0:14626:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174786300 with x1876702140844288 ext(4194304->5242879) 00002000:00010000:0.0:1789762944.110818:0:14626:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d174786300 00000100:00100000:0.0:1789762944.110826:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348656417099 time 348556417099 state 0x1 ref 4 00000100:00100000:2.0:1789762944.117189:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762944.117268:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140844416 00000100:00100000:1.0:1789762944.117273:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140844416 00002000:00100000:1.0:1789762944.117295:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x12:0x0] (5242880->6291455) req@ffff95d174786a00 x1876702140844416/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762944.117313:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174786a00 with x1876702140844416 ext(5242880->6291455) 00002000:00010000:1.0:1789762944.117316:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d174786a00 00000100:00100000:1.0:1789762944.117326:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348656417099 time 348556417099 state 0x1 ref 5 00000100:00100000:3.0:1789762944.123903:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762944.123959:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140844544 00000100:00100000:2.0:1789762944.123973:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140844544 00002000:00100000:2.0:1789762944.124003:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x12:0x0] (6291456->7340031) req@ffff95d1522ff100 x1876702140844544/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762944.124015:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522ff100 with x1876702140844544 ext(6291456->7340031) 00002000:00010000:2.0:1789762944.124020:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522ff100 00000100:00100000:2.0:1789762944.124037:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348656417099 time 348556417099 state 0x1 ref 6 00000100:00100000:2.0:1789762944.130311:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762944.130372:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140844672 00000100:00100000:1.0:1789762944.130377:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140844672 00002000:00100000:1.0:1789762944.130399:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x12:0x0] (7340032->8388607) req@ffff95d174785f80 x1876702140844672/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762944.130407:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174785f80 with x1876702140844672 ext(7340032->8388607) 00002000:00010000:1.0:1789762944.130410:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d174785f80 00000100:00100000:1.0:1789762944.130419:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348656417099 time 348556417099 state 0x1 ref 7 00000100:00100000:1.0:1789762944.183307:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348756458504 time 348656458504 state 0x1 ref 7 00000100:00100000:1.0:1789762944.183326:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+10:2345:x1876702140843904:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762944.186375:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+12:2345:x1876702140843904:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3051us (280945us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789762944.186386:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 702 00002000:00100000:1.0:1789762944.186399:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (1048576->2097151) req@ffff95d1522ffb80 x1876702140843904/t4294967400(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:724/0 lens 488/448 e 0 to 0 dl 1789762954 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762944.186409:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522ffb80 with x1876702140843904 ext(1048576->2097151) 00002000:00010000:1.0:1789762944.186414:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1522ffb80 00000100:00100000:3.0:1789762944.188667:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762944.188718:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140844800 00000100:00100000:1.0:1789762944.188728:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140844800 00002000:00100000:1.0:1789762944.188761:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc:0x0] (4194304->5242879) req@ffff95d1522fdc00 x1876702140844800/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762944.188772:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fdc00 with x1876702140844800 ext(4194304->5242879) 00002000:00010000:1.0:1789762944.188777:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1522fdc00 00000100:00100000:1.0:1789762944.188790:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348756458504 time 348656458504 state 0x1 ref 7 00000100:00100000:2.0:1789762944.194644:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762944.194710:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140844928 00000100:00100000:3.0:1789762944.194716:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140844928 00002000:00100000:3.0:1789762944.194736:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (5242880->6291455) req@ffff95d174785c00 x1876702140844928/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762944.194744:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174785c00 with x1876702140844928 ext(5242880->6291455) 00002000:00010000:3.0:1789762944.194747:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174785c00 00000100:00100000:3.0:1789762944.194756:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348756458504 time 348656458504 state 0x1 ref 8 00000100:00100000:1.0:1789762944.283396:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348856537200 time 348756537200 state 0x1 ref 8 00000100:00100000:1.0:1789762944.283436:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+13:2345:x1876702140844032:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762944.286940:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+15:2345:x1876702140844032:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3510us (188326us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789762944.286950:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 703 00002000:00100000:1.0:1789762944.286962:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc:0x0] (2097152->3145727) req@ffff95d174784e00 x1876702140844032/t4294967401(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762944.286973:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174784e00 with x1876702140844032 ext(2097152->3145727) 00002000:00010000:1.0:1789762944.286980:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174784e00 00000100:00100000:3.0:1789762944.289355:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.289403:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140845056 00000100:00100000:0.0:1789762944.289411:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140845056 00002000:00100000:0.0:1789762944.289450:0:14626:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xc:0x0] (6291456->7340031) req@ffff95d1522fc000 x1876702140845056/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762944.289458:0:14626:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fc000 with x1876702140845056 ext(6291456->7340031) 00002000:00010000:0.0:1789762944.289461:0:14626:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1522fc000 00000100:00100000:0.0:1789762944.289475:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348856537200 time 348756537200 state 0x1 ref 8 00000100:00100000:2.0:1789762944.302191:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762944.302244:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140845184 00000100:00100000:1.0:1789762944.302251:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140845184 00002000:00100000:1.0:1789762944.302288:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc:0x0] (7340032->8388607) req@ffff95d174787800 x1876702140845184/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762944.302300:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174787800 with x1876702140845184 ext(7340032->8388607) 00002000:00010000:1.0:1789762944.302305:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174787800 00000100:00100000:2.0:1789762944.302327:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762944.302335:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348856537200 time 348756537200 state 0x1 ref 9 00000100:00100000:0.0:1789762944.302392:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140845440 00000100:00100000:0.0:1789762944.302398:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140845440 00000100:00100000:0.0:1789762944.302431:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:0.0:1789762944.302446:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+14:13969:x1876702140845440:12345-192.168.203.31@tcp:35:dd.500 00000100:00100000:0.0:1789762944.302705:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+15:13969:x1876702140845440:12345-192.168.203.31@tcp:35:dd.500 Request processed in 260us (381us total) trans 4294967535 rc 0/0 00000100:00100000:0.0:1789762944.302714:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:2.0:1789762944.347600:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762944.347666:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140845696 00000100:00100000:3.0:1789762944.347677:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140845696 00000100:00100000:3.0:1789762944.347737:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 281 00000100:00100000:3.0:1789762944.347746:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+15:13980:x1876702140845696:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762944.347768:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762944.347783:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c57103d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb07 expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.347902:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c571044 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.347915:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c571044 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.347924:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c571044 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.347935:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c57104b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.347940:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c57104b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.347945:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c57104b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762944.348358:0:13232:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd:0x0], index 1: 0 00000004:00080000:3.0:1789762944.348376:0:13232:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13:0x0], index 0: 0 00010000:00010000:3.0:1789762944.348510:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c571052 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.348519:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c571052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.348539:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c571052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.348575:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c571044 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.348583:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c571044 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.348590:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c571044 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.348596:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762944.348601:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c571044 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.348609:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c571044 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.348621:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d151e90300) 00010000:00010000:3.0:1789762944.348625:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762944.348629:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c571044 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.348637:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895000/0xd08452c77c571044 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762944.348648:0:13232:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2a165eb reply state 000000008ff215ce transno 4294967536 ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c57104b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762944.348655:0:13232:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789762944.348683:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a895e00/0xd08452c77c57103d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb07 expref: 18 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.348693:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c571052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb07 expref: 17 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.348699:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff95d15055d300) 00010000:00010000:3.0:1789762944.348701:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762944.348703:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a894e00, rc 0) 00000100:00100000:3.0:1789762944.348755:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+18:13980:x1876702140845696:12345-192.168.203.31@tcp:101:dd.0 Request processed in 1011us (1165us total) trans 4294967536 rc 0/0 00000100:00100000:3.0:1789762944.348760:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 281 00010000:00010000:1.0:1789762944.349515:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c57104b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.349526:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c57104b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.349533:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c57104b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.349539:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762944.349543:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c57104b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.349550:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c57104b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.349561:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x636661f9 (ffff95d15055de00) 00010000:00010000:1.0:1789762944.349565:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762944.349568:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c57104b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.349575:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894a00/0xd08452c77c57104b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762944.361113:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.361157:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140845824 00000100:00100000:0.0:1789762944.361165:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140845824 00000100:00100000:0.0:1789762944.361200:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:0.0:1789762944.361208:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+17:13982:x1876702140845824:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762944.361219:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762944.361232:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb0e expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762944.361252:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789762944.361265:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789762944.361269:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762944.361276:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 18 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.361286:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 18 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.361295:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c99200, rc 0) 00000100:00100000:0.0:1789762944.361328:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+18:13982:x1876702140845824:12345-192.168.203.31@tcp:101:dd.0 Request processed in 122us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762944.361333:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:3.0:1789762944.363867:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.363908:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140845952 00000100:00100000:0.0:1789762944.363920:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140845952 00000100:00100000:0.0:1789762944.363945:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:0.0:1789762944.363950:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16fbf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+18:13981:x1876702140845952:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762944.363957:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762944.363972:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000875d9e09/0xd08452c77c571067 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb15 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.363988:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 19 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.363994:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762944.363996:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789762944.364000:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000875d9e09/0xd08452c77c571067 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb15 expref: 19 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.364039:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 19 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.364055:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 19 pid: 8803 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762944.364067:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044e53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6656:1876702149045632:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789762944.364136:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d16a095d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789762944.364953:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044e53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6656:1876702149045632:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762944.364970:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000875d9e09/0xd08452c77c571067 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb15 expref: 19 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.364989:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c99c00, rc 0) 00000100:00100000:0.0:1789762944.365019:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16fbf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+19:13981:x1876702140845952:12345-192.168.203.31@tcp:101:dd.0 Request processed in 1067us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762944.365027:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:2.0:1789762944.376178:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762944.376238:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140846080 00000100:00100000:1.0:1789762944.376249:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140846080 00000100:00100000:1.0:1789762944.376302:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:1.0:1789762944.376315:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+18:13986:x1876702140846080:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762944.376335:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762944.376380:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb1c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762944.376417:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789762944.376437:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=348s v=(0 0) 00010000:00010000:1.0:1789762944.376442:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762944.376452:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb1c expref: 19 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.376470:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb1c expref: 19 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.376485:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030e00, rc 0) 00000100:00100000:1.0:1789762944.376536:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+19:13986:x1876702140846080:12345-192.168.203.31@tcp:101:dd.0 Request processed in 223us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762944.376544:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:3.0:1789762944.379334:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.379393:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140846208 00000100:00100000:0.0:1789762944.379399:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140846208 00000100:00100000:0.0:1789762944.379428:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:0.0:1789762944.379434:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+19:13984:x1876702140846208:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762944.379442:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762944.379450:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571075 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb23 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.379466:0:8803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb1c expref: 20 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.379473:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762944.379475:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789762944.379479:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571075 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb23 expref: 20 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.379503:0:8803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb1c expref: 20 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.379512:0:8803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb1c expref: 20 pid: 6655 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762944.379534:0:8803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d044e51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8803:1876702149045760:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789762944.379590:0:8803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d16a095d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789762944.380479:0:8803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d044e51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8803:1876702149045760:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789762944.380495:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571075 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb23 expref: 20 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.380503:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c98200, rc 0) 00000100:00100000:0.0:1789762944.380528:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+20:13984:x1876702140846208:12345-192.168.203.31@tcp:101:dd.0 Request processed in 1095us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762944.380533:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:2.0:1789762944.382954:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.382997:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140846336 00000100:00100000:0.0:1789762944.383002:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140846336 00000100:00100000:0.0:1789762944.383033:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:0.0:1789762944.383038:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+19:13990:x1876702140846336:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762944.383045:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762944.383053:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb05363b/0xd08452c77c57107c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb2a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.383065:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789762944.383068:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789762944.383071:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb05363b/0xd08452c77c57107c lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb2a expref: 20 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.383079:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb05363b/0xd08452c77c57107c lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb2a expref: 20 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.383094:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c98800, rc 0) 00000100:00100000:0.0:1789762944.383124:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+20:13990:x1876702140846336:12345-192.168.203.31@tcp:101:dd.0 Request processed in 86us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762944.383129:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:3.0:1789762944.383452:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 348956608247 time 348856608247 state 0x1 ref 9 00000100:00100000:3.0:1789762944.383464:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+19:2344:x1876702140844160:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762944.385318:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762944.385365:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140846464 00000100:00100000:3.0:1789762944.385370:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140846464 00000100:00100000:3.0:1789762944.385400:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:3.0:1789762944.385409:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+21:13991:x1876702140846464:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762944.385417:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762944.385425:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075d71727/0xd08452c77c571083 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb31 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.385438:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xd:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1789762944.385447:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(3 0) 00010000:00010000:3.0:1789762944.385452:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075d71727/0xd08452c77c571083 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb31 expref: 22 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.385461:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075d71727/0xd08452c77c571083 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb31 expref: 22 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.385469:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a895e00, rc 0) 00000100:00100000:3.0:1789762944.385497:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+22:13991:x1876702140846464:12345-192.168.203.31@tcp:101:dd.0 Request processed in 91us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762944.385503:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:3.0:1789762944.386179:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+22:2344:x1876702140844160:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2714us (281502us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789762944.386188:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 704 00002000:00100000:3.0:1789762944.386199:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (3145728->4194303) req@ffff95d1522fc700 x1876702140844160/t4294967402(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762944.386210:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fc700 with x1876702140844160 ext(3145728->4194303) 00002000:00010000:3.0:1789762944.386216:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1522fc700 00000100:00100000:1.0:1789762944.391324:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.391383:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140846592 00000100:00100000:0.0:1789762944.391388:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140846592 00000100:00100000:0.0:1789762944.391428:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:0.0:1789762944.391434:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+22:13983:x1876702140846592:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762944.391443:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762944.391451:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f622ea79/0xd08452c77c57108a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb38 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.391465:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xd:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1789762944.391468:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(4 0) 00010000:00010000:0.0:1789762944.391472:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f622ea79/0xd08452c77c57108a lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb38 expref: 23 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.391480:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f622ea79/0xd08452c77c57108a lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb38 expref: 23 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.391487:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c99a00, rc 0) 00000100:00100000:0.0:1789762944.391513:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+23:13983:x1876702140846592:12345-192.168.203.31@tcp:101:dd.0 Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762944.391518:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:2.0:1789762944.391851:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.391889:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140846720 00000100:00100000:0.0:1789762944.391894:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140846720 00000100:00100000:0.0:1789762944.391915:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:0.0:1789762944.391920:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+20:13994:x1876702140846720:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762944.391926:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762944.391933:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571091 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb3f expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.391945:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789762944.391948:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789762944.391951:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571091 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb3f expref: 21 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.391958:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571091 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb3f expref: 21 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.391964:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c98c00, rc 0) 00000100:00100000:0.0:1789762944.391987:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+21:13994:x1876702140846720:12345-192.168.203.31@tcp:101:dd.0 Request processed in 67us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762944.391991:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:2.0:1789762944.394213:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762944.394243:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140846848 00000100:00100000:3.0:1789762944.394248:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140846848 00000100:00100000:3.0:1789762944.394275:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:3.0:1789762944.394280:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+21:13987:x1876702140846848:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762944.394287:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762944.394294:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cee3f8cf/0xd08452c77c571098 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb46 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.394318:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x13:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1789762944.394321:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(3 0) 00010000:00010000:3.0:1789762944.394325:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cee3f8cf/0xd08452c77c571098 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb46 expref: 22 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.394333:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cee3f8cf/0xd08452c77c571098 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb46 expref: 22 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.394351:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a895000, rc 0) 00000100:00100000:3.0:1789762944.394381:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+22:13987:x1876702140846848:12345-192.168.203.31@tcp:101:dd.0 Request processed in 100us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762944.394398:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:1.0:1789762944.394675:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.394727:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140846976 00000100:00100000:0.0:1789762944.394734:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140846976 00000100:00100000:0.0:1789762944.394768:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:0.0:1789762944.394779:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+22:13992:x1876702140846976:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762944.394789:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762944.394799:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061f95ccb/0xd08452c77c57109f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb4d expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.394830:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x13:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1789762944.394859:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(4 0) 00010000:00010000:0.0:1789762944.394865:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061f95ccb/0xd08452c77c57109f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb4d expref: 23 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.394875:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061f95ccb/0xd08452c77c57109f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb4d expref: 23 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.394884:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c98000, rc 0) 00000100:00100000:0.0:1789762944.394915:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+23:13992:x1876702140846976:12345-192.168.203.31@tcp:101:dd.0 Request processed in 141us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762944.394923:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:2.0:1789762944.394929:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.394949:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140847104 00000100:00100000:0.0:1789762944.394953:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140847104 00000100:00100000:0.0:1789762944.394974:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:0.0:1789762944.394982:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+23:13988:x1876702140847104:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762944.394988:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762944.394995:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033000e04/0xd08452c77c5710a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb54 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.395006:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xd:0x0].0x0 since=0s v=(4 0) 00010000:00010000:0.0:1789762944.395009:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(5 0) 00010000:00010000:0.0:1789762944.395013:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033000e04/0xd08452c77c5710a6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb54 expref: 24 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.395030:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033000e04/0xd08452c77c5710a6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb54 expref: 24 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.395037:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c98600, rc 0) 00000100:00100000:0.0:1789762944.395062:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+24:13988:x1876702140847104:12345-192.168.203.31@tcp:101:dd.0 Request processed in 82us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762944.395067:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:2.0:1789762944.396662:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762944.396694:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140847232 00000100:00100000:3.0:1789762944.396699:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140847232 00000100:00100000:3.0:1789762944.396724:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:3.0:1789762944.396730:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+23:13995:x1876702140847232:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762944.396738:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762944.396746:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c5710ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb5b expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.396759:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x13:0x0].0x0 since=0s v=(4 0) 00010000:00010000:3.0:1789762944.396762:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(5 0) 00010000:00010000:3.0:1789762944.396766:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c5710ad lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 7 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb5b expref: 24 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.396785:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c5710ad lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 7 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb5b expref: 24 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.396792:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a894600, rc 0) 00000100:00100000:3.0:1789762944.396818:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+24:13995:x1876702140847232:12345-192.168.203.31@tcp:101:dd.0 Request processed in 88us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762944.396823:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:1.0:1789762944.399394:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762944.399426:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140847360 00000100:00100000:3.0:1789762944.399431:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140847360 00000100:00100000:3.0:1789762944.399456:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:3.0:1789762944.399461:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+24:13989:x1876702140847360:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762944.399469:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762944.399476:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee688a08/0xd08452c77c5710b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb62 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.399490:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xd:0x0].0x0 since=0s v=(5 0) 00010000:00010000:3.0:1789762944.399493:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789762944.399497:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee688a08/0xd08452c77c5710b4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb62 expref: 25 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.399505:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee688a08/0xd08452c77c5710b4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb62 expref: 25 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.399512:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a895800, rc 0) 00000100:00100000:3.0:1789762944.399536:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+25:13989:x1876702140847360:12345-192.168.203.31@tcp:101:dd.0 Request processed in 75us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762944.399548:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:1.0:1789762944.400285:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.400324:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140847488 00000100:00100000:0.0:1789762944.400329:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140847488 00000100:00100000:0.0:1789762944.400367:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:0.0:1789762944.400373:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+24:13985:x1876702140847488:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762944.400380:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762944.400388:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b196748/0xd08452c77c5710bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb69 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.400402:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x13:0x0].0x0 since=0s v=(5 0) 00010000:00010000:0.0:1789762944.400406:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(6 0) 00010000:00010000:0.0:1789762944.400410:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b196748/0xd08452c77c5710bb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb69 expref: 25 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.400417:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b196748/0xd08452c77c5710bb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb69 expref: 25 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.400424:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c98e00, rc 0) 00000100:00100000:0.0:1789762944.400450:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+25:13985:x1876702140847488:12345-192.168.203.31@tcp:101:dd.0 Request processed in 78us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762944.400461:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:2.0:1789762944.400945:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762944.400983:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140847616 00000100:00100000:3.0:1789762944.400987:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140847616 00000100:00100000:3.0:1789762944.401009:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:3.0:1789762944.401014:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+25:13993:x1876702140847616:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789762944.401020:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762944.401026:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d261481/0xd08452c77c5710c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb70 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.401038:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x13:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789762944.401041:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:3.0:1789762944.401045:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d261481/0xd08452c77c5710c2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb70 expref: 26 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.401053:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d261481/0xd08452c77c5710c2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb70 expref: 26 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.401060:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a894000, rc 0) 00000100:00100000:3.0:1789762944.401084:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+26:13993:x1876702140847616:12345-192.168.203.31@tcp:101:dd.0 Request processed in 69us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762944.401088:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:1.0:1789762944.406082:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762944.406115:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.406146:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140847744 00000100:00100000:0.0:1789762944.406153:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140847744 00000100:00100000:3.0:1789762944.406162:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140847872 00000100:00100000:3.0:1789762944.406167:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140847872 00002000:00100000:0.0:1789762944.406184:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xd:0x0] (0->1048575) req@ffff95d174108000 x1876702140847744/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762944.406188:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xd:0x0] (2097152->3145727) req@ffff95d17410b100 x1876702140847872/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762944.406215:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174108000 with x1876702140847744 ext(0->1048575) 00002000:00100000:3.0:1789762944.406215:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17410b100 with x1876702140847872 ext(2097152->3145727) 00010000:00010000:0.0:1789762944.406227:0:11722:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 26 pid: 8803 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.406229:0:11723:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 26 pid: 8803 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762944.406257:0:11723:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 26 pid: 8803 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762944.406261:0:11722:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 26 pid: 8803 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762944.406267:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d17410b100 00002000:00010000:0.0:1789762944.406277:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d174108000 00000100:00100000:3.0:1789762944.406286:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015d00 gen 0 rate 20 depth 3 token 2 deadline 281792428086 time 281742451183 state 0x0 ref 1 00000100:00100000:0.0:1789762944.406298:0:11722:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x1, head sequence 8: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044015d00 gen 0 rate 20 depth 3 token 2 deadline 281792428086 time 281742451183 state 0x0 ref 2 00000100:00100000:0.0:1789762944.406350:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9e00 gen 0 rate 20 depth 3 token 3 deadline 348929492973 time 348879492973 state 0x1 ref 2 00000100:00100000:3.0:1789762944.406364:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9e00 gen 0 rate 20 depth 3 token 3 deadline 348929492973 time 348879492973 state 0x1 ref 2 00000100:00100000:0.0:1789762944.406386:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9e00 gen 0 rate 20 depth 3 token 2 deadline 348929543942 time 348879543942 state 0x1 ref 2 00000100:00100000:3.0:1789762944.406398:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9e00 gen 0 rate 20 depth 3 token 1 deadline 348929543942 time 348879559872 state 0x0 ref 2 00000100:00100000:0.0:1789762944.406404:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+26:2343:x1876702140847744:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762944.406414:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+26:2345:x1876702140847872:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:3.0:1789762944.412649:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762944.412700:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140848000 00000100:00100000:2.0:1789762944.412706:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140848000 00002000:00100000:2.0:1789762944.412735:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x13:0x0] (2097152->3145727) req@ffff95d1522ff480 x1876702140848000/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762944.412747:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522ff480 with x1876702140848000 ext(2097152->3145727) 00010000:00010000:2.0:1789762944.412755:0:13229:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb1c expref: 26 pid: 6655 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.412780:0:13229:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb1c expref: 26 pid: 6655 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762944.412787:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff95d1522ff480 00000100:00100000:2.0:1789762944.412800:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9e00 gen 0 rate 20 depth 3 token 1 deadline 348929559872 time 348879559872 state 0x1 ref 3 00000100:00100000:2.0:1789762944.412826:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9e00 gen 0 rate 20 depth 3 token 0 deadline 348929559872 time 348885988461 state 0x0 ref 3 00000100:00100000:2.0:1789762944.412855:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+26:2344:x1876702140848000:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762944.421957:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+30:2343:x1876702140847744:12345-192.168.203.31@tcp:4:dd.0 Request processed in 15554us (15871us total) trans 4294967404 rc 0/0 00000100:00100000:0.0:1789762944.421970:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1789762944.421981:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+30:2345:x1876702140847872:12345-192.168.203.31@tcp:4:dd.0 Request processed in 15567us (15862us total) trans 4294967403 rc 0/0 00002000:00100000:0.0:1789762944.421982:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xd:0x0] (0->1048575) req@ffff95d174108000 x1876702140847744/t4294967404(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1789762944.421997:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 3 00002000:00100000:0.0:1789762944.422009:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174108000 with x1876702140847744 ext(0->1048575) 00002000:00100000:1.0:1789762944.422012:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xd:0x0] (2097152->3145727) req@ffff95d17410b100 x1876702140847872/t4294967403(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1789762944.422022:0:11722:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 30 pid: 8803 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1789762944.422047:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d17410b100 with x1876702140847872 ext(2097152->3145727) 00010000:00010000:0.0:1789762944.422048:0:11722:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 30 pid: 8803 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.422061:0:11723:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 30 pid: 8803 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762944.422063:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d174108000 00010000:00010000:1.0:1789762944.422079:0:11723:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 30 pid: 8803 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762944.422099:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d17410b100 00000100:00100000:2.0:1789762944.422457:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+28:2344:x1876702140848000:12345-192.168.203.31@tcp:4:dd.0 Request processed in 9621us (9812us total) trans 4294967917 rc 0/0 00000100:00100000:2.0:1789762944.422464:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1789762944.422471:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d042091000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9e00 gen 0 rate 20 depth 3 token 0 deadline 348929559872 time 348885988461 state 0x2 ref 0 00002000:00100000:2.0:1789762944.422480:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x13:0x0] (2097152->3145727) req@ffff95d1522ff480 x1876702140848000/t4294967917(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762944.422487:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522ff480 with x1876702140848000 ext(2097152->3145727) 00010000:00010000:2.0:1789762944.422493:0:13229:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb1c expref: 28 pid: 6655 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.422502:0:13229:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb1c expref: 28 pid: 6655 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762944.422518:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff95d1522ff480 00000100:00100000:3.0:1789762944.428473:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762944.428514:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140848128 00000100:00100000:2.0:1789762944.428520:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140848128 00010000:00010000:2.0:1789762944.428539:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb1c expref: 28 pid: 6655 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762944.428562:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1789762944.428568:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+28:2345:x1876702140848128:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762944.428576:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789762944.428586:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1789762944.428589:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb mtime from disk: 0 -> 1789762943 00002000:00010000:2.0:1789762944.428591:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1789762943 00010000:00010000:2.0:1789762944.428595:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb1c expref: 28 pid: 6655 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428604:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb1c expref: 28 pid: 6655 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428623:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027be040/0xd08452c77c57106e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb1c expref: 28 pid: 6655 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428635:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428639:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428648:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb23 expref: 27 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428668:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb23 expref: 27 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428678:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428682:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428689:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571091 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb3f expref: 27 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428697:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571091 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb3f expref: 27 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428703:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428704:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428708:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cee3f8cf/0xd08452c77c571098 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb46 expref: 27 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428714:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cee3f8cf/0xd08452c77c571098 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb46 expref: 27 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428719:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428720:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428723:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061f95ccb/0xd08452c77c57109f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb4d expref: 27 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428729:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061f95ccb/0xd08452c77c57109f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb4d expref: 27 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428744:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428747:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428753:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c5710ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb5b expref: 27 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428763:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c5710ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb5b expref: 27 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428771:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428774:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428778:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b196748/0xd08452c77c5710bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb69 expref: 27 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428784:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b196748/0xd08452c77c5710bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb69 expref: 27 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428788:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428790:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762944.428793:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d261481/0xd08452c77c5710c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb70 expref: 27 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428797:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d261481/0xd08452c77c5710c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb70 expref: 27 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762944.428822:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001d261481/0xd08452c77c5710c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb70 expref: 27 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762944.428869:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149045888:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762944.428958:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000b196748/0xd08452c77c5710bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb69 expref: 27 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762944.428966:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cda680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149046016:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762944.428997:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c5710ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb5b expref: 27 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762944.429005:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149046144:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762944.429035:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000061f95ccb/0xd08452c77c57109f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb4d expref: 27 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762944.429047:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149046272:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762944.429081:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cee3f8cf/0xd08452c77c571098 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb46 expref: 27 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762944.429100:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cdbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149046400:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762944.429125:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571091 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb3f expref: 27 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762944.429131:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149046528:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762944.429160:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb23 expref: 27 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762944.429167:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cd8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149046656:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762944.429215:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d043877540 going to sleep for 11 seconds 00000100:00100000:0.0:1789762944.429274:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762944.429332:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140848256 00000100:00100000:1.0:1789762944.429348:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140848256 00010000:00010000:1.0:1789762944.429370:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 29 pid: 8803 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762944.429402:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:1.0:1789762944.429412:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+29:2342:x1876702140848256:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762944.429422:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789762944.429430:0:5797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1789762944.429433:0:5797:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb mtime from disk: 0 -> 1789762943 00002000:00010000:1.0:1789762944.429435:0:5797:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb ctime from disk: 0 -> 1789762943 00010000:00010000:1.0:1789762944.429441:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 29 pid: 8803 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429453:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 29 pid: 8803 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429481:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016554480/0xd08452c77c571060 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb0e expref: 29 pid: 8803 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429493:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762944.429497:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762944.429504:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000875d9e09/0xd08452c77c571067 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb15 expref: 28 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429514:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000875d9e09/0xd08452c77c571067 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb15 expref: 28 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429523:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762944.429526:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762944.429531:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb05363b/0xd08452c77c57107c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb2a expref: 28 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429541:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb05363b/0xd08452c77c57107c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb2a expref: 28 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429550:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762944.429554:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762944.429560:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075d71727/0xd08452c77c571083 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb31 expref: 28 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429571:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075d71727/0xd08452c77c571083 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb31 expref: 28 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429588:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762944.429591:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762944.429597:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f622ea79/0xd08452c77c57108a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb38 expref: 28 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429607:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f622ea79/0xd08452c77c57108a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb38 expref: 28 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429614:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762944.429617:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762944.429622:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033000e04/0xd08452c77c5710a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb54 expref: 28 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429631:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033000e04/0xd08452c77c5710a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb54 expref: 28 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429638:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762944.429641:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789762944.429645:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee688a08/0xd08452c77c5710b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb62 expref: 28 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429654:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee688a08/0xd08452c77c5710b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb62 expref: 28 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762944.429678:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee688a08/0xd08452c77c5710b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb62 expref: 28 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762944.429695:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17410bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149046784:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762944.429742:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000033000e04/0xd08452c77c5710a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb54 expref: 28 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762944.429754:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17410a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149046912:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762944.429792:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f622ea79/0xd08452c77c57108a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb38 expref: 28 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762944.429805:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174108700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149047040:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762944.429889:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000075d71727/0xd08452c77c571083 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb31 expref: 28 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762944.429901:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149047168:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762944.429942:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bb05363b/0xd08452c77c57107c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb2a expref: 28 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762944.429955:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174109180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149047296:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762944.430001:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000875d9e09/0xd08452c77c571067 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb15 expref: 28 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762944.430014:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174108380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149047424:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762944.430054:0:5797:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d04558d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789762944.436457:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149045888:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762944.436470:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cda680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149046016:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762944.436481:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149046144:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762944.436491:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149046272:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762944.436497:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cdbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149046400:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762944.436502:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149046528:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789762944.436506:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cd8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:6672:1876702149046656:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789762944.436528:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762944.436551:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+27:2345:x1876702140848128:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 7983us (8079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762944.436557:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:1.0:1789762944.440240:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17410bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149046784:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762944.440258:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17410a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149046912:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762944.440266:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174108700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149047040:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762944.440275:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149047168:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762944.440283:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174109180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149047296:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789762944.440291:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174108380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876702149047424:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789762944.440321:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762944.440379:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+28:2342:x1876702140848256:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 10968us (11106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762944.440390:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:1.0:1789762944.476140:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762944.476188:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140848384 00000100:00100000:3.0:1789762944.476199:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140848384 00002000:00100000:3.0:1789762944.476239:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x13:0x0] (0->1048575) req@ffff95d174108380 x1876702140848384/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762944.476248:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174108380 with x1876702140848384 ext(0->1048575) 00002000:00010000:3.0:1789762944.476252:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d174108380 00000100:00100000:3.0:1789762944.476268:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318064991066 time 318065049418 state 0x0 ref 1 00000100:00100000:3.0:1789762944.476275:0:6661:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x2, head sequence 8: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318064991066 time 318065049418 state 0x0 ref 1 00000100:00100000:3.0:1789762944.476300:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 3 deadline 348999458874 time 348949458874 state 0x1 ref 1 00000100:00100000:1.0:1789762944.483522:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 349056677199 time 348956677199 state 0x1 ref 8 00000100:00100000:1.0:1789762944.483540:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+27:2345:x1876702140844288:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:2.0:1789762944.489678:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+29:2345:x1876702140844288:12345-192.168.203.31@tcp:4:dd.500 Request processed in 6139us (378968us total) trans 4294967918 rc 0/0 00000100:00100000:2.0:1789762944.489686:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 705 00002000:00100000:2.0:1789762944.489694:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x12:0x0] (4194304->5242879) req@ffff95d174786300 x1876702140844288/t4294967918(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762944.489701:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174786300 with x1876702140844288 ext(4194304->5242879) 00002000:00010000:2.0:1789762944.489712:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d174786300 00000100:00100000:2.0:1789762944.489736:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 348999458874 time 348962897830 state 0x0 ref 1 00000100:00100000:2.0:1789762944.489747:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+28:2344:x1876702140848384:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:2.0:1789762944.492142:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+30:2344:x1876702140848384:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2394us (16012us total) trans 4294967919 rc 0/0 00000100:00100000:2.0:1789762944.492150:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 713 00000100:00100000:2.0:1789762944.492157:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 348999458874 time 348962897830 state 0x2 ref 0 00002000:00100000:2.0:1789762944.492165:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x13:0x0] (0->1048575) req@ffff95d174108380 x1876702140848384/t4294967919(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762944.492172:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174108380 with x1876702140848384 ext(0->1048575) 00002000:00010000:2.0:1789762944.492176:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d174108380 00000100:00100000:3.0:1789762944.521685:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.521741:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140848512 00000100:00100000:0.0:1789762944.521751:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140848512 00002000:00100000:0.0:1789762944.521791:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x13:0x0] (7340032->8388607) req@ffff95d1522fd880 x1876702140848512/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762944.521800:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fd880 with x1876702140848512 ext(7340032->8388607) 00002000:00010000:0.0:1789762944.521805:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fd880 00000100:00100000:0.0:1789762944.521819:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 348999458874 time 348962897830 state 0x0 ref 1 00000100:00100000:0.0:1789762944.521849:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 349012897830 time 348962897830 state 0x1 ref 1 00000100:00100000:1.0:1789762944.539884:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 349012897830 time 349013035702 state 0x0 ref 1 00000100:00100000:1.0:1789762944.539906:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+30:2343:x1876702140848512:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762944.542671:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+32:2343:x1876702140848512:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2769us (20993us total) trans 4294967920 rc 0/0 00000100:00100000:1.0:1789762944.542681:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 714 00000100:00100000:1.0:1789762944.542698:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 349012897830 time 349013035702 state 0x2 ref 0 00002000:00100000:1.0:1789762944.542712:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x13:0x0] (7340032->8388607) req@ffff95d1522fd880 x1876702140848512/t4294967920(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762944.542724:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fd880 with x1876702140848512 ext(7340032->8388607) 00002000:00010000:1.0:1789762944.542730:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fd880 00000100:00100000:3.0:1789762944.547038:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762944.547083:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762944.547101:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140848640 00000100:00100000:2.0:1789762944.547109:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140848640 00000100:00100000:0.0:1789762944.547131:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140848768 00000100:00100000:0.0:1789762944.547137:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140848768 00002000:00100000:2.0:1789762944.547142:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x13:0x0] (6291456->7340031) req@ffff95d1522fce00 x1876702140848640/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762944.547151:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fce00 with x1876702140848640 ext(6291456->7340031) 00002000:00010000:2.0:1789762944.547155:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fce00 00002000:00100000:0.0:1789762944.547163:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x13:0x0] (5242880->6291455) req@ffff95d1522fed80 x1876702140848768/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789762944.547173:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 349012897830 time 349013035702 state 0x0 ref 1 00002000:00100000:0.0:1789762944.547187:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fed80 with x1876702140848768 ext(5242880->6291455) 00000100:00100000:2.0:1789762944.547191:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 349063035702 time 349013035702 state 0x1 ref 1 00002000:00010000:0.0:1789762944.547201:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fed80 00000100:00100000:0.0:1789762944.547214:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 349063035702 time 349013035702 state 0x1 ref 2 00000100:00100000:0.0:1789762944.553991:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762944.554076:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140848896 00000100:00100000:3.0:1789762944.554082:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140848896 00002000:00100000:3.0:1789762944.554110:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (5242880->6291455) req@ffff95d044e53800 x1876702140848896/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762944.554121:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d044e53800 with x1876702140848896 ext(5242880->6291455) 00002000:00010000:3.0:1789762944.554125:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d044e53800 00000100:00100000:3.0:1789762944.554138:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 349063035702 time 349013035702 state 0x1 ref 3 00000100:00100000:2.0:1789762944.556155:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762944.556212:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140849024 00000100:00100000:1.0:1789762944.556218:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140849024 00002000:00100000:1.0:1789762944.556244:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xd:0x0] (6291456->7340031) req@ffff95d147cd8a80 x1876702140849024/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762944.556254:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147cd8a80 with x1876702140849024 ext(6291456->7340031) 00002000:00010000:1.0:1789762944.556258:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d147cd8a80 00000100:00100000:1.0:1789762944.556271:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 349063035702 time 349013035702 state 0x1 ref 4 00000100:00100000:3.0:1789762944.559660:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762944.559737:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140849152 00000100:00100000:2.0:1789762944.559743:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140849152 00002000:00100000:2.0:1789762944.559762:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xd:0x0] (7340032->8388607) req@ffff95d1742bd180 x1876702140849152/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762944.559770:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1742bd180 with x1876702140849152 ext(7340032->8388607) 00002000:00010000:2.0:1789762944.559773:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1742bd180 00000100:00100000:2.0:1789762944.559782:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 349063035702 time 349013035702 state 0x1 ref 5 00000100:00100000:0.0:1789762944.560745:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762944.560788:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140849280 00000100:00100000:3.0:1789762944.560794:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140849280 00002000:00100000:3.0:1789762944.560816:0:14626:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xd:0x0] (1048576->2097151) req@ffff95d043211880 x1876702140849280/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762944.560826:0:14626:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d043211880 with x1876702140849280 ext(1048576->2097151) 00002000:00010000:3.0:1789762944.560830:0:14626:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d043211880 00000100:00100000:3.0:1789762944.560860:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 349063035702 time 349013035702 state 0x1 ref 6 00000100:00100000:2.0:1789762944.563019:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762944.563070:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140849408 00000100:00100000:1.0:1789762944.563076:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140849408 00002000:00100000:1.0:1789762944.563101:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x13:0x0] (1048576->2097151) req@ffff95d147cd9880 x1876702140849408/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762944.563112:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147cd9880 with x1876702140849408 ext(1048576->2097151) 00002000:00010000:1.0:1789762944.563116:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147cd9880 00000100:00100000:1.0:1789762944.563129:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 349063035702 time 349013035702 state 0x1 ref 7 00000100:00100000:3.0:1789762944.568022:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762944.568047:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762944.568073:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140849536 00000100:00100000:2.0:1789762944.568079:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140849536 00002000:00100000:2.0:1789762944.568099:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x13:0x0] (4194304->5242879) req@ffff95d1742bca80 x1876702140849536/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1789762944.568106:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140849664 00002000:00100000:2.0:1789762944.568107:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1742bca80 with x1876702140849536 ext(4194304->5242879) 00002000:00010000:2.0:1789762944.568113:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1742bca80 00000100:00100000:1.0:1789762944.568115:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140849664 00000100:00100000:2.0:1789762944.568124:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 349063035702 time 349013035702 state 0x1 ref 8 00002000:00100000:1.0:1789762944.568144:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x13:0x0] (3145728->4194303) req@ffff95d1742be300 x1876702140849664/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762944.568168:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1742be300 with x1876702140849664 ext(3145728->4194303) 00002000:00010000:1.0:1789762944.568173:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1742be300 00000100:00100000:1.0:1789762944.568185:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 2 deadline 349063035702 time 349013035702 state 0x1 ref 9 00000100:00100000:0.0:1789762944.583611:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 349156767275 time 349056767275 state 0x1 ref 7 00000100:00100000:0.0:1789762944.583626:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+36:2344:x1876702140844416:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762944.586501:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+38:2344:x1876702140844416:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2876us (469310us total) trans 4294967921 rc 0/0 00000100:00100000:1.0:1789762944.586509:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 706 00002000:00100000:1.0:1789762944.586516:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x12:0x0] (5242880->6291455) req@ffff95d174786a00 x1876702140844416/t4294967921(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762944.586525:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174786a00 with x1876702140844416 ext(5242880->6291455) 00002000:00010000:1.0:1789762944.586528:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d174786a00 00000100:00100000:1.0:1789762944.586549:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 1 deadline 349109710135 time 349059710135 state 0x1 ref 9 00000100:00100000:1.0:1789762944.586558:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+37:2342:x1876702140848640:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762944.588811:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+39:2342:x1876702140848640:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2252us (41775us total) trans 4294967922 rc 0/0 00000100:00100000:1.0:1789762944.588817:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 715 00002000:00100000:1.0:1789762944.588823:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x13:0x0] (6291456->7340031) req@ffff95d1522fce00 x1876702140848640/t4294967922(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762944.588829:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fce00 with x1876702140848640 ext(6291456->7340031) 00002000:00010000:1.0:1789762944.588850:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fce00 00000100:00100000:1.0:1789762944.588875:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 0 deadline 349112036594 time 349062036594 state 0x1 ref 8 00000100:00100000:1.0:1789762944.588895:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+38:2342:x1876702140848768:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762944.590964:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+40:2342:x1876702140848768:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2070us (43879us total) trans 4294967923 rc 0/0 00000100:00100000:1.0:1789762944.590970:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 716 00002000:00100000:1.0:1789762944.590977:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x13:0x0] (5242880->6291455) req@ffff95d1522fed80 x1876702140848768/t4294967923(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762944.590984:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fed80 with x1876702140848768 ext(5242880->6291455) 00002000:00010000:1.0:1789762944.590987:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522fed80 00000100:00100000:1.0:1789762944.638929:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 0 deadline 349162080637 time 349112080637 state 0x1 ref 7 00000100:00100000:1.0:1789762944.638947:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+31:2344:x1876702140848896:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762944.641599:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+33:2344:x1876702140848896:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2652us (87606us total) trans 4294967405 rc 0/0 00000100:00100000:1.0:1789762944.641609:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 717 00002000:00100000:1.0:1789762944.641620:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xd:0x0] (5242880->6291455) req@ffff95d044e53800 x1876702140848896/t4294967405(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762944.641632:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d044e53800 with x1876702140848896 ext(5242880->6291455) 00002000:00010000:1.0:1789762944.641638:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d044e53800 00000100:00100000:0.0:1789762944.645220:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762944.645249:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762944.645261:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140850048 00000100:00100000:3.0:1789762944.645269:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140850048 00000100:00100000:0.0:1789762944.645281:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762944.645302:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140849792 00000100:00100000:2.0:1789762944.645309:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140849792 00000100:00100000:3.0:1789762944.645313:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:3.0:1789762944.645323:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15177e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+17:13983:x1876702140850048:12345-192.168.203.31@tcp:35:dd.0 00002000:00100000:2.0:1789762944.645351:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xd:0x0] (3145728->4194303) req@ffff95d043213b80 x1876702140849792/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762944.645361:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d043213b80 with x1876702140849792 ext(3145728->4194303) 00002000:00010000:2.0:1789762944.645365:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d043213b80 00000100:00100000:1.0:1789762944.645376:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140850176 00000100:00100000:2.0:1789762944.645382:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 0 deadline 349162080637 time 349112080637 state 0x1 ref 7 00000100:00100000:1.0:1789762944.645384:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140850176 00002000:00100000:1.0:1789762944.645412:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xd:0x0] (4194304->5242879) req@ffff95d043211180 x1876702140850176/t0(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/0 e 0 to 0 dl 1789762955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762944.645433:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d043211180 with x1876702140850176 ext(4194304->5242879) 00002000:00010000:1.0:1789762944.645437:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d043211180 00000100:00100000:1.0:1789762944.645446:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 0 deadline 349162080637 time 349112080637 state 0x1 ref 8 00000001:00080000:3.0:1789762944.645524:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967537 00000100:00100000:3.0:1789762944.645588:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15177e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+19:13983:x1876702140850048:12345-192.168.203.31@tcp:35:dd.0 Request processed in 268us (369us total) trans 4294967538 rc 0/0 00000100:00100000:3.0:1789762944.645595:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000020:00080000:3.0:1789762944.645599:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789762944.683720:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 349256869212 time 349156869212 state 0x1 ref 6 00000100:00100000:3.0:1789762944.683740:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140844544:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:3.0:1789762944.686696:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+41:2344:x1876702140844544:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2961us (562799us total) trans 4294967924 rc 0/0 00000100:00100000:3.0:1789762944.686704:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 707 00002000:00100000:3.0:1789762944.686712:0:14626:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x12:0x0] (6291456->7340031) req@ffff95d1522ff100 x1876702140844544/t4294967924(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762944.686730:0:14626:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522ff100 with x1876702140844544 ext(6291456->7340031) 00002000:00010000:3.0:1789762944.686735:0:14626:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1522ff100 00000100:00100000:1.0:1789762944.689011:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 0 deadline 349212169159 time 349162169159 state 0x1 ref 8 00000100:00100000:1.0:1789762944.689025:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+34:2345:x1876702140849024:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762944.691526:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+36:2345:x1876702140849024:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2502us (135370us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789762944.691533:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 718 00002000:00100000:1.0:1789762944.691540:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (6291456->7340031) req@ffff95d147cd8a80 x1876702140849024/t4294967406(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762944.691547:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147cd8a80 with x1876702140849024 ext(6291456->7340031) 00002000:00010000:1.0:1789762944.691551:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d147cd8a80 00000100:00100000:1.0:1789762944.739092:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 0 deadline 349262231163 time 349212231163 state 0x1 ref 7 00000100:00100000:1.0:1789762944.739117:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+35:2344:x1876702140849152:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762944.741914:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+37:2344:x1876702140849152:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2801us (182253us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1789762944.741922:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 719 00002000:00100000:1.0:1789762944.741931:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xd:0x0] (7340032->8388607) req@ffff95d1742bd180 x1876702140849152/t4294967407(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762944.741950:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1742bd180 with x1876702140849152 ext(7340032->8388607) 00002000:00010000:1.0:1789762944.741955:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1742bd180 00000100:00100000:2.0:1789762944.783804:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 349356948300 time 349256948300 state 0x1 ref 5 00000100:00100000:2.0:1789762944.783862:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+40:2345:x1876702140844672:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762944.790660:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+42:2345:x1876702140844672:12345-192.168.203.31@tcp:4:dd.500 Request processed in 6821us (660345us total) trans 4294967925 rc 0/0 00000100:00100000:1.0:1789762944.790669:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 708 00002000:00100000:1.0:1789762944.790679:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x12:0x0] (7340032->8388607) req@ffff95d174785f80 x1876702140844672/t4294967925(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762944.790687:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174785f80 with x1876702140844672 ext(7340032->8388607) 00002000:00010000:1.0:1789762944.790693:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d174785f80 00000100:00100000:1.0:1789762944.790720:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 0 deadline 349313880098 time 349263880098 state 0x1 ref 6 00000100:00100000:1.0:1789762944.790732:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+36:2342:x1876702140849280:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762944.793089:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+38:2342:x1876702140849280:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2359us (232345us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789762944.793095:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 720 00002000:00100000:1.0:1789762944.793101:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xd:0x0] (1048576->2097151) req@ffff95d043211880 x1876702140849280/t4294967408(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762944.793108:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d043211880 with x1876702140849280 ext(1048576->2097151) 00002000:00010000:1.0:1789762944.793111:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d043211880 00000100:00100000:0.0:1789762944.840848:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 0 deadline 349363981033 time 349313981033 state 0x1 ref 5 00000100:00100000:0.0:1789762944.840870:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+41:2343:x1876702140849408:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762944.843685:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+43:2343:x1876702140849408:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2818us (280664us total) trans 4294967926 rc 0/0 00000100:00100000:0.0:1789762944.843693:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 721 00002000:00100000:0.0:1789762944.843701:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x13:0x0] (1048576->2097151) req@ffff95d147cd9880 x1876702140849408/t4294967926(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762944.843709:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d147cd9880 with x1876702140849408 ext(1048576->2097151) 00002000:00010000:0.0:1789762944.843714:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d147cd9880 00000100:00100000:1.0:1789762944.883886:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 349457035570 time 349357035570 state 0x1 ref 4 00000100:00100000:1.0:1789762944.883906:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+37:2344:x1876702140844800:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762944.886449:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140844800:12345-192.168.203.31@tcp:4:dd.500 Request processed in 2547us (697780us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1789762944.886457:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 709 00002000:00100000:1.0:1789762944.886467:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc:0x0] (4194304->5242879) req@ffff95d1522fdc00 x1876702140844800/t4294967409(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762944.886475:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fdc00 with x1876702140844800 ext(4194304->5242879) 00002000:00010000:1.0:1789762944.886480:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1522fdc00 00000100:00100000:2.0:1789762944.890937:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 0 deadline 349414090998 time 349364090998 state 0x1 ref 4 00000100:00100000:2.0:1789762944.890954:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+42:2342:x1876702140849536:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762944.893201:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+44:2342:x1876702140849536:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2249us (325179us total) trans 4294967927 rc 0/0 00000100:00100000:1.0:1789762944.893209:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 722 00002000:00100000:1.0:1789762944.893216:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x13:0x0] (4194304->5242879) req@ffff95d1742bca80 x1876702140849536/t4294967927(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762944.893224:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1742bca80 with x1876702140849536 ext(4194304->5242879) 00002000:00010000:1.0:1789762944.893228:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1742bca80 00000100:00100000:3.0:1789762944.941158:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 0 deadline 349464286339 time 349414286339 state 0x1 ref 3 00000100:00100000:3.0:1789762944.941205:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+43:2342:x1876702140849664:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:0.0:1789762944.945668:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+45:2342:x1876702140849664:12345-192.168.203.31@tcp:4:dd.0 Request processed in 4471us (377607us total) trans 4294967928 rc 0/0 00000100:00100000:0.0:1789762944.945702:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 723 00002000:00100000:0.0:1789762944.945721:0:14626:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x13:0x0] (3145728->4194303) req@ffff95d1742be300 x1876702140849664/t4294967928(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762944.945736:0:14626:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1742be300 with x1876702140849664 ext(3145728->4194303) 00002000:00010000:0.0:1789762944.945746:0:14626:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d1742be300 00000100:00100000:1.0:1789762944.984026:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 349557172182 time 349457172182 state 0x1 ref 3 00000100:00100000:1.0:1789762944.984053:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+38:2345:x1876702140844928:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762944.987427:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+40:2345:x1876702140844928:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3380us (792779us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789762944.987439:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 710 00002000:00100000:0.0:1789762944.987452:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (5242880->6291455) req@ffff95d174785c00 x1876702140844928/t4294967410(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762944.987465:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174785c00 with x1876702140844928 ext(5242880->6291455) 00002000:00010000:0.0:1789762944.987471:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174785c00 00000100:00100000:1.0:1789762944.991220:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 0 deadline 349514376705 time 349464376705 state 0x1 ref 2 00000100:00100000:1.0:1789762944.991236:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+39:2342:x1876702140849792:12345-192.168.203.31@tcp:4:dd.0 00000100:00100000:1.0:1789762944.994297:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+41:2342:x1876702140849792:12345-192.168.203.31@tcp:4:dd.0 Request processed in 3062us (349045us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789762944.994320:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 724 00002000:00100000:1.0:1789762944.994330:0:11722:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xd:0x0] (3145728->4194303) req@ffff95d043213b80 x1876702140849792/t4294967411(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762944.994364:0:11722:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d043213b80 with x1876702140849792 ext(3145728->4194303) 00002000:00010000:1.0:1789762944.994371:0:11722:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d043213b80 00000100:00100000:1.0:1789762945.041279:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 0 deadline 349514376705 time 349514428971 state 0x0 ref 1 00000100:00100000:1.0:1789762945.041311:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+40:2342:x1876702140850176:12345-192.168.203.31@tcp:4:dd.0 00000100:00080000:0.0:1789762945.041350:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762945.044291:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+42:2342:x1876702140850176:12345-192.168.203.31@tcp:4:dd.0 Request processed in 2997us (399008us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789762945.044298:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 725 00000100:00100000:1.0:1789762945.044306:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173ccb000 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9a00 gen 0 rate 20 depth 3 token 0 deadline 349514376705 time 349514428971 state 0x2 ref 0 00002000:00100000:1.0:1789762945.044316:0:11723:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xd:0x0] (4194304->5242879) req@ffff95d043211180 x1876702140850176/t4294967412(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762945.044324:0:11723:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d043211180 with x1876702140850176 ext(4194304->5242879) 00002000:00010000:1.0:1789762945.044329:0:11723:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d043211180 00010000:00010000:3.0:1789762945.062963:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762945.084120:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 349657269356 time 349557269356 state 0x1 ref 2 00000100:00100000:0.0:1789762945.084142:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+41:2345:x1876702140845056:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:0.0:1789762945.087186:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+43:2345:x1876702140845056:12345-192.168.203.31@tcp:4:dd.500 Request processed in 3050us (797842us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789762945.087195:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 711 00002000:00100000:0.0:1789762945.087205:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (6291456->7340031) req@ffff95d1522fc000 x1876702140845056/t4294967413(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762945.087213:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d1522fc000 with x1876702140845056 ext(6291456->7340031) 00002000:00010000:0.0:1789762945.087228:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d1522fc000 00000100:00100000:1.0:1789762945.184202:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 349657269356 time 349657349154 state 0x0 ref 1 00000100:00100000:1.0:1789762945.184223:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+42:2345:x1876702140845184:12345-192.168.203.31@tcp:4:dd.500 00000100:00100000:1.0:1789762945.190686:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+44:2345:x1876702140845184:12345-192.168.203.31@tcp:4:dd.500 Request processed in 6466us (888493us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789762945.190704:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 712 00000100:00100000:1.0:1789762945.190712:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 349657269356 time 349657349154 state 0x2 ref 0 00002000:00100000:1.0:1789762945.190723:0:13229:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc:0x0] (7340032->8388607) req@ffff95d174787800 x1876702140845184/t4294967414(0) o4->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:725/0 lens 488/448 e 0 to 0 dl 1789762955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762945.190731:0:13229:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d174787800 with x1876702140845184 ext(7340032->8388607) 00002000:00010000:1.0:1789762945.190737:0:13229:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d174787800 00000100:00100000:3.0:1789762945.224681:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762945.224726:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762945.224749:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140850304 00000100:00100000:0.0:1789762945.224758:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140850304 00000100:00100000:2.0:1789762945.224786:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140850432 00000100:00100000:2.0:1789762945.224792:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140850432 00000100:00100000:0.0:1789762945.224828:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1789762945.224861:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+44:5571:x1876702140850304:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789762945.224865:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00010000:00010000:0.0:1789762945.224877:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 7 locks, starting at 0 00000100:00100000:3.0:1789762945.224883:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+45:6029:x1876702140850432:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00080000:1.0:1789762945.224889:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789762945.224899:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb size from disk: 0 -> 8388608 00010000:00010000:3.0:1789762945.224899:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 8 locks, starting at 0 00002000:00010000:0.0:1789762945.224905:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb mtime from disk: 0 -> 1789762943 00002000:00010000:0.0:1789762945.224907:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb ctime from disk: 0 -> 1789762943 00002000:00010000:3.0:1789762945.224915:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:3.0:1789762945.224921:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb mtime from disk: 0 -> 1789762943 00002000:00010000:3.0:1789762945.224924:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb ctime from disk: 0 -> 1789762943 00010000:00010000:0.0:1789762945.224927:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d69de3a/0xd08452c77c571036 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb00 expref: 44 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.224940:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571028 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaf9 expref: 45 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762945.224955:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb size from disk: 3145728 -> 8388608 00002000:00010000:0.0:1789762945.224959:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb mtime from disk: 1789762943 -> 1789762944 00002000:00010000:0.0:1789762945.224961:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb ctime from disk: 1789762943 -> 1789762944 00002000:00010000:3.0:1789762945.224968:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb size from disk: 3145728 -> 8388608 00002000:00010000:3.0:1789762945.224973:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb mtime from disk: 1789762943 -> 1789762944 00010000:00010000:0.0:1789762945.224974:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033000e04/0xd08452c77c5710a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb54 expref: 43 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762945.224978:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb ctime from disk: 1789762943 -> 1789762944 00010000:00010000:3.0:1789762945.224995:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cee3f8cf/0xd08452c77c571098 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb46 expref: 44 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.224999:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f622ea79/0xd08452c77c57108a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb38 expref: 42 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.225021:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061f95ccb/0xd08452c77c57109f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb4d expref: 43 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.225024:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000875d9e09/0xd08452c77c571067 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 6 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb15 expref: 41 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.225053:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b196748/0xd08452c77c5710bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 7 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb69 expref: 42 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.225054:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075d71727/0xd08452c77c571083 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 5 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb31 expref: 40 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.225089:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d261481/0xd08452c77c5710c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb70 expref: 41 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.225095:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb05363b/0xd08452c77c57107c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb2a expref: 39 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.225125:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571091 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb3f expref: 40 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.225126:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee688a08/0xd08452c77c5710b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb62 expref: 38 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.225135:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762945.225152:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c5710ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb5b expref: 39 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.225162:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571075 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb23 expref: 38 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.225172:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762945.225183:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+37:5571:x1876702140850304:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 325us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762945.225189:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:3.0:1789762945.225196:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+37:6029:x1876702140850432:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 320us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762945.225204:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:2.0:1789762945.253963:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762945.254014:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762945.254053:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140850688 00000100:00100000:0.0:1789762945.254064:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140850944 00000100:00100000:3.0:1789762945.254064:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140850688 00000100:00100000:0.0:1789762945.254071:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140850944 00000100:00100000:0.0:1789762945.254116:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 282 00000100:00100000:0.0:1789762945.254127:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+20:14018:x1876702140850944:12345-192.168.203.31@tcp:101:dd.0 00000100:00100000:3.0:1789762945.254134:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 283 00000100:00080000:1.0:1789762945.254143:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762945.254147:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+20:14017:x1876702140850688:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789762945.254151:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762945.254157:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762945.254169:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c5710c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb7e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.254171:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894600/0xd08452c77c5710d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb77 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.254274:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c5710d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.254279:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c5710de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.254286:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c5710d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.254296:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c5710d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.254306:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c5710de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.254322:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c5710de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762945.254328:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2e:0x0]: returning size 16777216 00000004:00200000:0.0:1789762945.254356:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2e:0x0]: returning size 16777216 00010000:00010000:3.0:1789762945.254475:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894600/0xd08452c77c5710d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb77 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.254488:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98800/0xd08452c77c5710c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb7e expref: 25 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.254492:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c5710d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb77 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.254507:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff95d14abf2800) 00010000:00010000:3.0:1789762945.254509:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762945.254512:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d17a894000, rc 0) 00010000:00010000:0.0:1789762945.254516:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c5710de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb7e expref: 24 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.254523:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff95d14abf2800) 00010000:00010000:0.0:1789762945.254526:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762945.254528:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c99c00, rc 0) 00000100:00100000:3.0:1789762945.254562:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+24:14017:x1876702140850688:12345-192.168.203.31@tcp:101:dd.0 Request processed in 419us (609us total) trans 4294967539 rc 0/0 00000100:00100000:0.0:1789762945.254565:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+24:14018:x1876702140850944:12345-192.168.203.31@tcp:101:dd.0 Request processed in 440us (549us total) trans 4294967540 rc 0/0 00000100:00100000:3.0:1789762945.254574:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 283 00000100:00100000:0.0:1789762945.254581:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 282 00000100:00100000:2.0:1789762945.255053:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.255092:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140851200 00000100:00100000:1.0:1789762945.255097:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140851200 00000100:00100000:1.0:1789762945.255127:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 284 00000100:00100000:1.0:1789762945.255134:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+23:14019:x1876702140851200:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762945.255143:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762945.255151:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c5710f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb85 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.255188:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c5710fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.255196:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c5710fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.255202:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c5710fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762945.255208:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2e:0x0]: returning size 16777216 00010000:00010000:1.0:1789762945.255268:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c5710f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb85 expref: 26 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.255281:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c5710fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb85 expref: 25 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.255288:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff95d14abf2800) 00010000:00010000:1.0:1789762945.255291:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762945.255294:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140030600, rc 0) 00000100:00100000:1.0:1789762945.255329:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+25:14019:x1876702140851200:12345-192.168.203.31@tcp:101:dd.0 Request processed in 195us (276us total) trans 4294967541 rc 0/0 00000100:00100000:1.0:1789762945.255349:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 284 00000100:00100000:1.0:1789762945.255949:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.255974:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762945.256007:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140851584 00000100:00100000:1.0:1789762945.256018:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762945.256022:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140851584 00000100:00100000:2.0:1789762945.256049:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140851456 00000100:00100000:2.0:1789762945.256058:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140851456 00000100:00100000:3.0:1789762945.256066:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140851712 00000100:00100000:3.0:1789762945.256073:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140851712 00000100:00100000:0.0:1789762945.256099:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:0.0:1789762945.256113:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+27:14018:x1876702140851584:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:2.0:1789762945.256127:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1789762945.256137:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1789762945.256144:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a04a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+27:2342:x1876702140851456:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789762945.256152:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+27:2342:x1876702140851712:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762945.256160:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762945.256165:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762945.256181:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894000/0xd08452c77c5710d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb77 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.256187:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99c00/0xd08452c77c5710de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb7e expref: 27 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.256211:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff95d14abf2800) 00010000:00010000:2.0:1789762945.256217:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762945.256263:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a04a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+26:2342:x1876702140851456:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 122us (282us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762945.256272:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff95d14abf2800) 00000100:00100000:2.0:1789762945.256273:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00010000:00010000:3.0:1789762945.256280:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762945.256320:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+25:2342:x1876702140851712:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 174us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762945.256347:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762945.256357:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+25:14018:x1876702140851584:12345-192.168.203.31@tcp:35:dd.0 Request processed in 246us (404us total) trans 4294967542 rc 0/0 00000100:00100000:0.0:1789762945.256369:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:3.0:1789762945.256389:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:1.0:1789762945.256402:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140851840 00000100:00100000:1.0:1789762945.256408:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140851840 00000100:00100000:1.0:1789762945.256462:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:1.0:1789762945.256478:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+37:14017:x1876702140851840:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789762945.256487:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762945.256499:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c571108 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb8c expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762945.256516:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 8388608, mtime: 0x6aad9d7f, atime: 0x0, ctime: 0x6aad9d7f, blocks: 0x1 00010000:00010000:1.0:1789762945.256527:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1789762945.256531:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762945.256546:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c571108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb8c expref: 38 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762945.256554:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:1.0:1789762945.256560:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c571108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb8c expref: 38 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.256570:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d140031600, rc 0) 00000100:00100000:2.0:1789762945.256598:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140851968 00000100:00100000:1.0:1789762945.256604:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+38:14017:x1876702140851840:12345-192.168.203.31@tcp:101:dd.0 Request processed in 132us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762945.256606:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140851968 00000100:00100000:1.0:1789762945.256611:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:2.0:1789762945.256658:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:2.0:1789762945.256668:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+24:2345:x1876702140851968:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762945.256679:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762945.256692:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c5710fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb85 expref: 24 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.256707:0:6672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff95d14abf2800) 00010000:00010000:2.0:1789762945.256712:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762945.256756:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:77777931-b235-4c03-82d2-4b1d12553008+23:2345:x1876702140851968:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 90us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762945.256765:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:3.0:1789762945.257262:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762945.257311:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762945.257348:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140852096 00000100:00100000:0.0:1789762945.257356:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140852096 00000100:00100000:1.0:1789762945.257359:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140852352 00000100:00100000:1.0:1789762945.257365:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140852352 00000100:00100000:0.0:1789762945.257403:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:1.0:1789762945.257411:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:0.0:1789762945.257419:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+38:14018:x1876702140852096:12345-192.168.203.31@tcp:101:dd.0 00000100:00100000:1.0:1789762945.257429:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+23:14019:x1876702140852352:12345-192.168.203.31@tcp:35:dd.0 00010000:00010000:0.0:1789762945.257432:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762945.257461:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57110f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb93 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.257483:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762945.257487:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762945.257495:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57110f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb93 expref: 39 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.257508:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57110f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb93 expref: 39 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.257519:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c98600, rc 0) 00000100:00100000:0.0:1789762945.257566:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+39:14018:x1876702140852096:12345-192.168.203.31@tcp:101:dd.0 Request processed in 153us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762945.257568:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+24:14019:x1876702140852352:12345-192.168.203.31@tcp:35:dd.0 Request processed in 144us (253us total) trans 4294967543 rc 0/0 00000100:00100000:0.0:1789762945.257590:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:1.0:1789762945.257598:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:0.0:1789762945.260493:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.260534:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140852480 00000100:00100000:1.0:1789762945.260539:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140852480 00002000:00100000:1.0:1789762945.260564:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x12:0x0] (0->1048575) req@ffff95d16ffd6a00 x1876702140852480/t0(0) o3->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:726/0 lens 488/0 e 0 to 0 dl 1789762956 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762945.260572:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffd6a00 with x1876702140852480 ext(0->1048575) 00002000:00010000:1.0:1789762945.260575:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffd6a00 00000100:00100000:1.0:1789762945.260588:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318443789825 time 318443716332 state 0x0 ref 1 00000100:00100000:1.0:1789762945.260595:0:6660:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x2, head sequence 8: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d044b75e00 gen 0 rate 10000 depth 3 token 2 deadline 318443789825 time 318443716332 state 0x0 ref 1 00000100:00100000:1.0:1789762945.260614:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 3 deadline 349833774616 time 349733774616 state 0x1 ref 1 00000100:00100000:1.0:1789762945.260637:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 349833774616 time 349733799834 state 0x0 ref 1 00000100:00100000:1.0:1789762945.260645:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140852480:12345-192.168.203.31@tcp:3:dd.0 00000100:00100000:1.0:1789762945.264519:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140852480:12345-192.168.203.31@tcp:3:dd.0 Request processed in 3870us (4024us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762945.264529:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 726 00000100:00100000:1.0:1789762945.264539:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d043224c00 key jobid={dd.0}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 349833774616 time 349733799834 state 0x2 ref 0 00002000:00100000:1.0:1789762945.264552:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x12:0x0] (0->1048575) req@ffff95d16ffd6a00 x1876702140852480/t0(0) o3->77777931-b235-4c03-82d2-4b1d12553008@192.168.203.31@tcp:726/0 lens 488/440 e 0 to 0 dl 1789762956 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762945.264562:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d16ffd6a00 with x1876702140852480 ext(0->1048575) 00002000:00010000:1.0:1789762945.264566:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d16ffd6a00 00000100:00100000:0.0:1789762945.290358:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762945.290428:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140852736 00000100:00100000:2.0:1789762945.290441:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140852736 00000100:00100000:2.0:1789762945.290492:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:2.0:1789762945.290502:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+24:14031:x1876702140852736:12345-192.168.203.31@tcp:35:dd.0 00000100:00100000:2.0:1789762945.290691:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+25:14031:x1876702140852736:12345-192.168.203.31@tcp:35:dd.0 Request processed in 191us (343us total) trans 4294967544 rc 0/0 00000100:00100000:2.0:1789762945.290696:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:3.0:1789762945.299755:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762945.299831:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140852864 00000100:00100000:2.0:1789762945.299857:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140852864 00000100:00100000:2.0:1789762945.299898:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 285 00000100:00100000:2.0:1789762945.299910:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+25:14033:x1876702140852864:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789762945.299924:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762945.299941:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c571116 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eb9a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.300002:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c57111d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.300016:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c57111d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.300028:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c57111d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762945.300054:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 16384 00000004:00200000:2.0:1789762945.300057:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762945.300069:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c57111d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.300087:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c571116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb9a expref: 27 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.300102:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c57111d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb9a expref: 26 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.300108:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d151e90300) 00010000:00010000:2.0:1789762945.300110:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762945.300112:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d144cf6600, rc 0) 00000100:00100000:2.0:1789762945.300142:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+26:14033:x1876702140852864:12345-192.168.203.31@tcp:101:rm.0 Request processed in 237us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762945.300147:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 285 00000100:00100000:0.0:1789762945.301525:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762945.301578:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140853120 00000100:00100000:3.0:1789762945.301585:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140853120 00000100:00100000:3.0:1789762945.301617:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 286 00000100:00100000:3.0:1789762945.301626:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+26:14033:x1876702140853120:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1789762945.301634:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762945.301643:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eba1 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762945.301686:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 16384 00010000:00010000:3.0:1789762945.301741:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571124 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eba1 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.301750:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:3.0:1789762945.301752:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762945.301755:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eba1 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.301763:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d160192000, rc 0) 00000100:00100000:3.0:1789762945.301795:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+27:14033:x1876702140853120:12345-192.168.203.31@tcp:101:rm.0 Request processed in 171us (273us total) trans 4294967545 rc 301/301 00000100:00100000:3.0:1789762945.301800:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 286 00000100:00100000:0.0:1789762945.303215:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.303256:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140853248 00000100:00100000:1.0:1789762945.303261:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140853248 00000100:00100000:1.0:1789762945.303288:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:1.0:1789762945.303294:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+27:14033:x1876702140853248:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:1.0:1789762945.305066:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+27:14033:x1876702140853248:12345-192.168.203.31@tcp:37:rm.0 Request processed in 1768us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762945.305076:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:0.0:1789762945.306310:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762945.306379:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140853504 00000100:00100000:2.0:1789762945.306385:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140853504 00000100:00100000:2.0:1789762945.306425:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:2.0:1789762945.306431:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+27:14033:x1876702140853504:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:2.0:1789762945.306520:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+28:14033:x1876702140853504:12345-192.168.203.31@tcp:35:rm.0 Request processed in 89us (210us total) trans 4294967546 rc 0/0 00000100:00100000:2.0:1789762945.306525:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:0.0:1789762945.307285:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762945.307321:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140853760 00000100:00100000:3.0:1789762945.307326:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140853760 00000100:00100000:3.0:1789762945.307369:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 287 00000100:00100000:3.0:1789762945.307385:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+28:14033:x1876702140853760:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1789762945.307397:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762945.307406:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192a00/0xd08452c77c571132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7eba8 expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.307446:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160193400/0xd08452c77c571139 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.307454:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d160193400/0xd08452c77c571139 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.307460:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d160193400/0xd08452c77c571139 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762945.307465:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 16384 00010000:00010000:3.0:1789762945.307505:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192a00/0xd08452c77c571132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eba8 expref: 31 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.307515:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160193400/0xd08452c77c571139 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eba8 expref: 30 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.307521:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d151e90300) 00010000:00010000:3.0:1789762945.307523:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789762945.307524:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d160193400, rc 0) 00000100:00100000:3.0:1789762945.307553:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+30:14033:x1876702140853760:12345-192.168.203.31@tcp:101:rm.0 Request processed in 170us (271us total) trans 4294967547 rc 0/0 00000100:00100000:3.0:1789762945.307557:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 287 00000100:00100000:0.0:1789762945.308368:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.308408:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140853888 00000100:00100000:1.0:1789762945.308413:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140853888 00000100:00100000:1.0:1789762945.308446:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 288 00000100:00100000:1.0:1789762945.308451:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16019b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+30:14033:x1876702140853888:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:1.0:1789762945.308481:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789762945.308513:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16019b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+30:14033:x1876702140853888:12345-192.168.203.31@tcp:41:rm.0 Request processed in 62us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762945.308518:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 288 00000100:00100000:0.0:1789762945.309450:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.309492:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140854144 00000100:00100000:1.0:1789762945.309496:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140854144 00000100:00100000:1.0:1789762945.309523:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 289 00000100:00100000:1.0:1789762945.309531:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d160198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+30:14033:x1876702140854144:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:1.0:1789762945.309555:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789762945.309569:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030a00/0xd08452c77c57101a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaf2 expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.309584:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff95d14abf2800) 00010000:00010000:1.0:1789762945.309595:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c57111d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb9a expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.309602:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d151e90300) 00010000:00010000:1.0:1789762945.309604:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762945.309613:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c571147 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.309619:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c571147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.309624:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c571147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.309642:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c57114e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.309648:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c57114e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.309652:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c57114e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.309701:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571155 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.309706:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.309710:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789762945.310158:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].18, 64 off9344 00000004:00080000:1.0:1789762945.310165:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349783330565ns, next at 350783328915ns, rc = 0 00000040:00080000:1.0:1789762945.310224:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].12, 64 off8960 00000004:00080000:1.0:1789762945.310229:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349783395866ns, next at 350783394960ns, rc = 0 00010000:00010000:1.0:1789762945.310266:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c57115c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310273:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c57115c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310279:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c57115c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310291:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c57115c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310296:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c57115c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310300:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c57115c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310315:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762945.310327:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310347:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571155 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.310352:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762945.310354:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571155 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.310358:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c57115c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310360:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762945.310364:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571155 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.310372:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762945.310374:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571155 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.310376:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c57115c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310385:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff95d14abf2b00) 00010000:00010000:3.0:1789762945.310385:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c57115c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310388:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762945.310392:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571155 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.310395:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff95d14abf2b00) 00010000:00010000:3.0:1789762945.310397:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789762945.310401:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c57115c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.310408:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030800/0xd08452c77c57115c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310409:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031200/0xd08452c77c571155 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.310423:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762945.310425:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762945.310426:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c571147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.310427:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762945.310432:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c571147 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310439:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c571147 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310445:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762945.310448:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c571147 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310454:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c571147 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310460:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d151e90300) 00010000:00010000:1.0:1789762945.310461:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762945.310463:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c571147 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.310467:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030200/0xd08452c77c571147 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762945.310475:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007200ed57 reply state 00000000e5542b82 transno 4294967548 ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c57114e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762945.310480:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762945.310520:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d160198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+30:14033:x1876702140854144:12345-192.168.203.31@tcp:36:rm.0 Request processed in 990us (1070us total) trans 4294967548 rc 0/0 00000100:00100000:1.0:1789762945.310525:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 289 00010000:00010000:1.0:1789762945.311177:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c57114e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.311183:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c57114e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.311187:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c57114e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.311190:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140031800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762945.311192:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c57114e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.311197:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c57114e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.311203:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0xf4d4877e (ffff95d14abf2600) 00010000:00010000:1.0:1789762945.311205:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762945.311207:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c57114e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.311210:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140031800/0xd08452c77c57114e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0xf4d4877e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762945.312309:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.312387:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140854400 00000100:00100000:1.0:1789762945.312393:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140854400 00000100:00100000:1.0:1789762945.312424:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 290 00000100:00100000:1.0:1789762945.312431:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+29:14033:x1876702140854400:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:1.0:1789762945.312461:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762945.312473:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d17a894e00/0xd08452c77c571052 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb07 expref: 29 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312483:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff95d15055d300) 00010000:00010000:1.0:1789762945.312489:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762945.312496:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c571163 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312503:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c571163 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312508:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c571163 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312516:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c57116a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312521:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c57116a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312525:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c57116a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312568:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6200/0xd08452c77c571171 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312574:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6200/0xd08452c77c571171 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312579:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6200/0xd08452c77c571171 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789762945.312807:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 64 off9024 00000040:00080000:1.0:1789762945.312818:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].19, 64 off9408 00010000:00010000:1.0:1789762945.312873:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6800/0xd08452c77c571178 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312880:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6800/0xd08452c77c571178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312886:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6800/0xd08452c77c571178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312890:0:7603:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6800/0xd08452c77c571178 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312894:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6800/0xd08452c77c571178 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312898:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6800/0xd08452c77c571178 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312910:0:7603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762945.312917:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6200/0xd08452c77c571171 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312921:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6200/0xd08452c77c571171 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312925:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6200/0xd08452c77c571171 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312928:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762945.312931:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6200/0xd08452c77c571171 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.312933:0:6671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762945.312942:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6800/0xd08452c77c571178 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312944:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6200/0xd08452c77c571171 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.312959:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762945.312965:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6800/0xd08452c77c571178 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.312966:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:1.0:1789762945.312973:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762945.312982:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6200/0xd08452c77c571171 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.312982:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6800/0xd08452c77c571178 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.313002:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6200/0xd08452c77c571171 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.313004:0:6671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff95d14abf2400) 00010000:00010000:2.0:1789762945.313011:0:6671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762945.313016:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6800/0xd08452c77c571178 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.313021:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6800/0xd08452c77c571178 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.313025:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c571163 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.313031:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c571163 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.313034:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762945.313038:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762945.313039:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c571163 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.313040:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762945.313046:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762945.313049:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c571163 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.313053:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c571163 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.313060:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d151e90300) 00010000:00010000:1.0:1789762945.313061:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762945.313063:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c571163 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.313075:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030e00/0xd08452c77c571163 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762945.313083:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2bd8def reply state 00000000417931b2 transno 4294967549 ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c57116a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762945.313088:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762945.313123:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+30:14033:x1876702140854400:12345-192.168.203.31@tcp:36:rm.0 Request processed in 693us (816us total) trans 4294967549 rc 0/0 00000100:00100000:1.0:1789762945.313129:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 290 00010000:00010000:1.0:1789762945.313739:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c57116a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.313745:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c57116a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.313749:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c57116a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.313752:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762945.313754:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c57116a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.313758:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c57116a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.313765:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x636661f9 (ffff95d14abf2700) 00010000:00010000:1.0:1789762945.313766:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762945.313768:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c57116a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.313780:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030600/0xd08452c77c57116a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x636661f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762945.314127:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.314163:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140854656 00000100:00100000:1.0:1789762945.314167:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140854656 00000100:00100000:1.0:1789762945.314194:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:1.0:1789762945.314200:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15177d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+29:14033:x1876702140854656:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:1.0:1789762945.314281:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15177d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+30:14033:x1876702140854656:12345-192.168.203.31@tcp:35:rm.0 Request processed in 82us (156us total) trans 4294967550 rc 0/0 00000100:00100000:1.0:1789762945.314286:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:0.0:1789762945.314951:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762945.314988:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140854912 00000100:00100000:2.0:1789762945.314994:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140854912 00000100:00100000:2.0:1789762945.315022:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 291 00000100:00100000:2.0:1789762945.315029:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+30:14033:x1876702140854912:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762945.315055:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762945.315065:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d160193400/0xd08452c77c571139 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eba8 expref: 30 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315078:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c570ffe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eaeb expref: 29 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315086:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d151e90300) 00010000:00010000:2.0:1789762945.315094:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d140030c00/0xd08452c77c570f9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ead6 expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315101:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2f00) 00010000:00010000:2.0:1789762945.315105:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762945.315114:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c57117f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315120:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c57117f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315125:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c57117f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315131:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c571186 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315136:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c571186 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315141:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c571186 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315189:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c57118d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315195:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c57118d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315200:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c57118d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762945.315451:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 16384 00010000:00010000:2.0:1789762945.315459:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c57118d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315464:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c57118d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315469:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c57118d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315472:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762945.315474:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c57118d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315478:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c57118d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315485:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff95d142a04900) 00010000:00010000:2.0:1789762945.315487:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762945.315489:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c57118d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315501:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c57118d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315512:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c57117f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315516:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c57117f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315520:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c57117f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315523:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762945.315525:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c57117f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315529:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c57117f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315533:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:2.0:1789762945.315535:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762945.315536:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c57117f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.315540:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c57117f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762945.315545:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6b4b640 reply state 0000000095f026f3 transno 4294967551 ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c571186 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762945.315550:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762945.315589:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+29:14033:x1876702140854912:12345-192.168.203.31@tcp:36:rm.0 Request processed in 560us (640us total) trans 4294967551 rc 0/0 00000100:00100000:2.0:1789762945.315594:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 291 00010000:00010000:1.0:1789762945.316236:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c571186 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.316242:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c571186 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.316246:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c571186 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.316250:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762945.316252:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c571186 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.316256:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c571186 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.316263:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d142a04d00) 00010000:00010000:1.0:1789762945.316265:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762945.316272:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c571186 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.316276:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c571186 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762945.595575:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762945.595632:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140855040 00000100:00100000:3.0:1789762945.595642:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140855040 00000100:00100000:3.0:1789762945.595686:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 292 00000100:00100000:3.0:1789762945.595697:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+28:14044:x1876702140855040:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:3.0:1789762945.595719:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762945.595737:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571194 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ebaf expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.595788:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192a00/0xd08452c77c57119b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.595809:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192a00/0xd08452c77c57119b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.595820:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192a00/0xd08452c77c57119b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762945.595874:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789762945.595879:0:6681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762945.595901:0:6681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192a00/0xd08452c77c57119b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.595925:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571194 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebaf expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.595937:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192a00/0xd08452c77c57119b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebaf expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.595944:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d800) 00010000:00010000:3.0:1789762945.595946:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762945.595950:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d160192a00, rc 0) 00000100:00100000:3.0:1789762945.596011:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+29:14044:x1876702140855040:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 316us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762945.596019:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 292 00000100:00100000:3.0:1789762945.597168:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762945.597204:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140855296 00000100:00100000:0.0:1789762945.597214:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140855296 00000100:00100000:0.0:1789762945.597243:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 293 00000100:00100000:0.0:1789762945.597252:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+29:14044:x1876702140855296:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:0.0:1789762945.597278:0:13232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762945.597292:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192a00/0xd08452c77c57119b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebaf expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.597302:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d15055d800) 00010000:00010000:0.0:1789762945.597308:0:13232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762945.597377:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98c00/0xd08452c77c5711a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.597385:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98c00/0xd08452c77c5711a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.597391:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98c00/0xd08452c77c5711a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.597403:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c5711a9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.597409:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c5711a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.597413:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c5711a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762945.597983:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00010000:00010000:0.0:1789762945.597991:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98c00/0xd08452c77c5711a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.598005:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98c00/0xd08452c77c5711a2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.598009:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98c00/0xd08452c77c5711a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.598014:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762945.598017:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98c00/0xd08452c77c5711a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.598022:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98c00/0xd08452c77c5711a2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.598029:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d151e90100) 00010000:00010000:0.0:1789762945.598031:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762945.598034:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98c00/0xd08452c77c5711a2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.598038:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98c00/0xd08452c77c5711a2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762945.598049:0:13232:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000af1431c reply state 00000000069dd724 transno 4294967552 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c5711a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762945.598055:0:13232:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762945.598101:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+30:14044:x1876702140855296:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 851us (934us total) trans 4294967552 rc 0/0 00000100:00100000:0.0:1789762945.598107:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 293 00010000:00010000:1.0:1789762945.598659:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c5711a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.598668:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c5711a9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.598673:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c5711a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.598677:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762945.598680:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c5711a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.598684:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c5711a9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.598692:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d151e90b00) 00010000:00010000:1.0:1789762945.598694:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762945.598697:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c5711a9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.598700:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98a00/0xd08452c77c5711a9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762945.603021:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.603051:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140855424 00000100:00100000:1.0:1789762945.603056:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140855424 00000100:00100000:1.0:1789762945.603090:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 294 00000100:00100000:1.0:1789762945.603104:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+29:14045:x1876702140855424:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789762945.603115:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762945.603125:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7c00/0xd08452c77c5711b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ebb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.603150:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7e00/0xd08452c77c5711b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.603158:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7e00/0xd08452c77c5711b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.603164:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7e00/0xd08452c77c5711b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762945.603178:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789762945.603180:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762945.603190:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7e00/0xd08452c77c5711b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.603203:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7c00/0xd08452c77c5711b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebb6 expref: 31 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.603216:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7e00/0xd08452c77c5711b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebb6 expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.603222:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2700) 00010000:00010000:1.0:1789762945.603224:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762945.603226:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d0493c7e00, rc 0) 00000100:00100000:1.0:1789762945.603257:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+30:14045:x1876702140855424:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 155us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762945.603272:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 294 00000100:00100000:0.0:1789762945.604179:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762945.604210:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140855680 00000100:00100000:2.0:1789762945.604216:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140855680 00000100:00100000:2.0:1789762945.604245:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 295 00000100:00100000:2.0:1789762945.604255:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+30:14045:x1876702140855680:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762945.604262:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762945.604264:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789762945.604279:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7e00/0xd08452c77c5711b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebb6 expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604294:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d14abf2700) 00010000:00010000:2.0:1789762945.604303:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762945.604317:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7600/0xd08452c77c5711be lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ebbd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604402:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7200/0xd08452c77c5711c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604409:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7200/0xd08452c77c5711c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604416:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7200/0xd08452c77c5711c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604424:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7a00/0xd08452c77c5711cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604438:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7a00/0xd08452c77c5711cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604443:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7a00/0xd08452c77c5711cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604485:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6c00/0xd08452c77c5711d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604491:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6c00/0xd08452c77c5711d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604496:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6c00/0xd08452c77c5711d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762945.604501:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00010000:00010000:2.0:1789762945.604509:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6c00/0xd08452c77c5711d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604513:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6c00/0xd08452c77c5711d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604518:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6c00/0xd08452c77c5711d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604521:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762945.604524:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6c00/0xd08452c77c5711d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604528:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6c00/0xd08452c77c5711d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604543:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff95d142a04000) 00010000:00010000:2.0:1789762945.604545:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762945.604547:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6c00/0xd08452c77c5711d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604551:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6c00/0xd08452c77c5711d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604564:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7200/0xd08452c77c5711c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604568:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7200/0xd08452c77c5711c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604573:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7200/0xd08452c77c5711c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604577:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762945.604579:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7200/0xd08452c77c5711c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604583:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7200/0xd08452c77c5711c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604588:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:2.0:1789762945.604590:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762945.604592:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7200/0xd08452c77c5711c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604595:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7200/0xd08452c77c5711c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604628:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7a00/0xd08452c77c5711cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604633:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7a00/0xd08452c77c5711cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604636:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7a00/0xd08452c77c5711cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604640:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762945.604642:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7a00/0xd08452c77c5711cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604646:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7a00/0xd08452c77c5711cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604653:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d142a04900) 00010000:00010000:2.0:1789762945.604654:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762945.604656:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7a00/0xd08452c77c5711cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604660:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7a00/0xd08452c77c5711cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604677:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7600/0xd08452c77c5711be lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebbd expref: 30 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604684:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:2.0:1789762945.604685:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762945.604693:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7600/0xd08452c77c5711be lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebbd expref: 30 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.604704:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d144cf7600, rc 0) 00000100:00100000:2.0:1789762945.604731:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+29:14045:x1876702140855680:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 480us (556us total) trans 0 rc 301/301 00000100:00100000:2.0:1789762945.604738:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 295 00000100:00100000:1.0:1789762945.605512:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762945.605546:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140855808 00000100:00100000:2.0:1789762945.605551:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140855808 00000100:00100000:2.0:1789762945.605577:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 296 00000100:00100000:2.0:1789762945.605582:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+29:14045:x1876702140855808:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762945.605590:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762945.605599:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c5711da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ebc4 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.605622:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c5711e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.605629:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c5711e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.605634:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c5711e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762945.605645:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789762945.605648:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762945.605654:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c5711e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.605665:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6e00/0xd08452c77c5711da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebc4 expref: 31 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.605682:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c5711e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebc4 expref: 30 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.605688:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04100) 00010000:00010000:2.0:1789762945.605690:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762945.605691:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d144cf6000, rc 0) 00000100:00100000:2.0:1789762945.605720:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+30:14045:x1876702140855808:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 138us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762945.605725:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 296 00000100:00100000:3.0:1789762945.606628:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762945.606666:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140856064 00000100:00100000:2.0:1789762945.606671:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140856064 00000100:00100000:2.0:1789762945.606701:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 297 00000100:00100000:2.0:1789762945.606707:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+30:14045:x1876702140856064:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789762945.606714:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762945.606721:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c5711e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ebcb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606748:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c5711ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606755:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c5711ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606761:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c5711ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606769:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7000/0xd08452c77c5711f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606779:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7000/0xd08452c77c5711f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606785:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7000/0xd08452c77c5711f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762945.606824:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00010000:00010000:2.0:1789762945.606903:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c5711ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606909:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c5711ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606914:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c5711ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606920:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762945.606924:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c5711ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606931:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c5711ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606941:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04100) 00010000:00010000:2.0:1789762945.606944:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762945.606948:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c5711ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606954:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c5711ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606973:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7000/0xd08452c77c5711f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606977:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7000/0xd08452c77c5711f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606981:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7000/0xd08452c77c5711f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606984:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762945.606986:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7000/0xd08452c77c5711f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606991:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7000/0xd08452c77c5711f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.606997:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d142a04b00) 00010000:00010000:2.0:1789762945.606998:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762945.607000:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7000/0xd08452c77c5711f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.607004:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7000/0xd08452c77c5711f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.607025:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c5711e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebcb expref: 32 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.607031:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04100) 00010000:00010000:2.0:1789762945.607032:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789762945.607040:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7800/0xd08452c77c5711e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebcb expref: 32 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.607048:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d144cf7800, rc 0) 00000100:00100000:2.0:1789762945.607078:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+31:14045:x1876702140856064:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 372us (452us total) trans 4294967553 rc 301/301 00000100:00100000:2.0:1789762945.607083:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 297 00000100:00100000:0.0:1789762945.608042:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762945.608080:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140856320 00000100:00100000:3.0:1789762945.608085:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140856320 00000100:00100000:3.0:1789762945.608128:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 298 00000100:00100000:3.0:1789762945.608135:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+31:14045:x1876702140856320:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:3.0:1789762945.608169:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192800/0xd08452c77c571204 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.608178:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192800/0xd08452c77c571204 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.608184:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192800/0xd08452c77c571204 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762945.608276:0:6681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe5f82e3 reply state 00000000587a5cf9 transno 4294967554 ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192800/0xd08452c77c571204 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762945.608283:0:6681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762945.608287:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000100:00100000:3.0:1789762945.608326:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+33:14045:x1876702140856320:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 192us (286us total) trans 4294967554 rc 0/0 00000100:00100000:3.0:1789762945.608343:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 298 00010000:00010000:3.0:1789762945.608852:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192800/0xd08452c77c571204 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.608859:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192800/0xd08452c77c571204 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.608864:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192800/0xd08452c77c571204 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.608868:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192800 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762945.608871:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192800/0xd08452c77c571204 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.608886:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192800/0xd08452c77c571204 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.608895:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff95d15055d900) 00010000:00010000:3.0:1789762945.608898:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789762945.608900:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192800/0xd08452c77c571204 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.608905:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192800/0xd08452c77c571204 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762945.608932:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762945.608963:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140856576 00000100:00100000:2.0:1789762945.608968:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140856576 00000100:00100000:2.0:1789762945.608999:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:2.0:1789762945.609007:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+32:14045:x1876702140856576:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1789762945.609112:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+33:14045:x1876702140856576:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 107us (183us total) trans 4294967555 rc 0/0 00000100:00100000:2.0:1789762945.609118:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:0.0:1789762945.612230:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.612302:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140856704 00000100:00100000:1.0:1789762945.612308:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140856704 00000100:00100000:1.0:1789762945.612355:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 299 00000100:00100000:1.0:1789762945.612366:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1526df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+33:14046:x1876702140856704:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:1.0:1789762945.612378:0:13232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762945.612390:0:13232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7c00/0xd08452c77c57120b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ebd2 expref: -99 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612426:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6400/0xd08452c77c571212 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612436:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6400/0xd08452c77c571212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612442:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6400/0xd08452c77c571212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612455:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7000/0xd08452c77c571219 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612460:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7000/0xd08452c77c571219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612465:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7000/0xd08452c77c571219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612506:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6e00/0xd08452c77c571220 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612519:0:13232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6e00/0xd08452c77c571220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612524:0:13232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6e00/0xd08452c77c571220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762945.612538:0:13232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:1.0:1789762945.612540:0:13232:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762945.612549:0:13232:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6e00/0xd08452c77c571220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612555:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6400/0xd08452c77c571212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612559:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6400/0xd08452c77c571212 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612563:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6400/0xd08452c77c571212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612566:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762945.612569:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6400/0xd08452c77c571212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612573:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6400/0xd08452c77c571212 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612578:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04100) 00010000:00010000:1.0:1789762945.612581:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762945.612583:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6400/0xd08452c77c571212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612596:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6400/0xd08452c77c571212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612606:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7000/0xd08452c77c571219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612610:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7000/0xd08452c77c571219 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612614:0:13232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7000/0xd08452c77c571219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612617:0:13232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c7000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762945.612619:0:13232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7000/0xd08452c77c571219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612623:0:13232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7000/0xd08452c77c571219 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612628:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d14abf2600) 00010000:00010000:1.0:1789762945.612630:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762945.612631:0:13232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7000/0xd08452c77c571219 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612635:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7000/0xd08452c77c571219 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612652:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c7c00/0xd08452c77c57120b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebd2 expref: 35 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612671:0:13232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6e00/0xd08452c77c571220 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebd2 expref: 34 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.612676:0:13232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff95d14abf2800) 00010000:00010000:1.0:1789762945.612678:0:13232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762945.612680:0:13232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d0493c6e00, rc 0) 00000100:00100000:1.0:1789762945.612710:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1526df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+34:14046:x1876702140856704:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 349us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762945.612715:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 299 00000100:00100000:2.0:1789762945.613696:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.613735:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140856960 00000100:00100000:1.0:1789762945.613741:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140856960 00000100:00100000:1.0:1789762945.613772:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 300 00000100:00100000:1.0:1789762945.613780:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+34:14046:x1876702140856960:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:1.0:1789762945.613802:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762945.613817:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6e00/0xd08452c77c571220 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebd2 expref: 34 pid: 13232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.613929:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff95d14abf2800) 00010000:00010000:1.0:1789762945.613936:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762945.613949:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6600/0xd08452c77c571227 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.613957:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6600/0xd08452c77c571227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.613963:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6600/0xd08452c77c571227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762945.614056:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003528470 reply state 00000000a5d5d1b1 transno 4294967556 ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6600/0xd08452c77c571227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762945.614062:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789762945.614066:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000100:00100000:1.0:1789762945.614108:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+35:14046:x1876702140856960:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 328us (413us total) trans 4294967556 rc 0/0 00000100:00100000:1.0:1789762945.614113:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 300 00010000:00010000:1.0:1789762945.614627:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6600/0xd08452c77c571227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.614634:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6600/0xd08452c77c571227 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.614638:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6600/0xd08452c77c571227 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.614642:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6600 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:1.0:1789762945.614644:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6600/0xd08452c77c571227 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.614649:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6600/0xd08452c77c571227 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.614656:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff95d14abf2100) 00010000:00010000:1.0:1789762945.614658:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789762945.614661:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6600/0xd08452c77c571227 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.614665:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d0493c6600/0xd08452c77c571227 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762945.631608:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762945.631648:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140857088 00000100:00100000:0.0:1789762945.631654:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140857088 00000100:00100000:0.0:1789762945.631689:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 301 00000100:00100000:0.0:1789762945.631697:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+34:14052:x1876702140857088:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:0.0:1789762945.631711:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762945.631721:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98400/0xd08452c77c57122e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ebd9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.631753:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99400/0xd08452c77c571235 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.631762:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99400/0xd08452c77c571235 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.631768:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99400/0xd08452c77c571235 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.631777:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c57123c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.631781:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c57123c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.631786:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c57123c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.631933:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98000/0xd08452c77c571243 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.631942:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98000/0xd08452c77c571243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.631959:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98000/0xd08452c77c571243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762945.631979:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:0.0:1789762945.631982:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762945.631993:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98000/0xd08452c77c571243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632001:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99400/0xd08452c77c571235 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632006:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99400/0xd08452c77c571235 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632011:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99400/0xd08452c77c571235 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632014:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762945.632017:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99400/0xd08452c77c571235 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632022:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99400/0xd08452c77c571235 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632031:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04100) 00010000:00010000:0.0:1789762945.632033:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762945.632036:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99400/0xd08452c77c571235 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632040:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99400/0xd08452c77c571235 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632057:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c57123c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632062:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c57123c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632065:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c57123c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632068:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99e00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:0.0:1789762945.632070:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c57123c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632074:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c57123c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632079:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d151e90100) 00010000:00010000:0.0:1789762945.632081:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762945.632083:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c57123c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632087:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c99e00/0xd08452c77c57123c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632105:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98400/0xd08452c77c57122e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebd9 expref: 36 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632114:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98000/0xd08452c77c571243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebd9 expref: 35 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.632126:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff95d151e90800) 00010000:00010000:0.0:1789762945.632128:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789762945.632130:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148c98000, rc 0) 00000100:00100000:0.0:1789762945.632165:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+35:14052:x1876702140857088:12345-192.168.203.31@tcp:101:dd.500 Request processed in 470us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762945.632170:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 301 00000100:00100000:0.0:1789762945.633152:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762945.633181:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140857344 00000100:00100000:3.0:1789762945.633187:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140857344 00000100:00100000:3.0:1789762945.633214:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 302 00000100:00100000:3.0:1789762945.633220:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+35:14052:x1876702140857344:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:3.0:1789762945.633227:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762945.633235:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192800/0xd08452c77c57124a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ebe0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633298:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571251 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633306:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571251 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633312:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571251 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633372:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192400/0xd08452c77c571258 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633386:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192400/0xd08452c77c571258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633395:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192400/0xd08452c77c571258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762945.633688:0:7603:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14:0x0], index 0: 0 00010000:00010000:3.0:1789762945.633795:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192200/0xd08452c77c57125f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633802:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192200/0xd08452c77c57125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633807:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192200/0xd08452c77c57125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633827:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571251 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633862:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571251 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633870:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571251 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633877:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762945.633881:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571251 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633889:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571251 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633909:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff95d151e90800) 00010000:00010000:3.0:1789762945.633911:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762945.633914:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571251 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633918:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192000/0xd08452c77c571251 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762945.633926:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de445389 reply state 00000000ff30cdb3 transno 4294967557 ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192400/0xd08452c77c571258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762945.633931:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789762945.633948:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192800/0xd08452c77c57124a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebe0 expref: 38 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633955:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192200/0xd08452c77c57125f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebe0 expref: 37 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.633960:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff95d15055d000) 00010000:00010000:3.0:1789762945.633962:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762945.633963:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d160192200, rc 0) 00000100:00100000:3.0:1789762945.633994:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+38:14052:x1876702140857344:12345-192.168.203.31@tcp:101:dd.500 Request processed in 774us (842us total) trans 4294967557 rc 0/0 00000100:00100000:3.0:1789762945.633999:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 302 00010000:00010000:3.0:1789762945.634585:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192400/0xd08452c77c571258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.634591:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192400/0xd08452c77c571258 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.634601:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192400/0xd08452c77c571258 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.634604:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762945.634606:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192400/0xd08452c77c571258 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.634610:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192400/0xd08452c77c571258 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.634616:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x4009f790 (ffff95d15055d900) 00010000:00010000:3.0:1789762945.634618:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762945.634620:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192400/0xd08452c77c571258 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.634624:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192400/0xd08452c77c571258 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762945.636992:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.637026:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140857472 00000100:00100000:1.0:1789762945.637032:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140857472 00000100:00100000:1.0:1789762945.637071:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 349657269356 time 349657349154 state 0x0 ref 1 00000100:00100000:1.0:1789762945.637085:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 349757349154 time 349657349154 state 0x1 ref 1 00000100:00100000:1.0:1789762945.637116:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 349757349154 time 350110275974 state 0x0 ref 1 00000100:00100000:1.0:1789762945.637130:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+39:2344:x1876702140857472:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762945.637163:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789762945.637170:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c57126d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.637184:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1789762945.637189:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762945.637195:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c57126d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.637206:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c57126d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762945.664539:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967928 is committed 00000001:00080000:2.0:1789762945.664558:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967929 is committed 00002000:00010000:1.0:1789762945.664560:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1789762945.664565:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 0 -> 1789762945 00002000:00010000:1.0:1789762945.664567:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 0 -> 1789762945 00002000:00010000:1.0:1789762945.664569:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1789762945.664590:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c57126d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.664601:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c57126d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.664608:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c57126d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762945.664610:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967912 is committed 00010000:00010000:1.0:1789762945.664617:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762945.664623:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c57126d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.664633:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c57126d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.664653:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c57126d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.664663:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c57126d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762945.664746:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140857472:12345-192.168.203.31@tcp:4:dd.500 Request processed in 27616us (27751us total) trans 4294967929 rc 0/0 00000100:00100000:1.0:1789762945.664755:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 727 00000100:00100000:1.0:1789762945.664765:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 349757349154 time 350110275974 state 0x2 ref 0 00000100:00100000:0.0:1789762945.676979:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.677059:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140857600 00000100:00100000:1.0:1789762945.677074:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140857600 00000100:00100000:1.0:1789762945.677113:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 349757349154 time 350110275974 state 0x0 ref 1 00000100:00100000:1.0:1789762945.677125:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 350210275974 time 350110275974 state 0x1 ref 1 00000100:00100000:1.0:1789762945.677149:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 1 deadline 350210275974 time 350150311288 state 0x0 ref 1 00000100:00100000:1.0:1789762945.677159:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+7:2345:x1876702140857600:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762945.677188:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 1048576, mtime: 0x6aad9d81, atime: 0x0, ctime: 0x6aad9d81, blocks: 0x803 00010000:00010000:1.0:1789762945.677194:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c571274 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.677205:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1789762945.677209:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762945.677213:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c571274 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.677222:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c571274 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762945.690401:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967930 is committed 00002000:00010000:2.0:1789762945.690410:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1789762945.690417:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1789762945.690432:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c571274 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.690448:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c571274 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.690473:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c571274 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.690481:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762945.690486:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c571274 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.690496:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c571274 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.690515:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c571274 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.690521:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071833e5d/0xd08452c77c571274 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762945.690593:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+7:2345:x1876702140857600:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13432us (13614us total) trans 4294967930 rc 0/0 00000100:00100000:2.0:1789762945.690603:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 728 00000100:00100000:2.0:1789762945.690613:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 1 deadline 350210275974 time 350150311288 state 0x2 ref 0 00000100:00100000:0.0:1789762945.692535:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.692581:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140857728 00000100:00100000:1.0:1789762945.692590:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140857728 00000100:00100000:1.0:1789762945.692633:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 1 deadline 350210275974 time 350150311288 state 0x0 ref 1 00000100:00100000:1.0:1789762945.692649:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 1 deadline 350250311288 time 350150311288 state 0x1 ref 1 00000100:00100000:1.0:1789762945.692686:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350250311288 time 350165846652 state 0x0 ref 1 00000100:00100000:1.0:1789762945.692698:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140857728:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762945.692734:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 2097152, mtime: 0x6aad9d81, atime: 0x0, ctime: 0x6aad9d81, blocks: 0x1007 00010000:00010000:1.0:1789762945.692743:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c57127b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.692758:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1789762945.692762:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762945.692767:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c57127b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.692778:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c57127b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762945.707301:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967931 is committed 00002000:00010000:2.0:1789762945.707311:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1789762945.707318:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789762945.707342:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c57127b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.707369:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c57127b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.707379:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c57127b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.707387:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c7c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762945.707392:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c57127b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.707402:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c57127b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.707419:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c57127b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.707428:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c57127b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762945.707496:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140857728:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14796us (14958us total) trans 4294967931 rc 0/0 00000100:00100000:2.0:1789762945.707506:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 729 00000100:00100000:2.0:1789762945.707516:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350250311288 time 350165846652 state 0x2 ref 0 00000100:00100000:0.0:1789762945.709252:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.709288:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140857856 00000100:00100000:1.0:1789762945.709295:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140857856 00000100:00100000:1.0:1789762945.709342:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350250311288 time 350165846652 state 0x0 ref 1 00000100:00100000:1.0:1789762945.709355:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350265846652 time 350165846652 state 0x1 ref 1 00000001:00080000:1.0:1789762945.712863:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967552 is committed 00000001:00080000:1.0:1789762945.712888:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967556 is committed 00000004:00080000:1.0:1789762945.712899:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 18 committed 00000004:00080000:1.0:1789762945.712910:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 23 committed 00000001:00080000:1.0:1789762945.712963:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967557 is committed 00000100:00100000:1.0:1789762945.713014:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149047680:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789762945.713051:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762945.713071:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149047680 00000100:00100000:3.0:1789762945.713076:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149047680 00000100:00100000:1.0:1789762945.713092:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149047552:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1789762945.713112:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762945.713118:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762945.713139:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149047552 00000100:00100000:3.0:1789762945.713145:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149047552 00000100:00100000:2.0:1789762945.713155:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789762945.713174:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149047680:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789762945.713177:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789762945.713189:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149047552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789762945.713195:0:6654:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:12 count 1 00002000:00080000:0.0:1789762945.713201:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:18 count 1 00010000:00010000:0.0:1789762945.713212:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762945.713216:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 8388608, mtime: 0x6aad9d7f, atime: 0x0, ctime: 0x6aad9d7f, blocks: 0x1 00010000:00010000:2.0:1789762945.713222:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da61bb32/0xd08452c77c571289 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.713229:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c571108 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb8c expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.713232:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1789762945.713236:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762945.713240:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57110f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb93 expref: 7 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.713242:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da61bb32/0xd08452c77c571289 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.713248:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762945.713256:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762945.713256:0:6654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da61bb32/0xd08452c77c571289 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.713261:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.713266:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da61bb32/0xd08452c77c571289 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.713273:0:6654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da61bb32/0xd08452c77c571289 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.713285:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57110f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb93 expref: 7 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.713293:0:6654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762945.713301:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57110f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb93 expref: 7 pid: 8803 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.713303:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762945.713312:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da61bb32/0xd08452c77c571289 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762945.713319:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1876702149047808:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789762945.713323:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762945.713341:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da61bb32/0xd08452c77c571289 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.713350:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da61bb32/0xd08452c77c571289 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.713361:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da61bb32/0xd08452c77c571289 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.713367:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da61bb32/0xd08452c77c571289 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.713390:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762945.713392:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762945.713394:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762945.713408:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c571108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb8c expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.713420:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c571108 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb8c expref: 7 pid: 6656 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762945.713431:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1876702149047936:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789762945.713464:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d16a095d80 going to sleep for 11 seconds 00000100:00080000:0.0:1789762945.713480:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762945.713779:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149047680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 609us (726us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789762945.713784:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000004:00080000:1.0:1789762945.713814:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d147cdb800/2, rc 0, transno 4294967415 00000100:00100000:1.0:1789762945.713830:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149047680:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789762945.714216:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1876702149047808:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789762945.714223:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1876702149047936:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789762945.714241:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762945.714454:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762945.714482:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762945.714485:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140857984 00000100:00100000:1.0:1789762945.714490:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140857984 00010000:00010000:1.0:1789762945.714510:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57110f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb93 expref: 8 pid: 8803 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762945.714521:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140858112 00000100:00100000:2.0:1789762945.714526:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140858112 00000100:00100000:1.0:1789762945.714537:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00010000:00010000:2.0:1789762945.714545:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c571108 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb8c expref: 9 pid: 6656 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762945.714549:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+9:2345:x1876702140857984:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762945.714564:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762945.714569:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57110f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb93 expref: 9 pid: 8803 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.714582:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57110f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb93 expref: 9 pid: 8803 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762945.714589:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00010000:00010000:1.0:1789762945.714598:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57110f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb93 expref: 9 pid: 8803 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762945.714600:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+9:2344:x1876702140858112:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762945.714614:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762945.714616:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762945.714620:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c571108 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb8c expref: 8 pid: 6656 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.714632:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c571108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb8c expref: 8 pid: 6656 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.714644:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d69de3a/0xd08452c77c571108 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7eb8c expref: 8 pid: 6656 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762945.714656:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77777931-b235-4c03-82d2-4b1d12553008+7:2345:x1876702140857984:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 109us (298us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762945.714656:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762945.714666:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762945.714671:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762945.714687:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00010000:00010000:2.0:1789762945.714689:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.714714:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762945.714728:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.714739:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762945.714745:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140858112:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 145us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762945.714759:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00010000:00010000:3.0:1789762945.714816:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762945.714822:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.714873:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762945.714879:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.714888:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762945.714891:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789762945.714894:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.714905:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.714922:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.714929:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571282 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762945.714942:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762945.714945:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762945.714946:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762945.715218:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149047552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2033us (2101us total) trans 4294967932 rc 0/0 00000100:00100000:3.0:1789762945.715224:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789762945.715245:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967912 gen 2 00000100:00100000:1.0:1789762945.715259:0:3279:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d148de2d80 x1876702149047552/t4294967932(4294967932) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789762961 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789762945.715266:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d148de2d80/2, rc 0, transno 4294967932 00000100:00100000:1.0:1789762945.715276:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149047552:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762945.792768:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350265846652 time 350265911899 state 0x0 ref 1 00000100:00100000:1.0:1789762945.792796:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140857856:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762945.792882:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 3145728, mtime: 0x6aad9d81, atime: 0x0, ctime: 0x6aad9d81, blocks: 0x1807 00010000:00010000:1.0:1789762945.792892:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c571290 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.792909:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1789762945.792914:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762945.792921:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c571290 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.792935:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c571290 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762945.804829:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967933 is committed 00002000:00010000:0.0:1789762945.804860:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1789762945.804868:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 6151 -> 8199 00000001:00080000:1.0:1789762945.804872:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967932 is committed 00010000:00010000:0.0:1789762945.804881:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c571290 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.804895:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c571290 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.804914:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c571290 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.804923:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762945.804928:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c571290 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.804938:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c571290 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.804957:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c571290 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.804965:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c571290 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762945.805023:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140857856:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12237us (95770us total) trans 4294967933 rc 0/0 00000100:00100000:0.0:1789762945.805031:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 730 00000100:00100000:0.0:1789762945.805039:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350265846652 time 350265911899 state 0x2 ref 0 00000100:00100000:3.0:1789762945.807408:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762945.807454:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140858240 00000100:00100000:0.0:1789762945.807463:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140858240 00000100:00100000:0.0:1789762945.807500:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350265846652 time 350265911899 state 0x0 ref 1 00000100:00100000:0.0:1789762945.807520:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350365911899 time 350265911899 state 0x1 ref 1 00000100:00100000:0.0:1789762945.892806:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350365911899 time 350365955331 state 0x0 ref 1 00000100:00100000:0.0:1789762945.892827:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140858240:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762945.892902:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 4194304, mtime: 0x6aad9d81, atime: 0x0, ctime: 0x6aad9d81, blocks: 0x2007 00010000:00010000:0.0:1789762945.892912:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571297 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.892929:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=350s v=(0 0) 00010000:00010000:0.0:1789762945.892933:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762945.892938:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571297 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.892949:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571297 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762945.904808:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967934 is committed 00002000:00010000:0.0:1789762945.904823:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1789762945.904829:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1789762945.904866:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571297 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.904876:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.904893:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.904899:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762945.904903:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.904914:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.904933:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571297 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762945.904942:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571297 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762945.905015:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140858240:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12191us (97606us total) trans 4294967934 rc 0/0 00000100:00100000:0.0:1789762945.905024:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 731 00000100:00100000:0.0:1789762945.905033:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350365911899 time 350365955331 state 0x2 ref 0 00000100:00100000:3.0:1789762945.908138:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762945.908186:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140858368 00000100:00100000:2.0:1789762945.908194:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140858368 00000100:00100000:2.0:1789762945.908232:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350365911899 time 350365955331 state 0x0 ref 1 00000100:00100000:2.0:1789762945.908243:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350465955331 time 350365955331 state 0x1 ref 1 00000100:00100000:1.0:1789762945.992879:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350465955331 time 350466025969 state 0x0 ref 1 00000100:00100000:1.0:1789762945.992906:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140858368:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762945.992959:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 5242880, mtime: 0x6aad9d81, atime: 0x0, ctime: 0x6aad9d81, blocks: 0x2807 00010000:00010000:1.0:1789762945.992966:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b174ec9/0xd08452c77c57129e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.992980:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1789762945.992984:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762945.992988:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b174ec9/0xd08452c77c57129e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762945.993000:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b174ec9/0xd08452c77c57129e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762946.006793:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967935 is committed 00002000:00010000:0.0:1789762946.006870:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1789762946.006875:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1789762946.006886:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b174ec9/0xd08452c77c57129e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.006911:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b174ec9/0xd08452c77c57129e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.006921:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b174ec9/0xd08452c77c57129e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.006930:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c7a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762946.006935:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b174ec9/0xd08452c77c57129e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.006947:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b174ec9/0xd08452c77c57129e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.006963:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b174ec9/0xd08452c77c57129e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.006968:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b174ec9/0xd08452c77c57129e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762946.007038:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140858368:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14138us (98897us total) trans 4294967935 rc 0/0 00000100:00100000:0.0:1789762946.007050:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 732 00000100:00100000:0.0:1789762946.007061:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350465955331 time 350466025969 state 0x2 ref 0 00000100:00100000:3.0:1789762946.009902:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762946.009938:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140858496 00000100:00100000:0.0:1789762946.009951:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140858496 00000100:00100000:0.0:1789762946.009986:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350465955331 time 350466025969 state 0x0 ref 1 00000100:00100000:0.0:1789762946.009997:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350566025969 time 350466025969 state 0x1 ref 1 00010000:00010000:3.0:1789762946.086945:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762946.092962:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350566025969 time 350566113944 state 0x0 ref 1 00000100:00100000:2.0:1789762946.092991:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140858496:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762946.093034:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 6291456, mtime: 0x6aad9d81, atime: 0x0, ctime: 0x6aad9d81, blocks: 0x3007 00010000:00010000:2.0:1789762946.093041:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f956496/0xd08452c77c5712a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762946.093054:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1789762946.093058:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762946.093063:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f956496/0xd08452c77c5712a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762946.093073:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f956496/0xd08452c77c5712a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762946.104468:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967936 is committed 00002000:00010000:0.0:1789762946.104495:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1789762946.104500:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1789762946.104511:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f956496/0xd08452c77c5712a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.104521:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f956496/0xd08452c77c5712a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.104528:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f956496/0xd08452c77c5712a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.104533:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762946.104537:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f956496/0xd08452c77c5712a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.104544:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f956496/0xd08452c77c5712a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.104559:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f956496/0xd08452c77c5712a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.104564:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f956496/0xd08452c77c5712a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762946.104641:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140858496:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11650us (94735us total) trans 4294967936 rc 0/0 00000100:00100000:0.0:1789762946.104653:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 733 00000100:00100000:0.0:1789762946.104666:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350566025969 time 350566113944 state 0x2 ref 0 00000100:00100000:3.0:1789762946.107616:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762946.107660:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140858624 00000100:00100000:0.0:1789762946.107670:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140858624 00000100:00100000:0.0:1789762946.107714:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350566025969 time 350566113944 state 0x0 ref 1 00000100:00100000:0.0:1789762946.107728:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350666113944 time 350566113944 state 0x1 ref 1 00000100:00100000:0.0:1789762946.193084:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350666113944 time 350666221163 state 0x0 ref 1 00000100:00100000:0.0:1789762946.193122:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140858624:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762946.193194:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 7340032, mtime: 0x6aad9d81, atime: 0x0, ctime: 0x6aad9d81, blocks: 0x3807 00010000:00010000:0.0:1789762946.193208:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5712ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.193230:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=350s v=(0 0) 00010000:00010000:0.0:1789762946.193237:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762946.193246:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5712ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.193267:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5712ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762946.209052:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967937 is committed 00002000:00010000:0.0:1789762946.209110:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:0.0:1789762946.209116:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1789762946.209126:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5712ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.209137:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5712ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.209145:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5712ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.209150:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762946.209154:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5712ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.209161:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5712ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.209176:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5712ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.209182:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5712ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762946.209256:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140858624:12345-192.168.203.31@tcp:4:dd.500 Request processed in 16147us (101637us total) trans 4294967937 rc 0/0 00000100:00100000:0.0:1789762946.209275:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 734 00000100:00100000:0.0:1789762946.209285:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350666113944 time 350666221163 state 0x2 ref 0 00000100:00100000:1.0:1789762946.212427:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762946.212475:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140858752 00000100:00100000:0.0:1789762946.212483:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140858752 00000100:00100000:0.0:1789762946.212523:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350666113944 time 350666221163 state 0x0 ref 1 00000100:00100000:0.0:1789762946.212535:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350766221163 time 350666221163 state 0x1 ref 1 00000100:00100000:3.0:1789762946.293126:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350766221163 time 350766273994 state 0x0 ref 1 00000100:00100000:3.0:1789762946.293149:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140858752:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762946.293201:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 8388608, mtime: 0x6aad9d81, atime: 0x0, ctime: 0x6aad9d81, blocks: 0x4007 00010000:00010000:3.0:1789762946.293210:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762946.293228:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=350s v=(0 0) 00010000:00010000:3.0:1789762946.293233:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762946.293252:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762946.293267:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762946.304905:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967938 is committed 00002000:00010000:3.0:1789762946.304909:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:3.0:1789762946.304914:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:3.0:1789762946.304926:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762946.304937:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762946.304944:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762946.304950:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762946.304954:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762946.304960:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762946.304975:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762946.304980:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762946.305053:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140858752:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11909us (92624us total) trans 4294967938 rc 0/0 00000100:00100000:3.0:1789762946.305064:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 735 00000100:00100000:3.0:1789762946.305074:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350766221163 time 350766273994 state 0x2 ref 0 00000100:00100000:1.0:1789762946.307287:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762946.307345:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140858880 00000100:00100000:0.0:1789762946.307353:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140858880 00000100:00100000:0.0:1789762946.307392:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350766221163 time 350766273994 state 0x0 ref 1 00000100:00100000:0.0:1789762946.307404:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350866273994 time 350766273994 state 0x1 ref 1 00000100:00100000:2.0:1789762946.393266:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350866273994 time 350866406727 state 0x0 ref 1 00000100:00100000:2.0:1789762946.393299:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140858880:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762946.393382:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 9437184, mtime: 0x6aad9d81, atime: 0x0, ctime: 0x6aad9d81, blocks: 0x4807 00010000:00010000:2.0:1789762946.393392:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c5712ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762946.393410:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1789762946.393416:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762946.393423:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c5712ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762946.393453:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c5712ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762946.405203:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967939 is committed 00002000:00010000:0.0:1789762946.405225:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:0.0:1789762946.405233:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:0.0:1789762946.405247:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c5712ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.405262:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c5712ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.405274:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c5712ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.405296:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762946.405301:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c5712ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.405308:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c5712ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.405336:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c5712ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.405343:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c5712ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762946.405425:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140858880:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12136us (98135us total) trans 4294967939 rc 0/0 00000100:00100000:0.0:1789762946.405434:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 736 00000100:00100000:0.0:1789762946.405444:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350866273994 time 350866406727 state 0x2 ref 0 00000100:00100000:2.0:1789762946.408783:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762946.408829:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140859008 00000100:00100000:0.0:1789762946.408853:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140859008 00000100:00100000:0.0:1789762946.408893:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350866273994 time 350866406727 state 0x0 ref 1 00000100:00100000:0.0:1789762946.408905:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350966406727 time 350866406727 state 0x1 ref 1 00000100:00100000:1.0:1789762946.493356:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350966406727 time 350966482924 state 0x0 ref 1 00000100:00100000:1.0:1789762946.493392:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140859008:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762946.493443:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 10485760, mtime: 0x6aad9d81, atime: 0x0, ctime: 0x6aad9d81, blocks: 0x5007 00010000:00010000:1.0:1789762946.493450:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c8e7f9/0xd08452c77c5712c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762946.493473:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1789762946.493477:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762946.493482:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032c8e7f9/0xd08452c77c5712c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762946.493494:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032c8e7f9/0xd08452c77c5712c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762946.506632:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967940 is committed 00002000:00010000:0.0:1789762946.506646:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:0.0:1789762946.506658:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 20487 -> 22535 00010000:00010000:0.0:1789762946.506671:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c8e7f9/0xd08452c77c5712c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.506683:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032c8e7f9/0xd08452c77c5712c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.506690:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032c8e7f9/0xd08452c77c5712c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.506695:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762946.506698:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c8e7f9/0xd08452c77c5712c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.506708:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c8e7f9/0xd08452c77c5712c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.506728:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032c8e7f9/0xd08452c77c5712c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.506749:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032c8e7f9/0xd08452c77c5712c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762946.506870:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140859008:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13479us (98082us total) trans 4294967940 rc 0/0 00000100:00100000:0.0:1789762946.506883:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 737 00000100:00100000:0.0:1789762946.506897:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350966406727 time 350966482924 state 0x2 ref 0 00000100:00100000:0.0:1789762946.510977:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762946.511018:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140859136 00000100:00100000:3.0:1789762946.511027:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140859136 00000100:00100000:3.0:1789762946.511066:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 350966406727 time 350966482924 state 0x0 ref 1 00000100:00100000:3.0:1789762946.511078:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351066482924 time 350966482924 state 0x1 ref 1 00000100:00100000:3.0:1789762946.593399:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351066482924 time 351066545429 state 0x0 ref 1 00000100:00100000:3.0:1789762946.593424:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140859136:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762946.593474:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 11534336, mtime: 0x6aad9d81, atime: 0x0, ctime: 0x6aad9d81, blocks: 0x5807 00010000:00010000:3.0:1789762946.593481:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762946.593495:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1789762946.593498:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762946.593503:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762946.593515:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762946.605808:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967941 is committed 00002000:00010000:0.0:1789762946.605814:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:0.0:1789762946.605819:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 22535 -> 24583 00010000:00010000:0.0:1789762946.605831:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.605859:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.605867:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.605872:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762946.605876:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.605882:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.605896:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.605901:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c5712c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762946.605961:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140859136:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12544us (94983us total) trans 4294967941 rc 0/0 00000100:00100000:0.0:1789762946.605976:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 738 00000100:00100000:0.0:1789762946.605985:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351066482924 time 351066545429 state 0x2 ref 0 00000100:00100000:2.0:1789762946.609230:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762946.609280:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140859264 00000100:00100000:0.0:1789762946.609289:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140859264 00000100:00100000:0.0:1789762946.609342:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351066482924 time 351066545429 state 0x0 ref 1 00000100:00100000:0.0:1789762946.609353:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351166545429 time 351066545429 state 0x1 ref 1 00000100:00100000:1.0:1789762946.693476:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351166545429 time 351166622452 state 0x0 ref 1 00000100:00100000:1.0:1789762946.693501:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140859264:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762946.693547:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 12582912, mtime: 0x6aad9d81, atime: 0x0, ctime: 0x6aad9d81, blocks: 0x6007 00010000:00010000:1.0:1789762946.693555:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c5712cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762946.693569:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1789762946.693572:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762946.693578:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c5712cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762946.693589:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c5712cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762946.704577:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967942 is committed 00002000:00010000:0.0:1789762946.704592:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:0.0:1789762946.704597:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 1789762945 -> 1789762946 00002000:00010000:0.0:1789762946.704599:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 1789762945 -> 1789762946 00002000:00010000:0.0:1789762946.704601:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 24583 -> 26631 00010000:00010000:0.0:1789762946.704611:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c5712cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.704621:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c5712cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.704627:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c5712cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.704632:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c7c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762946.704636:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c5712cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.704654:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c5712cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.704668:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c5712cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.704673:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fabe3f4/0xd08452c77c5712cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762946.704730:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140859264:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11237us (95501us total) trans 4294967942 rc 0/0 00000100:00100000:0.0:1789762946.704737:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 739 00000100:00100000:0.0:1789762946.704746:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351166545429 time 351166622452 state 0x2 ref 0 00000100:00100000:2.0:1789762946.707353:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762946.707399:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140859392 00000100:00100000:0.0:1789762946.707407:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140859392 00000100:00100000:0.0:1789762946.707443:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351166545429 time 351166622452 state 0x0 ref 1 00000100:00100000:0.0:1789762946.707454:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351266622452 time 351166622452 state 0x1 ref 1 00000004:00080000:1.0:1789762946.726971:0:8167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351200135390ns, next at 352200132910ns, rc = 0 00000100:00100000:2.0:1789762946.726982:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17410aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149048064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762946.726999:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149048192:0@lo:400:kworker.0 00000100:00100000:3.0:1789762946.727003:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149048320:0@lo:400:kworker.0 00000100:00100000:0.0:1789762946.727045:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149048448:0@lo:400:kworker.0 00000100:00100000:2.0:1789762946.727057:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762946.727063:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762946.727064:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762946.727103:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762946.727133:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149048576:0@lo:400:kworker.0 00000100:00100000:1.0:1789762946.727138:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702149048704:0@lo:400:kworker.0 00000100:00100000:3.0:1789762946.727138:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149048832:0@lo:400:kworker.0 00000100:00100000:0.0:1789762946.727147:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149048320 00000100:00100000:0.0:1789762946.727151:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149048320 00000100:00100000:2.0:1789762946.727170:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762946.727185:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762946.727200:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149048448 00000100:00100000:0.0:1789762946.727206:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149048448 00000100:00100000:3.0:1789762946.727206:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149048704 00000100:00100000:3.0:1789762946.727213:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149048704 00000100:00100000:2.0:1789762946.727229:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149048064 00000100:00100000:2.0:1789762946.727234:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149048064 00000100:00100000:1.0:1789762946.727242:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149048192 00000100:00100000:1.0:1789762946.727248:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149048192 00000100:00100000:0.0:1789762946.727262:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789762946.727272:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789762946.727278:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789762946.727280:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149048320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762946.727288:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789762946.727288:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149048448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762946.727292:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149048064:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762946.727304:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a108850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149048192:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789762946.727338:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 98762752 pending 27262976 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762946.727350:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1876702149048320:12345-0@lo:400:kworker.0 Request processed in 78us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762946.727358:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789762946.727373:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876702149048448:12345-0@lo:400:kworker.0 Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762946.727380:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789762946.727381:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a108850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149048192:12345-0@lo:400:kworker.0 Request processed in 72us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762946.727387:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789762946.727392:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16ffd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702149048704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762946.727393:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789762946.727399:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149048064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762946.727411:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789762946.727426:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762946.727437:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16ffd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1876702149048704:12345-0@lo:400:kworker.0 Request processed in 49us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762946.727444:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789762946.727456:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1876702149048704:0@lo:400:kworker.0 00000100:00100000:3.0:1789762946.727468:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1876702149048320:0@lo:400:kworker.0 00000100:00100000:1.0:1789762946.727470:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149048192:0@lo:400:kworker.0 00000100:00100000:0.0:1789762946.727473:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149048576 00000100:00100000:2.0:1789762946.727475:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17410aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149048064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762946.727479:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149048576 00000100:00100000:3.0:1789762946.727513:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149048832 00000100:00100000:0.0:1789762946.727517:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789762946.727520:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149048832 00000100:00080000:1.0:1789762946.727525:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762946.727526:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149048576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762946.727562:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789762946.727568:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149048576:12345-0@lo:400:kworker.0 Request processed in 43us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762946.727575:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149048832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762946.727579:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789762946.727582:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1876702149048448:0@lo:400:kworker.0 00000100:00100000:2.0:1789762946.727586:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967932 gen 2 00000004:00080000:2.0:1789762946.727592:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d148de2d80, transno 4294967932 00000100:00100000:2.0:1789762946.727616:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149048576:0@lo:400:kworker.0 00000100:00100000:3.0:1789762946.727634:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149048832:12345-0@lo:400:kworker.0 Request processed in 62us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762946.727644:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789762946.727656:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149048832:0@lo:400:kworker.0 00000100:00100000:0.0:1789762946.793534:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351266622452 time 351266679956 state 0x0 ref 1 00000100:00100000:0.0:1789762946.793561:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140859392:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762946.793611:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 13631488, mtime: 0x6aad9d82, atime: 0x0, ctime: 0x6aad9d82, blocks: 0x6807 00010000:00010000:0.0:1789762946.793618:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c5712d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.793658:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1789762946.793663:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762946.793671:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c5712d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.793684:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c5712d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762946.807880:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967943 is committed 00002000:00010000:0.0:1789762946.807886:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:0.0:1789762946.807891:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 26631 -> 28679 00010000:00010000:0.0:1789762946.807902:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c5712d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.807913:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c5712d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.807921:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c5712d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.807926:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762946.807929:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c5712d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.807948:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c5712d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.807972:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c5712d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762946.807978:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c5712d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762946.808074:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140859392:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14519us (100716us total) trans 4294967943 rc 0/0 00000100:00100000:0.0:1789762946.808086:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 740 00000100:00100000:0.0:1789762946.808100:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351266622452 time 351266679956 state 0x2 ref 0 00000100:00100000:1.0:1789762946.811735:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762946.811794:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140859520 00000100:00100000:0.0:1789762946.811802:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140859520 00000100:00100000:0.0:1789762946.811863:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351266622452 time 351266679956 state 0x0 ref 1 00000100:00100000:0.0:1789762946.811877:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351366679956 time 351266679956 state 0x1 ref 1 00000100:00100000:1.0:1789762946.893616:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351366679956 time 351366763999 state 0x0 ref 1 00000100:00100000:1.0:1789762946.893654:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140859520:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762946.893703:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 14680064, mtime: 0x6aad9d82, atime: 0x0, ctime: 0x6aad9d82, blocks: 0x7007 00010000:00010000:1.0:1789762946.893722:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd3dd52/0xd08452c77c5712dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762946.893735:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1789762946.893739:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762946.893744:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd3dd52/0xd08452c77c5712dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762946.893755:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bd3dd52/0xd08452c77c5712dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762946.905226:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967944 is committed 00002000:00010000:1.0:1789762946.905243:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:1.0:1789762946.905248:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 28679 -> 30727 00010000:00010000:1.0:1789762946.905259:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd3dd52/0xd08452c77c5712dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762946.905269:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bd3dd52/0xd08452c77c5712dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762946.905276:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bd3dd52/0xd08452c77c5712dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762946.905281:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c7e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762946.905285:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd3dd52/0xd08452c77c5712dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762946.905292:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd3dd52/0xd08452c77c5712dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762946.905313:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bd3dd52/0xd08452c77c5712dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762946.905333:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd3dd52/0xd08452c77c5712dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762946.905407:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140859520:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11773us (93674us total) trans 4294967944 rc 0/0 00000100:00100000:1.0:1789762946.905415:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 741 00000100:00100000:1.0:1789762946.905424:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351366679956 time 351366763999 state 0x2 ref 0 00000100:00100000:0.0:1789762946.907727:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762946.907763:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140859648 00000100:00100000:1.0:1789762946.907770:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140859648 00000100:00100000:1.0:1789762946.907806:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351366679956 time 351366763999 state 0x0 ref 1 00000100:00100000:1.0:1789762946.907816:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351466763999 time 351366763999 state 0x1 ref 1 00000100:00100000:2.0:1789762946.932120:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762946.932162:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762946.932186:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762946.932205:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140859904 00000100:00100000:1.0:1789762946.932210:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140859776 00000100:00100000:3.0:1789762946.932213:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140859904 00000100:00100000:1.0:1789762946.932217:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140859776 00000100:00100000:2.0:1789762946.932218:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762946.932243:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140860160 00000100:00100000:0.0:1789762946.932249:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140860160 00000100:00100000:1.0:1789762946.932265:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 309 00000100:00100000:2.0:1789762946.932266:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140860032 00000100:00100000:3.0:1789762946.932271:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 260 00000100:00100000:2.0:1789762946.932272:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140860032 00000100:00100000:1.0:1789762946.932277:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140859776:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762946.932284:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d147cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140859904:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762946.932301:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 261 00000100:00100000:0.0:1789762946.932311:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17410aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140860160:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762946.932335:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:1.0:1789762946.932342:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140859776:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 67us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762946.932350:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d147cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2345:x1876702140859904:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762946.932351:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+37:2344:x1876702140860032:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762946.932357:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 309 00000100:00100000:0.0:1789762946.932361:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17410aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140860160:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 49us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762946.932389:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 260 00000100:00100000:0.0:1789762946.932398:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 261 00000100:00100000:2.0:1789762946.932407:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77777931-b235-4c03-82d2-4b1d12553008+37:2344:x1876702140860032:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 60us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762946.932417:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00080000:1.0:1789762946.932428:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762946.993703:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351466763999 time 351466852732 state 0x0 ref 1 00000100:00100000:3.0:1789762946.993723:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140859648:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762946.993767:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 15728640, mtime: 0x6aad9d82, atime: 0x0, ctime: 0x6aad9d82, blocks: 0x7807 00010000:00010000:3.0:1789762946.993777:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5712e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762946.993793:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1789762946.993798:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762946.993805:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5712e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762946.993820:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5712e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762947.005239:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967945 is committed 00002000:00010000:1.0:1789762947.005261:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:1.0:1789762947.005267:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 30727 -> 32775 00010000:00010000:1.0:1789762947.005277:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5712e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.005291:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5712e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.005302:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5712e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.005310:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762947.005316:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5712e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.005336:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5712e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.005352:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5712e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.005358:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5712e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762947.005417:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140859648:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11697us (97688us total) trans 4294967945 rc 0/0 00000100:00100000:1.0:1789762947.005433:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 742 00000100:00100000:1.0:1789762947.005442:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351466763999 time 351466852732 state 0x2 ref 0 00000100:00100000:0.0:1789762947.007431:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762947.007474:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140860288 00000100:00100000:2.0:1789762947.007483:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140860288 00000100:00080000:1.0:1789762947.007521:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762947.007530:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351466763999 time 351466852732 state 0x0 ref 1 00000100:00100000:2.0:1789762947.007542:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351566852732 time 351466852732 state 0x1 ref 1 00000100:00100000:3.0:1789762947.093789:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351566852732 time 351566940043 state 0x0 ref 1 00000100:00100000:3.0:1789762947.093809:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140860288:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762947.093868:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 16777216, mtime: 0x6aad9d82, atime: 0x0, ctime: 0x6aad9d82, blocks: 0x8007 00010000:00010000:3.0:1789762947.093876:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5712eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762947.093888:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1789762947.093906:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762947.093913:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5712eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762947.093928:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5712eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762947.104611:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967946 is committed 00002000:00010000:1.0:1789762947.104630:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:1.0:1789762947.104637:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 32775 -> 34823 00010000:00010000:1.0:1789762947.104649:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5712eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.104663:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5712eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.104672:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5712eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.104677:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762947.104681:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5712eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.104688:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5712eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.104702:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5712eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.104708:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5712eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762947.104773:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140860288:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10967us (97340us total) trans 4294967946 rc 0/0 00000100:00100000:1.0:1789762947.104782:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 743 00000100:00100000:1.0:1789762947.104791:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351566852732 time 351566940043 state 0x2 ref 0 00000100:00100000:2.0:1789762947.106826:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762947.106879:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140860416 00000100:00100000:1.0:1789762947.106889:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140860416 00000100:00100000:1.0:1789762947.106930:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351566852732 time 351566940043 state 0x0 ref 1 00000100:00100000:1.0:1789762947.106941:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351666940043 time 351566940043 state 0x1 ref 1 00010000:00010000:2.0:1789762947.110915:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762947.193894:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351666940043 time 351667040144 state 0x0 ref 1 00000100:00100000:0.0:1789762947.193914:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1522fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140860416:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762947.193961:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 17825792, mtime: 0x6aad9d82, atime: 0x0, ctime: 0x6aad9d82, blocks: 0x8807 00010000:00010000:0.0:1789762947.193969:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5712f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762947.193984:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1789762947.193987:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762947.193992:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5712f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762947.194003:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5712f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762947.205186:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967947 is committed 00002000:00010000:1.0:1789762947.205201:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:1.0:1789762947.205207:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 34823 -> 36871 00010000:00010000:1.0:1789762947.205218:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5712f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.205227:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5712f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.205234:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5712f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.205239:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762947.205242:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5712f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.205255:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5712f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.205269:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5712f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.205274:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5712f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762947.205344:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1522fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140860416:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11432us (98516us total) trans 4294967947 rc 0/0 00000100:00100000:1.0:1789762947.205355:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 744 00000100:00100000:1.0:1789762947.205368:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351666940043 time 351667040144 state 0x2 ref 0 00000100:00100000:2.0:1789762947.207382:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762947.207417:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140860544 00000100:00100000:1.0:1789762947.207424:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140860544 00000100:00100000:1.0:1789762947.207458:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351666940043 time 351667040144 state 0x0 ref 1 00000100:00100000:1.0:1789762947.207469:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351767040144 time 351667040144 state 0x1 ref 1 00000004:00080000:0.0:1789762947.238954:0:7131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351712119206ns, next at 352712116733ns, rc = 0 00000100:00100000:1.0:1789762947.238972:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d174167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149048960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762947.239017:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762947.239054:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149048960 00000100:00100000:3.0:1789762947.239060:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149048960 00000100:00080000:0.0:1789762947.239097:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762947.239113:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789762947.239122:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1742eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149048960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762947.239138:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 525795328 pending 0 free 3859808256 avail 3822059520 00000100:00100000:3.0:1789762947.239177:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1742eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149048960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762947.239183:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789762947.239220:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d174167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149048960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762947.293975:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351767040144 time 351767116851 state 0x0 ref 1 00000100:00100000:0.0:1789762947.293995:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d044e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140860544:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762947.294047:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 18874368, mtime: 0x6aad9d82, atime: 0x0, ctime: 0x6aad9d82, blocks: 0x9007 00010000:00010000:0.0:1789762947.294054:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5712f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762947.294067:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1789762947.294071:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762947.294075:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5712f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762947.294085:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5712f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762947.304504:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967948 is committed 00002000:00010000:1.0:1789762947.304524:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:1.0:1789762947.304534:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 36871 -> 38919 00010000:00010000:1.0:1789762947.304545:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5712f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.304555:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5712f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.304562:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5712f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.304567:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762947.304571:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5712f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.304579:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5712f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.304593:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5712f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.304598:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5712f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762947.304665:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d044e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140860544:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10671us (97280us total) trans 4294967948 rc 0/0 00000100:00100000:1.0:1789762947.304676:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 745 00000100:00100000:1.0:1789762947.304685:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351767040144 time 351767116851 state 0x2 ref 0 00000100:00100000:2.0:1789762947.306736:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762947.306774:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140860672 00000100:00100000:1.0:1789762947.306781:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140860672 00000100:00100000:1.0:1789762947.306816:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351767040144 time 351767116851 state 0x0 ref 1 00000100:00100000:1.0:1789762947.306827:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351867116851 time 351767116851 state 0x1 ref 1 00000100:00100000:0.0:1789762947.394057:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351867116851 time 351867204618 state 0x0 ref 1 00000100:00100000:0.0:1789762947.394082:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140860672:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762947.394138:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 19922944, mtime: 0x6aad9d82, atime: 0x0, ctime: 0x6aad9d82, blocks: 0x9807 00010000:00010000:0.0:1789762947.394148:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571300 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762947.394164:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1789762947.394168:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762947.394175:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762947.394189:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762947.405137:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967949 is committed 00002000:00010000:1.0:1789762947.405161:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:1.0:1789762947.405168:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 38919 -> 40967 00010000:00010000:1.0:1789762947.405180:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.405194:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.405205:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571300 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.405213:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762947.405219:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571300 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.405231:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571300 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.405248:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571300 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.405270:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca784e62/0xd08452c77c571300 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762947.405347:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140860672:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11272us (98610us total) trans 4294967949 rc 0/0 00000100:00100000:1.0:1789762947.405356:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 746 00000100:00100000:1.0:1789762947.405364:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351867116851 time 351867204618 state 0x2 ref 0 00000100:00100000:2.0:1789762947.407423:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762947.407458:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140860800 00000100:00100000:1.0:1789762947.407467:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140860800 00000100:00100000:1.0:1789762947.407503:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351867116851 time 351867204618 state 0x0 ref 1 00000100:00100000:1.0:1789762947.407514:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351967204618 time 351867204618 state 0x1 ref 1 00000100:00100000:2.0:1789762947.494130:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351967204618 time 351967279086 state 0x0 ref 1 00000100:00100000:2.0:1789762947.494166:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140860800:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762947.494210:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 20971520, mtime: 0x6aad9d82, atime: 0x0, ctime: 0x6aad9d82, blocks: 0xa007 00010000:00010000:2.0:1789762947.494218:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da61bb32/0xd08452c77c571307 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762947.494231:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1789762947.494235:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762947.494240:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da61bb32/0xd08452c77c571307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762947.494251:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da61bb32/0xd08452c77c571307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762947.505176:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:2.0:1789762947.505183:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 40967 -> 43015 00000001:00080000:1.0:1789762947.505188:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967950 is committed 00010000:00010000:2.0:1789762947.505197:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da61bb32/0xd08452c77c571307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762947.505212:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da61bb32/0xd08452c77c571307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762947.505224:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da61bb32/0xd08452c77c571307 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762947.505232:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762947.505244:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da61bb32/0xd08452c77c571307 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762947.505255:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da61bb32/0xd08452c77c571307 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762947.505272:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da61bb32/0xd08452c77c571307 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762947.505278:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da61bb32/0xd08452c77c571307 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762947.505348:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140860800:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11186us (97924us total) trans 4294967950 rc 0/0 00000100:00100000:2.0:1789762947.505358:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 747 00000100:00100000:2.0:1789762947.505380:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351967204618 time 351967279086 state 0x2 ref 0 00000100:00100000:2.0:1789762947.507413:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762947.507500:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140860928 00000100:00100000:1.0:1789762947.507509:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140860928 00000100:00100000:1.0:1789762947.507544:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 351967204618 time 351967279086 state 0x0 ref 1 00000100:00100000:1.0:1789762947.507555:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352067279086 time 351967279086 state 0x1 ref 1 00000100:00100000:0.0:1789762947.594252:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352067279086 time 352067398873 state 0x0 ref 1 00000100:00100000:0.0:1789762947.594277:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140860928:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762947.594341:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 22020096, mtime: 0x6aad9d82, atime: 0x0, ctime: 0x6aad9d82, blocks: 0xa807 00010000:00010000:0.0:1789762947.594349:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c57130e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762947.594363:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1789762947.594366:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762947.594371:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c57130e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762947.594384:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c57130e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762947.608883:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:1.0:1789762947.608892:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 43015 -> 45063 00010000:00010000:1.0:1789762947.608906:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c57130e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.608928:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c57130e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.608937:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c57130e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.608943:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762947.608948:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c57130e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.608956:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c57130e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.608973:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c57130e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.608979:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c57130e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762947.609089:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140860928:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14801us (101655us total) trans 4294967951 rc 0/0 00000100:00100000:1.0:1789762947.609100:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 748 00000100:00100000:1.0:1789762947.609112:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352067279086 time 352067398873 state 0x2 ref 0 00000001:00080000:1.0:1789762947.609151:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967951 is committed 00000100:00100000:3.0:1789762947.611753:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762947.611794:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140861056 00000100:00100000:1.0:1789762947.611804:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140861056 00000100:00100000:1.0:1789762947.611857:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352067279086 time 352067398873 state 0x0 ref 1 00000100:00100000:1.0:1789762947.611868:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352167398873 time 352067398873 state 0x1 ref 1 00000100:00100000:3.0:1789762947.694400:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352167398873 time 352167547461 state 0x0 ref 1 00000100:00100000:3.0:1789762947.694425:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140861056:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762947.694488:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 23068672, mtime: 0x6aad9d82, atime: 0x0, ctime: 0x6aad9d82, blocks: 0xb007 00010000:00010000:3.0:1789762947.694495:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571315 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762947.694508:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1789762947.694512:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762947.694516:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762947.694540:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762947.706987:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967952 is committed 00002000:00010000:1.0:1789762947.707008:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:1.0:1789762947.707013:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 1789762946 -> 1789762947 00002000:00010000:1.0:1789762947.707016:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 1789762946 -> 1789762947 00002000:00010000:1.0:1789762947.707018:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 45063 -> 47111 00010000:00010000:1.0:1789762947.707029:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.707040:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.707048:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.707053:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762947.707056:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.707063:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571315 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.707077:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571315 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.707100:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571315 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762947.707170:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140861056:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12752us (95415us total) trans 4294967952 rc 0/0 00000100:00100000:1.0:1789762947.707180:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 749 00000100:00100000:1.0:1789762947.707190:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352167398873 time 352167547461 state 0x2 ref 0 00000100:00100000:3.0:1789762947.709416:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762947.709471:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140861184 00000100:00100000:2.0:1789762947.709479:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140861184 00000100:00100000:2.0:1789762947.709519:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352167398873 time 352167547461 state 0x0 ref 1 00000100:00100000:2.0:1789762947.709531:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352267547461 time 352167547461 state 0x1 ref 1 00000100:00100000:3.0:1789762947.794527:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352267547461 time 352267674004 state 0x0 ref 1 00000100:00100000:3.0:1789762947.794552:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140861184:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762947.794603:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 24117248, mtime: 0x6aad9d83, atime: 0x0, ctime: 0x6aad9d83, blocks: 0xb807 00010000:00010000:3.0:1789762947.794611:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c57131c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762947.794624:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1789762947.794628:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762947.794633:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c57131c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762947.794643:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c57131c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762947.806492:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967953 is committed 00002000:00010000:1.0:1789762947.806504:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:1.0:1789762947.806509:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 47111 -> 49159 00010000:00010000:1.0:1789762947.806519:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c57131c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.806528:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c57131c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.806535:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c57131c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.806541:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762947.806544:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c57131c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.806551:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c57131c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.806575:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c57131c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.806581:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c57131c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762947.806635:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140861184:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12091us (97218us total) trans 4294967953 rc 0/0 00000100:00100000:1.0:1789762947.806642:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 750 00000100:00100000:1.0:1789762947.806651:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352267547461 time 352267674004 state 0x2 ref 0 00000100:00100000:3.0:1789762947.808802:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762947.808864:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140861312 00000100:00100000:1.0:1789762947.808872:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140861312 00000100:00100000:1.0:1789762947.808915:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352267547461 time 352267674004 state 0x0 ref 1 00000100:00100000:1.0:1789762947.808942:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352367674004 time 352267674004 state 0x1 ref 1 00000100:00100000:0.0:1789762947.894653:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352367674004 time 352367788871 state 0x0 ref 1 00000100:00100000:0.0:1789762947.894679:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140861312:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762947.894734:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 25165824, mtime: 0x6aad9d83, atime: 0x0, ctime: 0x6aad9d83, blocks: 0xc007 00010000:00010000:0.0:1789762947.894741:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571323 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762947.894773:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1789762947.894778:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762947.894785:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762947.894799:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762947.906888:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 25165824 -> 26214400 00000001:00080000:2.0:1789762947.906892:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967954 is committed 00002000:00010000:1.0:1789762947.906897:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 49159 -> 51207 00010000:00010000:1.0:1789762947.906911:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.906926:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.906950:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571323 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.906956:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762947.906960:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571323 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.906966:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571323 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.906980:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571323 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.906985:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571323 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762947.907047:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140861312:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12376us (98243us total) trans 4294967954 rc 0/0 00000100:00100000:1.0:1789762947.907055:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 751 00000100:00100000:1.0:1789762947.907064:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352367674004 time 352367788871 state 0x2 ref 0 00000100:00100000:3.0:1789762947.909095:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762947.909134:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140861440 00000100:00100000:1.0:1789762947.909142:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140861440 00000100:00100000:1.0:1789762947.909184:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352367674004 time 352367788871 state 0x0 ref 1 00000100:00100000:1.0:1789762947.909204:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352467788871 time 352367788871 state 0x1 ref 1 00000100:00100000:1.0:1789762947.994711:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352467788871 time 352467858606 state 0x0 ref 1 00000100:00100000:1.0:1789762947.994737:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140861440:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762947.994797:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 26214400, mtime: 0x6aad9d83, atime: 0x0, ctime: 0x6aad9d83, blocks: 0xc807 00010000:00010000:1.0:1789762947.994805:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000717347f/0xd08452c77c57132a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.994819:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=352s v=(0 0) 00010000:00010000:1.0:1789762947.994822:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762947.994827:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000717347f/0xd08452c77c57132a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762947.994866:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000717347f/0xd08452c77c57132a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762948.005862:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 26214400 -> 27262976 00000001:00080000:2.0:1789762948.005862:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967955 is committed 00002000:00010000:1.0:1789762948.005868:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 51207 -> 53255 00010000:00010000:1.0:1789762948.005881:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000717347f/0xd08452c77c57132a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.005890:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000717347f/0xd08452c77c57132a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.005909:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000717347f/0xd08452c77c57132a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.005914:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762948.005918:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000717347f/0xd08452c77c57132a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.005924:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000717347f/0xd08452c77c57132a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.005938:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000717347f/0xd08452c77c57132a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.005944:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000717347f/0xd08452c77c57132a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762948.005998:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140861440:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11271us (96903us total) trans 4294967955 rc 0/0 00000100:00100000:1.0:1789762948.006006:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 752 00000100:00100000:1.0:1789762948.006015:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352467788871 time 352467858606 state 0x2 ref 0 00000100:00100000:3.0:1789762948.008139:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762948.008179:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140861568 00000100:00100000:1.0:1789762948.008187:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140861568 00000100:00100000:1.0:1789762948.008222:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352467788871 time 352467858606 state 0x0 ref 1 00000100:00100000:1.0:1789762948.008242:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352567858606 time 352467858606 state 0x1 ref 1 00000100:00100000:0.0:1789762948.094859:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352567858606 time 352567993026 state 0x0 ref 1 00000100:00100000:0.0:1789762948.094878:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140861568:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762948.094938:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 27262976, mtime: 0x6aad9d83, atime: 0x0, ctime: 0x6aad9d83, blocks: 0xd007 00010000:00010000:0.0:1789762948.094945:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571331 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762948.094958:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1789762948.094961:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762948.094966:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762948.094976:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762948.106373:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967956 is committed 00002000:00010000:1.0:1789762948.106384:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:1.0:1789762948.106389:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 53255 -> 55303 00010000:00010000:1.0:1789762948.106399:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.106410:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.106416:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.106421:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762948.106425:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.106432:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571331 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.106446:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571331 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.106451:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571331 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762948.106517:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140861568:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11642us (98377us total) trans 4294967956 rc 0/0 00000100:00100000:1.0:1789762948.106525:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 753 00000100:00100000:1.0:1789762948.106533:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352567858606 time 352567993026 state 0x2 ref 0 00000100:00100000:3.0:1789762948.108484:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762948.108527:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140861696 00000100:00100000:1.0:1789762948.108535:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140861696 00000100:00100000:1.0:1789762948.108573:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352567858606 time 352567993026 state 0x0 ref 1 00000100:00100000:1.0:1789762948.108584:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352667993026 time 352567993026 state 0x1 ref 1 00010000:00010000:1.0:1789762948.134958:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762948.194921:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352667993026 time 352668061164 state 0x0 ref 1 00000100:00100000:2.0:1789762948.194944:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140861696:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762948.194990:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 28311552, mtime: 0x6aad9d83, atime: 0x0, ctime: 0x6aad9d83, blocks: 0xd807 00010000:00010000:2.0:1789762948.194998:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571338 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762948.195011:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1789762948.195015:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762948.195020:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762948.195030:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762948.205769:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967957 is committed 00002000:00010000:1.0:1789762948.205780:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:1.0:1789762948.205786:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 55303 -> 57351 00010000:00010000:1.0:1789762948.205796:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.205806:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.205813:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.205819:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762948.205822:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.205852:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.205867:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571338 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.205873:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571338 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762948.205929:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140861696:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10990us (97444us total) trans 4294967957 rc 0/0 00000100:00100000:1.0:1789762948.205936:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 754 00000100:00100000:1.0:1789762948.205945:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352667993026 time 352668061164 state 0x2 ref 0 00000100:00100000:3.0:1789762948.207941:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762948.207973:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140861824 00000100:00100000:1.0:1789762948.207981:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140861824 00000100:00100000:1.0:1789762948.208017:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352667993026 time 352668061164 state 0x0 ref 1 00000100:00100000:1.0:1789762948.208029:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352768061164 time 352668061164 state 0x1 ref 1 00000100:00100000:0.0:1789762948.294983:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352768061164 time 352768130693 state 0x0 ref 1 00000100:00100000:0.0:1789762948.295004:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140861824:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762948.295053:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 29360128, mtime: 0x6aad9d83, atime: 0x0, ctime: 0x6aad9d83, blocks: 0xe007 00010000:00010000:0.0:1789762948.295061:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57133f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762948.295076:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1789762948.295079:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762948.295084:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57133f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762948.295094:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57133f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762948.306113:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967958 is committed 00002000:00010000:1.0:1789762948.306136:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:1.0:1789762948.306142:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 57351 -> 59399 00010000:00010000:1.0:1789762948.306152:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57133f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.306172:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57133f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.306179:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57133f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.306184:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762948.306187:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57133f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.306193:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57133f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.306207:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57133f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.306213:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57133f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762948.306272:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140861824:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11272us (98329us total) trans 4294967958 rc 0/0 00000100:00100000:1.0:1789762948.306280:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 755 00000100:00100000:1.0:1789762948.306290:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352768061164 time 352768130693 state 0x2 ref 0 00000100:00100000:3.0:1789762948.308338:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762948.308382:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140861952 00000100:00100000:1.0:1789762948.308396:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140861952 00000100:00100000:1.0:1789762948.308432:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352768061164 time 352768130693 state 0x0 ref 1 00000100:00100000:1.0:1789762948.308442:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352868130693 time 352768130693 state 0x1 ref 1 00000100:00100000:3.0:1789762948.395065:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352868130693 time 352868213303 state 0x0 ref 1 00000100:00100000:3.0:1789762948.395088:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140861952:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762948.395134:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 30408704, mtime: 0x6aad9d83, atime: 0x0, ctime: 0x6aad9d83, blocks: 0xe807 00010000:00010000:3.0:1789762948.395142:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571346 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762948.395156:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1789762948.395160:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762948.395164:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762948.395175:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762948.405744:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967959 is committed 00002000:00010000:1.0:1789762948.405758:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:1.0:1789762948.405763:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 59399 -> 61447 00010000:00010000:1.0:1789762948.405774:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.405784:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571346 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.405791:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571346 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.405796:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762948.405799:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571346 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.405806:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571346 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.405819:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571346 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.405824:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571346 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762948.405902:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140861952:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10821us (97562us total) trans 4294967959 rc 0/0 00000100:00100000:1.0:1789762948.405911:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 756 00000100:00100000:1.0:1789762948.405920:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352868130693 time 352868213303 state 0x2 ref 0 00000100:00100000:2.0:1789762948.407880:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762948.407919:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140862080 00000100:00100000:1.0:1789762948.407927:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140862080 00000100:00100000:1.0:1789762948.407962:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352868130693 time 352868213303 state 0x0 ref 1 00000100:00100000:1.0:1789762948.407973:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352968213303 time 352868213303 state 0x1 ref 1 00000100:00100000:3.0:1789762948.495172:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352968213303 time 352968320118 state 0x0 ref 1 00000100:00100000:3.0:1789762948.495193:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140862080:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762948.495240:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 31457280, mtime: 0x6aad9d83, atime: 0x0, ctime: 0x6aad9d83, blocks: 0xf007 00010000:00010000:3.0:1789762948.495247:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57134d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762948.495277:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1789762948.495280:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762948.495285:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57134d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762948.495295:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57134d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762948.505588:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:3.0:1789762948.505594:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 61447 -> 63495 00000001:00080000:1.0:1789762948.505598:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967960 is committed 00010000:00010000:3.0:1789762948.505604:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57134d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762948.505615:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57134d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762948.505622:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57134d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762948.505628:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762948.505631:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57134d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762948.505637:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57134d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762948.505661:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57134d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762948.505667:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57134d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762948.505733:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140862080:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10543us (97850us total) trans 4294967960 rc 0/0 00000100:00100000:3.0:1789762948.505742:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 757 00000100:00100000:3.0:1789762948.505750:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352968213303 time 352968320118 state 0x2 ref 0 00000100:00100000:0.0:1789762948.507858:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762948.507932:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140862208 00000100:00100000:1.0:1789762948.507940:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140862208 00000100:00100000:1.0:1789762948.507977:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 352968213303 time 352968320118 state 0x0 ref 1 00000100:00100000:1.0:1789762948.507988:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353068320118 time 352968320118 state 0x1 ref 1 00000100:00100000:0.0:1789762948.595248:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353068320118 time 353068396260 state 0x0 ref 1 00000100:00100000:0.0:1789762948.595271:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140862208:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762948.595339:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 32505856, mtime: 0x6aad9d83, atime: 0x0, ctime: 0x6aad9d83, blocks: 0xf807 00010000:00010000:0.0:1789762948.595349:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571354 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762948.595367:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1789762948.595383:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762948.595389:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762948.595403:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762948.607814:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967961 is committed 00002000:00010000:1.0:1789762948.607852:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:1.0:1789762948.607858:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 63495 -> 65543 00010000:00010000:1.0:1789762948.607871:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.607883:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.607898:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571354 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.607903:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762948.607906:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571354 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.607913:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571354 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.607928:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571354 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.607934:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a736457e/0xd08452c77c571354 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762948.608015:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140862208:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12748us (100154us total) trans 4294967961 rc 0/0 00000100:00100000:1.0:1789762948.608024:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 758 00000100:00100000:1.0:1789762948.608034:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353068320118 time 353068396260 state 0x2 ref 0 00000100:00100000:2.0:1789762948.610361:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762948.610404:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140862336 00000100:00100000:1.0:1789762948.610414:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140862336 00000100:00100000:1.0:1789762948.610451:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353068320118 time 353068396260 state 0x0 ref 1 00000100:00100000:1.0:1789762948.610471:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353168396260 time 353068396260 state 0x1 ref 1 00000100:00100000:3.0:1789762948.695380:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353168396260 time 353168519353 state 0x0 ref 1 00000100:00100000:3.0:1789762948.695401:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140862336:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762948.695446:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 33554432, mtime: 0x6aad9d83, atime: 0x0, ctime: 0x6aad9d83, blocks: 0x10007 00010000:00010000:3.0:1789762948.695453:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57135b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762948.695467:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789762948.695470:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762948.695475:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57135b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762948.695485:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57135b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762948.706259:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967962 is committed 00002000:00010000:1.0:1789762948.706270:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:1.0:1789762948.706275:0:14626:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 1789762947 -> 1789762948 00002000:00010000:1.0:1789762948.706278:0:14626:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 1789762947 -> 1789762948 00002000:00010000:1.0:1789762948.706281:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 65543 -> 67591 00010000:00010000:1.0:1789762948.706290:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57135b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.706300:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57135b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.706321:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57135b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.706328:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762948.706332:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57135b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.706338:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57135b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.706352:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57135b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.706358:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57135b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762948.706432:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140862336:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11035us (96069us total) trans 4294967962 rc 0/0 00000100:00100000:1.0:1789762948.706441:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 759 00000100:00100000:1.0:1789762948.706450:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353168396260 time 353168519353 state 0x2 ref 0 00000100:00100000:0.0:1789762948.708601:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762948.708645:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140862464 00000100:00100000:3.0:1789762948.708654:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140862464 00000100:00100000:3.0:1789762948.708693:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353168396260 time 353168519353 state 0x0 ref 1 00000100:00100000:3.0:1789762948.708708:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353268519353 time 353168519353 state 0x1 ref 1 00000100:00100000:0.0:1789762948.795446:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353268519353 time 353268594836 state 0x0 ref 1 00000100:00100000:0.0:1789762948.795468:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140862464:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762948.795517:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 34603008, mtime: 0x6aad9d84, atime: 0x0, ctime: 0x6aad9d84, blocks: 0x10807 00010000:00010000:0.0:1789762948.795524:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c571362 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762948.795538:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1789762948.795542:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762948.795546:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c571362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762948.795558:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c571362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762948.806428:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967963 is committed 00002000:00010000:1.0:1789762948.806446:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 34603008 -> 35651584 00002000:00010000:1.0:1789762948.806451:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 67591 -> 69639 00010000:00010000:1.0:1789762948.806462:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c571362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.806472:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c571362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.806479:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c571362 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.806484:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762948.806488:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c571362 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.806494:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c571362 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.806509:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c571362 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.806524:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ceb89053/0xd08452c77c571362 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762948.806589:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140862464:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11126us (97987us total) trans 4294967963 rc 0/0 00000100:00100000:1.0:1789762948.806599:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 760 00000100:00100000:1.0:1789762948.806609:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353268519353 time 353268594836 state 0x2 ref 0 00000100:00100000:2.0:1789762948.808865:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762948.808889:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140862592 00000100:00100000:1.0:1789762948.808897:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140862592 00000100:00100000:1.0:1789762948.808934:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353268519353 time 353268594836 state 0x0 ref 1 00000100:00100000:1.0:1789762948.808945:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353368594836 time 353268594836 state 0x1 ref 1 00000100:00100000:2.0:1789762948.895525:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353368594836 time 353368672546 state 0x0 ref 1 00000100:00100000:2.0:1789762948.895558:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140862592:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762948.895608:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 35651584, mtime: 0x6aad9d84, atime: 0x0, ctime: 0x6aad9d84, blocks: 0x11007 00010000:00010000:2.0:1789762948.895618:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c571369 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762948.895655:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1789762948.895661:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762948.895667:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c571369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762948.895679:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c571369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762948.907197:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967964 is committed 00002000:00010000:1.0:1789762948.907206:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:1.0:1789762948.907212:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 69639 -> 71687 00010000:00010000:1.0:1789762948.907226:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c571369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.907241:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c571369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.907252:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c571369 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.907272:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762948.907277:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c571369 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.907284:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c571369 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.907300:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c571369 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.907319:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb784abb/0xd08452c77c571369 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762948.907389:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140862592:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11839us (98522us total) trans 4294967964 rc 0/0 00000100:00100000:1.0:1789762948.907398:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 761 00000100:00100000:1.0:1789762948.907409:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353368594836 time 353368672546 state 0x2 ref 0 00000100:00100000:0.0:1789762948.909709:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762948.909745:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140862720 00000100:00100000:1.0:1789762948.909754:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140862720 00000100:00100000:1.0:1789762948.909791:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353368594836 time 353368672546 state 0x0 ref 1 00000100:00100000:1.0:1789762948.909802:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353468672546 time 353368672546 state 0x1 ref 1 00000100:00100000:1.0:1789762948.995603:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353468672546 time 353468749056 state 0x0 ref 1 00000100:00100000:1.0:1789762948.995642:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140862720:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762948.995694:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 36700160, mtime: 0x6aad9d84, atime: 0x0, ctime: 0x6aad9d84, blocks: 0x11807 00010000:00010000:1.0:1789762948.995701:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c571370 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.995715:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1789762948.995719:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762948.995724:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c571370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762948.995735:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c571370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762949.007364:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967965 is committed 00002000:00010000:1.0:1789762949.007433:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:1.0:1789762949.007439:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 71687 -> 73735 00010000:00010000:1.0:1789762949.007449:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c571370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.007460:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c571370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.007466:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c571370 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.007471:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762949.007481:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c571370 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.007488:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c571370 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.007503:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c571370 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.007508:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c571370 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762949.007584:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140862720:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11946us (97873us total) trans 4294967965 rc 0/0 00000100:00100000:1.0:1789762949.007592:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 762 00000100:00100000:1.0:1789762949.007602:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353468672546 time 353468749056 state 0x2 ref 0 00000100:00100000:0.0:1789762949.009860:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762949.009885:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140862848 00000100:00100000:1.0:1789762949.009904:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140862848 00000100:00080000:0.0:1789762949.009940:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762949.009950:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353468672546 time 353468749056 state 0x0 ref 1 00000100:00100000:1.0:1789762949.009962:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353568749056 time 353468749056 state 0x1 ref 1 00000100:00100000:3.0:1789762949.095691:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353568749056 time 353568830798 state 0x0 ref 1 00000100:00100000:3.0:1789762949.095715:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140862848:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762949.095764:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 37748736, mtime: 0x6aad9d84, atime: 0x0, ctime: 0x6aad9d84, blocks: 0x12007 00010000:00010000:3.0:1789762949.095771:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571377 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.095785:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789762949.095789:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762949.095794:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571377 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.095805:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571377 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762949.107273:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967966 is committed 00002000:00010000:1.0:1789762949.107284:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:1.0:1789762949.107289:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 73735 -> 75783 00010000:00010000:1.0:1789762949.107300:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571377 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.107331:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571377 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.107343:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571377 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.107351:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762949.107356:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571377 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.107367:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571377 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.107388:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571377 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.107394:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571377 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762949.107454:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140862848:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11747us (97593us total) trans 4294967966 rc 0/0 00000100:00100000:1.0:1789762949.107464:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 763 00000100:00100000:1.0:1789762949.107473:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353568749056 time 353568830798 state 0x2 ref 0 00000100:00100000:1.0:1789762949.109550:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762949.109607:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140862976 00000100:00100000:2.0:1789762949.109617:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140862976 00000100:00100000:2.0:1789762949.109662:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353568749056 time 353568830798 state 0x0 ref 1 00000100:00100000:2.0:1789762949.109676:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353668830798 time 353568830798 state 0x1 ref 1 00010000:00010000:2.0:1789762949.158974:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762949.195805:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353668830798 time 353668951756 state 0x0 ref 1 00000100:00100000:3.0:1789762949.195878:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140862976:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762949.195929:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 38797312, mtime: 0x6aad9d84, atime: 0x0, ctime: 0x6aad9d84, blocks: 0x12807 00010000:00010000:3.0:1789762949.195937:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57137e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.195951:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789762949.195955:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762949.195959:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57137e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.195971:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57137e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762949.208986:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967967 is committed 00002000:00010000:3.0:1789762949.208991:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:3.0:1789762949.208997:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 75783 -> 77831 00010000:00010000:3.0:1789762949.209011:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57137e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.209022:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57137e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.209039:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57137e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.209045:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762949.209048:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57137e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.209055:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57137e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.209071:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57137e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.209076:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57137e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762949.209151:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140862976:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13326us (99598us total) trans 4294967967 rc 0/0 00000100:00100000:3.0:1789762949.209159:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 764 00000100:00100000:3.0:1789762949.209170:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353668830798 time 353668951756 state 0x2 ref 0 00000100:00100000:2.0:1789762949.211639:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762949.211693:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140863104 00000100:00100000:1.0:1789762949.211704:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140863104 00000100:00100000:1.0:1789762949.211750:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353668830798 time 353668951756 state 0x0 ref 1 00000100:00100000:1.0:1789762949.211766:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353768951756 time 353668951756 state 0x1 ref 1 00000100:00100000:0.0:1789762949.295929:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353768951756 time 353769065356 state 0x0 ref 1 00000100:00100000:0.0:1789762949.295953:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140863104:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762949.296003:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 39845888, mtime: 0x6aad9d84, atime: 0x0, ctime: 0x6aad9d84, blocks: 0x13007 00010000:00010000:0.0:1789762949.296012:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c571385 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.296027:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1789762949.296031:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762949.296037:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c571385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.296050:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c571385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762949.307644:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967413 is committed 00000001:00080000:2.0:1789762949.307672:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967414 is committed 00000001:00080000:2.0:1789762949.307757:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967415 is committed 00000001:00080000:1.0:1789762949.311293:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967968 is committed 00002000:00010000:0.0:1789762949.311337:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:0.0:1789762949.311341:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 77831 -> 79879 00010000:00010000:0.0:1789762949.311353:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c571385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.311364:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c571385 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.311371:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c571385 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.311382:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762949.311386:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c571385 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.311404:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c571385 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.311420:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c571385 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.311425:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c571385 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762949.311502:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140863104:12345-192.168.203.31@tcp:4:dd.500 Request processed in 15553us (99860us total) trans 4294967968 rc 0/0 00000100:00100000:0.0:1789762949.311511:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 765 00000100:00100000:0.0:1789762949.311521:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353768951756 time 353769065356 state 0x2 ref 0 00000100:00100000:0.0:1789762949.313894:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762949.313938:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140863232 00000100:00100000:1.0:1789762949.313946:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140863232 00000100:00100000:1.0:1789762949.313984:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353768951756 time 353769065356 state 0x0 ref 1 00000100:00100000:1.0:1789762949.313996:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353869065356 time 353769065356 state 0x1 ref 1 00000100:00100000:1.0:1789762949.395974:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353869065356 time 353869119336 state 0x0 ref 1 00000100:00100000:1.0:1789762949.396002:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140863232:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762949.396061:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 40894464, mtime: 0x6aad9d84, atime: 0x0, ctime: 0x6aad9d84, blocks: 0x13807 00010000:00010000:1.0:1789762949.396072:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57138c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.396087:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1789762949.396091:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762949.396096:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57138c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.396107:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57138c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762949.407691:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967969 is committed 00002000:00010000:0.0:1789762949.407705:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:0.0:1789762949.407709:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 79879 -> 81927 00010000:00010000:0.0:1789762949.407720:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57138c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.407731:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57138c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.407745:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57138c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.407750:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c7400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762949.407754:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57138c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.407760:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57138c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.407775:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57138c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.407781:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57138c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762949.407889:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140863232:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11893us (93990us total) trans 4294967969 rc 0/0 00000100:00100000:0.0:1789762949.407898:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 766 00000100:00100000:0.0:1789762949.407907:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353869065356 time 353869119336 state 0x2 ref 0 00000100:00100000:0.0:1789762949.410345:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762949.410389:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140863360 00000100:00100000:3.0:1789762949.410398:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140863360 00000100:00100000:3.0:1789762949.410441:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353869065356 time 353869119336 state 0x0 ref 1 00000100:00100000:3.0:1789762949.410473:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353969119336 time 353869119336 state 0x1 ref 1 00000100:00100000:0.0:1789762949.496071:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353969119336 time 353969217361 state 0x0 ref 1 00000100:00100000:0.0:1789762949.496123:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140863360:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762949.496175:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 41943040, mtime: 0x6aad9d84, atime: 0x0, ctime: 0x6aad9d84, blocks: 0x14007 00010000:00010000:0.0:1789762949.496183:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016554480/0xd08452c77c571393 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.496197:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1789762949.496201:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762949.496205:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016554480/0xd08452c77c571393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.496216:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016554480/0xd08452c77c571393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762949.508272:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967970 is committed 00002000:00010000:0.0:1789762949.508295:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:0.0:1789762949.508316:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 81927 -> 83975 00010000:00010000:0.0:1789762949.508330:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016554480/0xd08452c77c571393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.508356:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016554480/0xd08452c77c571393 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.508367:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016554480/0xd08452c77c571393 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.508375:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762949.508389:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016554480/0xd08452c77c571393 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.508401:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016554480/0xd08452c77c571393 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.508423:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016554480/0xd08452c77c571393 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.508430:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016554480/0xd08452c77c571393 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762949.508507:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140863360:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12388us (98159us total) trans 4294967970 rc 0/0 00000100:00100000:0.0:1789762949.508515:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 767 00000100:00100000:0.0:1789762949.508526:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353969119336 time 353969217361 state 0x2 ref 0 00000100:00100000:1.0:1789762949.510811:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762949.510867:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140863488 00000100:00100000:0.0:1789762949.510876:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140863488 00000100:00100000:0.0:1789762949.510916:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 353969119336 time 353969217361 state 0x0 ref 1 00000100:00100000:0.0:1789762949.510928:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354069217361 time 353969217361 state 0x1 ref 1 00000100:00100000:2.0:1789762949.596159:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354069217361 time 354069304183 state 0x0 ref 1 00000100:00100000:2.0:1789762949.596181:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140863488:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762949.596243:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 42991616, mtime: 0x6aad9d84, atime: 0x0, ctime: 0x6aad9d84, blocks: 0x14807 00010000:00010000:2.0:1789762949.596251:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa6ea37b/0xd08452c77c57139a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762949.596275:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1789762949.596279:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762949.596283:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa6ea37b/0xd08452c77c57139a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762949.596297:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa6ea37b/0xd08452c77c57139a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762949.607869:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967971 is committed 00002000:00010000:0.0:1789762949.607874:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:0.0:1789762949.607881:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 83975 -> 86023 00010000:00010000:0.0:1789762949.607895:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa6ea37b/0xd08452c77c57139a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.607915:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa6ea37b/0xd08452c77c57139a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.607926:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa6ea37b/0xd08452c77c57139a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.607932:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762949.607936:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa6ea37b/0xd08452c77c57139a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.607944:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa6ea37b/0xd08452c77c57139a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.607957:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa6ea37b/0xd08452c77c57139a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.607962:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa6ea37b/0xd08452c77c57139a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762949.608028:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140863488:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11852us (97216us total) trans 4294967971 rc 0/0 00000100:00100000:0.0:1789762949.608037:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 768 00000100:00100000:0.0:1789762949.608046:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354069217361 time 354069304183 state 0x2 ref 0 00000100:00100000:1.0:1789762949.610244:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762949.610281:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140863616 00000100:00100000:0.0:1789762949.610294:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140863616 00000100:00100000:0.0:1789762949.610341:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354069217361 time 354069304183 state 0x0 ref 1 00000100:00100000:0.0:1789762949.610353:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354169304183 time 354069304183 state 0x1 ref 1 00000100:00100000:1.0:1789762949.696286:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354169304183 time 354169427181 state 0x0 ref 1 00000100:00100000:1.0:1789762949.696337:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140863616:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762949.696393:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 44040192, mtime: 0x6aad9d84, atime: 0x0, ctime: 0x6aad9d84, blocks: 0x15007 00010000:00010000:1.0:1789762949.696402:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c5713a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.696420:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1789762949.696425:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762949.696432:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c5713a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.696447:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c5713a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762949.708453:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967972 is committed 00002000:00010000:0.0:1789762949.708476:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:0.0:1789762949.708482:0:11722:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 1789762948 -> 1789762949 00002000:00010000:0.0:1789762949.708485:0:11722:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 1789762948 -> 1789762949 00002000:00010000:0.0:1789762949.708487:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 86023 -> 88073 00010000:00010000:0.0:1789762949.708497:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c5713a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.708508:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c5713a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.708515:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c5713a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.708520:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762949.708523:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c5713a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.708529:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c5713a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.708542:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c5713a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.708558:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004344e374/0xd08452c77c5713a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762949.708621:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140863616:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12297us (98377us total) trans 4294967972 rc 0/0 00000100:00100000:0.0:1789762949.708629:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 769 00000100:00100000:0.0:1789762949.708638:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354169304183 time 354169427181 state 0x2 ref 0 00000100:00100000:2.0:1789762949.710916:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762949.710955:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140863744 00000100:00100000:0.0:1789762949.710964:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140863744 00000100:00100000:0.0:1789762949.711004:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354169304183 time 354169427181 state 0x0 ref 1 00000100:00100000:0.0:1789762949.711015:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354269427181 time 354169427181 state 0x1 ref 1 00000100:00100000:1.0:1789762949.796411:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354269427181 time 354269557376 state 0x0 ref 1 00000100:00100000:1.0:1789762949.796439:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140863744:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762949.796502:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 45088768, mtime: 0x6aad9d85, atime: 0x0, ctime: 0x6aad9d85, blocks: 0x15809 00010000:00010000:1.0:1789762949.796509:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c5713a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.796523:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1789762949.796526:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762949.796531:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c5713a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762949.796542:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c5713a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762949.807633:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967973 is committed 00002000:00010000:0.0:1789762949.807657:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:0.0:1789762949.807663:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 88073 -> 90121 00010000:00010000:0.0:1789762949.807674:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c5713a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.807685:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c5713a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.807692:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c5713a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.807708:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762949.807711:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c5713a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.807718:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c5713a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.807732:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c5713a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.807738:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c5713a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762949.807806:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140863744:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11375us (96888us total) trans 4294967973 rc 0/0 00000100:00100000:0.0:1789762949.807814:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 770 00000100:00100000:0.0:1789762949.807824:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354269427181 time 354269557376 state 0x2 ref 0 00000100:00100000:2.0:1789762949.810044:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762949.810080:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140863872 00000100:00100000:0.0:1789762949.810088:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140863872 00000100:00100000:0.0:1789762949.810126:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354269427181 time 354269557376 state 0x0 ref 1 00000100:00100000:0.0:1789762949.810138:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354369557376 time 354269557376 state 0x1 ref 1 00000100:00100000:3.0:1789762949.896520:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354369557376 time 354369665190 state 0x0 ref 1 00000100:00100000:3.0:1789762949.896548:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140863872:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762949.896598:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 46137344, mtime: 0x6aad9d85, atime: 0x0, ctime: 0x6aad9d85, blocks: 0x16009 00010000:00010000:3.0:1789762949.896606:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c5713af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.896620:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=354s v=(0 0) 00010000:00010000:3.0:1789762949.896624:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762949.896629:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c5713af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.896640:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c5713af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762949.909231:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967974 is committed 00002000:00010000:0.0:1789762949.909245:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:0.0:1789762949.909257:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 90121 -> 92169 00010000:00010000:0.0:1789762949.909279:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c5713af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.909290:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c5713af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.909309:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c5713af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.909315:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762949.909319:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c5713af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.909326:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c5713af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.909347:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c5713af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762949.909353:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c5713af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762949.909421:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140863872:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12881us (99375us total) trans 4294967974 rc 0/0 00000100:00100000:0.0:1789762949.909429:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 771 00000100:00100000:0.0:1789762949.909439:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354369557376 time 354369665190 state 0x2 ref 0 00000100:00100000:0.0:1789762949.911730:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762949.911783:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140864000 00000100:00100000:3.0:1789762949.911793:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140864000 00000100:00100000:3.0:1789762949.911862:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354369557376 time 354369665190 state 0x0 ref 1 00000100:00100000:3.0:1789762949.911879:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354469665190 time 354369665190 state 0x1 ref 1 00000100:00100000:3.0:1789762949.996590:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354469665190 time 354469735340 state 0x0 ref 1 00000100:00100000:3.0:1789762949.996627:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140864000:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762949.996688:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 47185920, mtime: 0x6aad9d85, atime: 0x0, ctime: 0x6aad9d85, blocks: 0x16809 00010000:00010000:3.0:1789762949.996695:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.996709:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=354s v=(0 0) 00010000:00010000:3.0:1789762949.996713:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762949.996718:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762949.996729:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762950.008397:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 47185920 -> 48234496 00000001:00080000:2.0:1789762950.008405:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967975 is committed 00002000:00010000:3.0:1789762950.008405:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 92169 -> 94217 00010000:00010000:3.0:1789762950.008418:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.008430:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.008438:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.008444:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762950.008454:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.008461:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.008475:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.008481:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762950.008550:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140864000:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11926us (96817us total) trans 4294967975 rc 0/0 00000100:00100000:3.0:1789762950.008559:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 772 00000100:00100000:3.0:1789762950.008570:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354469665190 time 354469735340 state 0x2 ref 0 00000100:00100000:2.0:1789762950.010788:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762950.010868:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140864128 00000100:00100000:0.0:1789762950.010876:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140864128 00000100:00100000:0.0:1789762950.010917:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354469665190 time 354469735340 state 0x0 ref 1 00000100:00100000:0.0:1789762950.010928:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354569735340 time 354469735340 state 0x1 ref 1 00000100:00100000:3.0:1789762950.096747:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354569735340 time 354569891102 state 0x0 ref 1 00000100:00100000:3.0:1789762950.096785:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140864128:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762950.096866:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 48234496, mtime: 0x6aad9d85, atime: 0x0, ctime: 0x6aad9d85, blocks: 0x17009 00010000:00010000:3.0:1789762950.096874:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.096888:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=354s v=(0 0) 00010000:00010000:3.0:1789762950.096905:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762950.096911:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.096922:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762950.108203:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967976 is committed 00002000:00010000:3.0:1789762950.108206:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:3.0:1789762950.108213:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 94217 -> 96265 00010000:00010000:3.0:1789762950.108227:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.108243:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.108254:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.108261:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762950.108265:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.108272:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.108288:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.108317:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762950.108386:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140864128:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11620us (97595us total) trans 4294967976 rc 0/0 00000100:00100000:3.0:1789762950.108394:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 773 00000100:00100000:3.0:1789762950.108404:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354569735340 time 354569891102 state 0x2 ref 0 00000100:00100000:0.0:1789762950.110494:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762950.110529:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140864256 00000100:00100000:3.0:1789762950.110537:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140864256 00000100:00100000:3.0:1789762950.110574:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354569735340 time 354569891102 state 0x0 ref 1 00000100:00100000:3.0:1789762950.110586:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354669891102 time 354569891102 state 0x1 ref 1 00010000:00010000:3.0:1789762950.182929:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762950.196822:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354669891102 time 354669969278 state 0x0 ref 1 00000100:00100000:3.0:1789762950.196868:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d174166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140864256:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762950.196915:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 49283072, mtime: 0x6aad9d85, atime: 0x0, ctime: 0x6aad9d85, blocks: 0x17809 00010000:00010000:3.0:1789762950.196923:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.196938:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=354s v=(0 0) 00010000:00010000:3.0:1789762950.196959:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762950.196966:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.196982:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762950.208968:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967977 is committed 00002000:00010000:3.0:1789762950.208970:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 49283072 -> 50331648 00002000:00010000:3.0:1789762950.208977:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 96265 -> 98313 00010000:00010000:3.0:1789762950.208990:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.209002:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.209009:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.209014:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762950.209017:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.209024:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.209039:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.209055:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762950.209124:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d174166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140864256:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12263us (98628us total) trans 4294967977 rc 0/0 00000100:00100000:3.0:1789762950.209134:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 774 00000100:00100000:3.0:1789762950.209144:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354669891102 time 354669969278 state 0x2 ref 0 00000100:00100000:0.0:1789762950.211621:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762950.211658:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140864384 00000100:00100000:3.0:1789762950.211668:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140864384 00000100:00100000:3.0:1789762950.211718:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354669891102 time 354669969278 state 0x0 ref 1 00000100:00100000:3.0:1789762950.211733:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354769969278 time 354669969278 state 0x1 ref 1 00000100:00100000:0.0:1789762950.296924:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354769969278 time 354770070755 state 0x0 ref 1 00000100:00100000:0.0:1789762950.296949:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140864384:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762950.297001:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 50331648, mtime: 0x6aad9d85, atime: 0x0, ctime: 0x6aad9d85, blocks: 0x18009 00010000:00010000:0.0:1789762950.297009:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.297023:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1789762950.297027:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762950.297032:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.297043:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762950.308728:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967978 is committed 00002000:00010000:0.0:1789762950.308758:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:0.0:1789762950.308769:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 98313 -> 100361 00010000:00010000:0.0:1789762950.308782:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.308793:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.308800:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.308805:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762950.308809:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.308816:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.308849:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.308855:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762950.308927:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140864384:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11984us (97305us total) trans 4294967978 rc 0/0 00000100:00100000:0.0:1789762950.308936:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 775 00000100:00100000:0.0:1789762950.308947:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354769969278 time 354770070755 state 0x2 ref 0 00000100:00100000:0.0:1789762950.311221:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762950.311267:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140864512 00000100:00100000:3.0:1789762950.311278:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140864512 00000100:00100000:3.0:1789762950.311341:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354769969278 time 354770070755 state 0x0 ref 1 00000100:00100000:3.0:1789762950.311358:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354870070755 time 354770070755 state 0x1 ref 1 00000100:00100000:0.0:1789762950.397110:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354870070755 time 354870242822 state 0x0 ref 1 00000100:00100000:0.0:1789762950.397161:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140864512:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762950.397321:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 51380224, mtime: 0x6aad9d85, atime: 0x0, ctime: 0x6aad9d85, blocks: 0x18809 00010000:00010000:0.0:1789762950.397357:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.397385:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1789762950.397393:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762950.397405:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.397431:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762950.415097:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967979 is committed 00002000:00010000:0.0:1789762950.415175:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:0.0:1789762950.415185:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 100361 -> 102409 00010000:00010000:0.0:1789762950.415204:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.415221:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.415250:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.415270:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762950.415276:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.415287:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.415347:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.415364:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762950.415484:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140864512:12345-192.168.203.31@tcp:4:dd.500 Request processed in 18342us (104258us total) trans 4294967979 rc 0/0 00000100:00100000:0.0:1789762950.415500:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 776 00000100:00100000:0.0:1789762950.415515:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354870070755 time 354870242822 state 0x2 ref 0 00000100:00100000:2.0:1789762950.418390:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762950.418462:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140864640 00000100:00100000:3.0:1789762950.418477:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140864640 00000100:00100000:3.0:1789762950.418544:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354870070755 time 354870242822 state 0x0 ref 1 00000100:00100000:3.0:1789762950.418580:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354970242822 time 354870242822 state 0x1 ref 1 00000100:00100000:0.0:1789762950.497403:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354970242822 time 354970541681 state 0x0 ref 1 00000100:00100000:0.0:1789762950.497464:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140864640:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762950.497566:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 52428800, mtime: 0x6aad9d85, atime: 0x0, ctime: 0x6aad9d85, blocks: 0x19009 00010000:00010000:0.0:1789762950.497579:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.497633:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1789762950.497656:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762950.497669:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.497696:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762950.513693:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967980 is committed 00002000:00010000:0.0:1789762950.513782:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:0.0:1789762950.513794:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 102409 -> 104457 00010000:00010000:0.0:1789762950.513815:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.513872:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.513885:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.513894:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762950.513900:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.513911:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.513965:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.513979:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762950.514118:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140864640:12345-192.168.203.31@tcp:4:dd.500 Request processed in 16684us (95724us total) trans 4294967980 rc 0/0 00000100:00100000:0.0:1789762950.514137:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 777 00000100:00100000:0.0:1789762950.514157:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354970242822 time 354970541681 state 0x2 ref 0 00000100:00100000:1.0:1789762950.516555:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762950.516629:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140864768 00000100:00100000:0.0:1789762950.516644:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140864768 00000100:00100000:0.0:1789762950.516732:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 354970242822 time 354970541681 state 0x0 ref 1 00000100:00100000:0.0:1789762950.516760:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355070541681 time 354970541681 state 0x1 ref 1 00000100:00100000:3.0:1789762950.597475:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355070541681 time 355070621567 state 0x0 ref 1 00000100:00100000:3.0:1789762950.597499:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140864768:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762950.597569:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 53477376, mtime: 0x6aad9d85, atime: 0x0, ctime: 0x6aad9d85, blocks: 0x19809 00010000:00010000:3.0:1789762950.597578:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.597592:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1789762950.597596:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762950.597601:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.597613:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762950.609161:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967981 is committed 00002000:00010000:0.0:1789762950.609182:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:0.0:1789762950.609187:0:14626:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 1789762949 -> 1789762950 00002000:00010000:0.0:1789762950.609190:0:14626:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 1789762949 -> 1789762950 00002000:00010000:0.0:1789762950.609192:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 104457 -> 106505 00010000:00010000:0.0:1789762950.609204:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.609215:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.609229:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.609234:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762950.609238:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.609244:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.609259:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.609265:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c5713e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762950.609348:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140864768:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11853us (92794us total) trans 4294967981 rc 0/0 00000100:00100000:0.0:1789762950.609356:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 778 00000100:00100000:0.0:1789762950.609367:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355070541681 time 355070621567 state 0x2 ref 0 00000100:00100000:1.0:1789762950.611450:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762950.611499:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140864896 00000100:00100000:0.0:1789762950.611508:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140864896 00000100:00100000:0.0:1789762950.611546:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355070541681 time 355070621567 state 0x0 ref 1 00000100:00100000:0.0:1789762950.611566:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355170621567 time 355070621567 state 0x1 ref 1 00000100:00100000:0.0:1789762950.697557:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355170621567 time 355170703253 state 0x0 ref 1 00000100:00100000:0.0:1789762950.697591:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140864896:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762950.697653:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 54525952, mtime: 0x6aad9d86, atime: 0x0, ctime: 0x6aad9d86, blocks: 0x1a009 00010000:00010000:0.0:1789762950.697664:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.697679:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1789762950.697682:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762950.697687:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.697698:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762950.708637:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967982 is committed 00002000:00010000:0.0:1789762950.708649:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:0.0:1789762950.708655:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 106505 -> 108553 00010000:00010000:0.0:1789762950.708665:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.708675:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.708692:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.708698:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762950.708701:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.708707:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.708721:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.708727:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c5713e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762950.708791:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140864896:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11214us (97338us total) trans 4294967982 rc 0/0 00000100:00100000:0.0:1789762950.708803:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 779 00000100:00100000:0.0:1789762950.708815:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355170621567 time 355170703253 state 0x2 ref 0 00000100:00100000:2.0:1789762950.710830:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762950.710886:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140865024 00000100:00100000:0.0:1789762950.710894:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140865024 00000100:00100000:0.0:1789762950.710941:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355170621567 time 355170703253 state 0x0 ref 1 00000100:00100000:0.0:1789762950.710961:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355270703253 time 355170703253 state 0x1 ref 1 00000100:00100000:3.0:1789762950.797686:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355270703253 time 355270825130 state 0x0 ref 1 00000100:00100000:3.0:1789762950.797731:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140865024:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762950.797801:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 55574528, mtime: 0x6aad9d86, atime: 0x0, ctime: 0x6aad9d86, blocks: 0x1a809 00010000:00010000:3.0:1789762950.797812:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c5713ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.797831:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1789762950.797872:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762950.797890:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c5713ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.797908:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c5713ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762950.809860:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967983 is committed 00002000:00010000:0.0:1789762950.809871:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:0.0:1789762950.809877:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 108553 -> 110601 00010000:00010000:0.0:1789762950.809888:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c5713ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.809899:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c5713ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.809906:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c5713ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.809911:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762950.809914:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c5713ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.809920:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c5713ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.809935:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c5713ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.809940:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c5713ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762950.810013:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140865024:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12294us (99181us total) trans 4294967983 rc 0/0 00000100:00100000:0.0:1789762950.810022:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 780 00000100:00100000:0.0:1789762950.810033:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355270703253 time 355270825130 state 0x2 ref 0 00000100:00100000:2.0:1789762950.812900:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762950.812936:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140865152 00000100:00100000:0.0:1789762950.812943:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140865152 00000100:00100000:0.0:1789762950.812986:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355270703253 time 355270825130 state 0x0 ref 1 00000100:00100000:0.0:1789762950.813002:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355370825130 time 355270825130 state 0x1 ref 1 00000004:00080000:1.0:1789762950.829319:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 24 committed 00000004:00080000:1.0:1789762950.829337:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 19 committed 00000100:00100000:1.0:1789762950.829405:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789762950.829424:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d148cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149049216:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789762950.829468:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762950.829499:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149049216 00000100:00100000:2.0:1789762950.829506:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149049216 00000100:00100000:1.0:1789762950.829516:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d14552ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149049088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762950.829540:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789762950.829553:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762950.829568:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149049088 00000100:00100000:2.0:1789762950.829573:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149049088 00000100:00100000:3.0:1789762950.829580:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789762950.829592:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149049216:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1789762950.829603:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762950.829610:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00002000:00080000:3.0:1789762950.829613:0:8803:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:13 count 1 00000100:00100000:2.0:1789762950.829622:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149049088:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1789762950.829638:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 8388608, mtime: 0x6aad9d80, atime: 0x0, ctime: 0x6aad9d80, blocks: 0x4007 00002000:00080000:2.0:1789762950.829641:0:6654:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:19 count 1 00010000:00010000:3.0:1789762950.829646:0:8803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a3fc21e/0xd08452c77c5713f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.829659:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=355s v=(0 0) 00002000:00010000:2.0:1789762950.829664:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 8388608, mtime: 0x6aad9d80, atime: 0x0, ctime: 0x6aad9d80, blocks: 0x4007 00010000:00010000:3.0:1789762950.829664:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762950.829669:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a3fc21e/0xd08452c77c5713f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762950.829685:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e1d1999/0xd08452c77c5713fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.829688:0:8803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a3fc21e/0xd08452c77c5713f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762950.829713:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1789762950.829713:0:8803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a3fc21e/0xd08452c77c5713f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762950.829722:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762950.829726:0:8803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a3fc21e/0xd08452c77c5713f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762950.829729:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e1d1999/0xd08452c77c5713fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762950.829742:0:6654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e1d1999/0xd08452c77c5713fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762950.829758:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e1d1999/0xd08452c77c5713fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762950.829765:0:6654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e1d1999/0xd08452c77c5713fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.829768:0:8803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762950.829806:0:6654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789762950.829813:0:6671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789762950.829821:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a3fc21e/0xd08452c77c5713f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762950.829827:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762950.829861:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762950.829866:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e1d1999/0xd08452c77c5713fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.829868:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a3fc21e/0xd08452c77c5713f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762950.829887:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762950.829894:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a3fc21e/0xd08452c77c5713f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762950.829894:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e1d1999/0xd08452c77c5713fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762950.829918:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e1d1999/0xd08452c77c5713fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.829927:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a3fc21e/0xd08452c77c5713f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762950.829933:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e1d1999/0xd08452c77c5713fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762950.829949:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e1d1999/0xd08452c77c5713fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762950.829957:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a3fc21e/0xd08452c77c5713f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762950.829969:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762950.829972:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762950.829974:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762950.829982:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762950.829986:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762950.829989:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762950.830480:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149049216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 889us (1008us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789762950.830487:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789762950.830506:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967415 gen 2 00000004:00080000:1.0:1789762950.830513:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d147cdb800, transno 4294967415 00000100:00100000:1.0:1789762950.830542:0:3277:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d148cc0700 x1876702149049216/t4294967416(4294967416) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789762966 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762950.830545:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149049088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 926us (1003us total) trans 4294967984 rc 0/0 00000100:00100000:2.0:1789762950.830559:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000004:00080000:1.0:1789762950.830564:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d148cc0700/2, rc 0, transno 4294967416 00000100:00100000:1.0:1789762950.830573:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d148cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149049216:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1789762950.830590:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d14552ad80/2, rc 0, transno 4294967984 00000100:00100000:1.0:1789762950.830594:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d14552ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149049088:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789762950.897761:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355370825130 time 355370900997 state 0x0 ref 1 00000100:00100000:3.0:1789762950.897786:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140865152:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762950.897853:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 56623104, mtime: 0x6aad9d86, atime: 0x0, ctime: 0x6aad9d86, blocks: 0x1b009 00010000:00010000:3.0:1789762950.897861:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571403 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.897875:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1789762950.897878:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762950.897883:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.897894:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762950.910448:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 56623104 -> 57671680 00002000:00010000:3.0:1789762950.910454:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 110601 -> 112649 00000001:00080000:0.0:1789762950.910455:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967984 is committed 00010000:00010000:3.0:1789762950.910466:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762950.910470:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967985 is committed 00010000:00010000:3.0:1789762950.910489:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.910496:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571403 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.910501:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762950.910505:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571403 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.910511:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571403 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.910526:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571403 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762950.910531:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571403 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762950.910603:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140865152:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12823us (97711us total) trans 4294967985 rc 0/0 00000100:00100000:3.0:1789762950.910614:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 781 00000100:00100000:3.0:1789762950.910627:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355370825130 time 355370900997 state 0x2 ref 0 00000100:00100000:1.0:1789762950.912853:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762950.912908:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140865280 00000100:00100000:0.0:1789762950.912916:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140865280 00000100:00100000:0.0:1789762950.912959:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355370825130 time 355370900997 state 0x0 ref 1 00000100:00100000:0.0:1789762950.912975:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355470900997 time 355370900997 state 0x1 ref 1 00000100:00100000:2.0:1789762950.997869:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355470900997 time 355470990634 state 0x0 ref 1 00000100:00100000:2.0:1789762950.997914:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140865280:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762950.997968:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 57671680, mtime: 0x6aad9d86, atime: 0x0, ctime: 0x6aad9d86, blocks: 0x1b809 00010000:00010000:2.0:1789762950.997976:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57140a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762950.998005:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1789762950.998008:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762950.998013:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57140a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762950.998024:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57140a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762951.009224:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967986 is committed 00002000:00010000:0.0:1789762951.009251:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:0.0:1789762951.009256:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 112649 -> 114697 00010000:00010000:0.0:1789762951.009267:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57140a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.009277:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57140a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.009284:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57140a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.009300:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762951.009310:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57140a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.009329:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57140a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.009344:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57140a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.009349:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57140a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762951.009414:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140865280:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11523us (96576us total) trans 4294967986 rc 0/0 00000100:00100000:0.0:1789762951.009423:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 782 00000100:00100000:0.0:1789762951.009445:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355470900997 time 355470990634 state 0x2 ref 0 00000100:00100000:0.0:1789762951.011696:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762951.011742:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140865408 00000100:00100000:3.0:1789762951.011757:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140865408 00000100:00080000:0.0:1789762951.011793:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762951.011809:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355470900997 time 355470990634 state 0x0 ref 1 00000100:00100000:3.0:1789762951.011822:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355570990634 time 355470990634 state 0x1 ref 1 00000100:00100000:1.0:1789762951.097940:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355570990634 time 355571083890 state 0x0 ref 1 00000100:00100000:1.0:1789762951.097971:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140865408:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762951.098030:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 58720256, mtime: 0x6aad9d86, atime: 0x0, ctime: 0x6aad9d86, blocks: 0x1c009 00010000:00010000:1.0:1789762951.098040:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c05867af/0xd08452c77c571411 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762951.098056:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=355s v=(0 0) 00010000:00010000:1.0:1789762951.098061:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762951.098069:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c05867af/0xd08452c77c571411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762951.098084:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c05867af/0xd08452c77c571411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762951.109570:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967987 is committed 00002000:00010000:1.0:1789762951.109572:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:1.0:1789762951.109578:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 114697 -> 116745 00010000:00010000:1.0:1789762951.109588:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c05867af/0xd08452c77c571411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762951.109599:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c05867af/0xd08452c77c571411 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762951.109607:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c05867af/0xd08452c77c571411 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762951.109621:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762951.109625:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c05867af/0xd08452c77c571411 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762951.109632:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c05867af/0xd08452c77c571411 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762951.109645:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c05867af/0xd08452c77c571411 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762951.109651:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c05867af/0xd08452c77c571411 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762951.109714:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140865408:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11753us (98016us total) trans 4294967987 rc 0/0 00000100:00100000:1.0:1789762951.109723:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 783 00000100:00100000:1.0:1789762951.109732:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355570990634 time 355571083890 state 0x2 ref 0 00000100:00100000:1.0:1789762951.111908:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762951.111946:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140865536 00000100:00100000:3.0:1789762951.111956:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140865536 00000100:00100000:3.0:1789762951.112004:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355570990634 time 355571083890 state 0x0 ref 1 00000100:00100000:3.0:1789762951.112017:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355671083890 time 355571083890 state 0x1 ref 1 00000100:00100000:3.0:1789762951.198018:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355671083890 time 355671148477 state 0x0 ref 1 00000100:00100000:3.0:1789762951.198040:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042718700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140865536:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762951.198099:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 59768832, mtime: 0x6aad9d86, atime: 0x0, ctime: 0x6aad9d86, blocks: 0x1c809 00010000:00010000:3.0:1789762951.198106:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571418 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.198120:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1789762951.198124:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762951.198129:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.198139:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762951.206947:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789762951.210374:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:3.0:1789762951.210379:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 116745 -> 118793 00000001:00080000:0.0:1789762951.210384:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967988 is committed 00010000:00010000:3.0:1789762951.210390:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.210402:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.210409:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571418 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.210423:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762951.210427:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571418 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.210433:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571418 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.210447:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571418 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.210452:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571418 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762951.210528:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042718700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140865536:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12480us (98606us total) trans 4294967988 rc 0/0 00000100:00100000:3.0:1789762951.210543:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 784 00000100:00100000:3.0:1789762951.210553:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355671083890 time 355671148477 state 0x2 ref 0 00000100:00100000:0.0:1789762951.212992:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762951.213043:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140865664 00000100:00100000:1.0:1789762951.213052:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140865664 00000100:00100000:1.0:1789762951.213092:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355671083890 time 355671148477 state 0x0 ref 1 00000100:00100000:1.0:1789762951.213104:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355771148477 time 355671148477 state 0x1 ref 1 00000100:00100000:0.0:1789762951.298070:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355771148477 time 355771216425 state 0x0 ref 1 00000100:00100000:0.0:1789762951.298091:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140865664:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762951.298139:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 60817408, mtime: 0x6aad9d86, atime: 0x0, ctime: 0x6aad9d86, blocks: 0x1d009 00010000:00010000:0.0:1789762951.298158:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57141f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.298172:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1789762951.298176:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762951.298180:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57141f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.298192:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57141f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762951.309471:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:3.0:1789762951.309477:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 118793 -> 120841 00000001:00080000:0.0:1789762951.309483:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967989 is committed 00010000:00010000:3.0:1789762951.309488:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57141f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.309499:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57141f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.309506:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57141f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.309511:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762951.309515:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57141f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.309522:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57141f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.309536:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57141f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.309541:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c57141f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762951.309609:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140865664:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11523us (96617us total) trans 4294967989 rc 0/0 00000100:00100000:3.0:1789762951.309618:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 785 00000100:00100000:3.0:1789762951.309627:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355771148477 time 355771216425 state 0x2 ref 0 00000100:00100000:1.0:1789762951.311811:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762951.311871:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140865792 00000100:00100000:2.0:1789762951.311880:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140865792 00000100:00100000:2.0:1789762951.311925:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355771148477 time 355771216425 state 0x0 ref 1 00000100:00100000:2.0:1789762951.311941:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355871216425 time 355771216425 state 0x1 ref 1 00000100:00100000:0.0:1789762951.398157:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355871216425 time 355871304119 state 0x0 ref 1 00000100:00100000:0.0:1789762951.398178:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140865792:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762951.398221:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 61865984, mtime: 0x6aad9d86, atime: 0x0, ctime: 0x6aad9d86, blocks: 0x1d809 00010000:00010000:0.0:1789762951.398228:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571426 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.398242:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1789762951.398245:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762951.398250:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571426 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.398260:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571426 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762951.411660:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967990 is committed 00002000:00010000:0.0:1789762951.411667:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:0.0:1789762951.411673:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 120841 -> 122889 00010000:00010000:0.0:1789762951.411685:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571426 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.411697:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571426 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.411704:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571426 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.411710:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762951.411714:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571426 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.411720:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571426 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.411735:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571426 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.411740:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e82bea3/0xd08452c77c571426 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762951.411812:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140865792:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13638us (100000us total) trans 4294967990 rc 0/0 00000100:00100000:0.0:1789762951.411830:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 786 00000100:00100000:0.0:1789762951.411860:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355871216425 time 355871304119 state 0x2 ref 0 00000100:00100000:2.0:1789762951.414171:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762951.414222:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140865920 00000100:00100000:3.0:1789762951.414231:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140865920 00000100:00100000:3.0:1789762951.414277:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355871216425 time 355871304119 state 0x0 ref 1 00000100:00100000:3.0:1789762951.414305:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355971304119 time 355871304119 state 0x1 ref 1 00000100:00100000:3.0:1789762951.498232:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355971304119 time 355971366615 state 0x0 ref 1 00000100:00100000:3.0:1789762951.498256:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140865920:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762951.498333:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 62914560, mtime: 0x6aad9d86, atime: 0x0, ctime: 0x6aad9d86, blocks: 0x1e009 00010000:00010000:3.0:1789762951.498340:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c57142d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.498354:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1789762951.498357:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762951.498363:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c57142d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.498373:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c57142d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762951.509948:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967991 is committed 00002000:00010000:0.0:1789762951.509962:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:0.0:1789762951.509967:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 122889 -> 124937 00010000:00010000:0.0:1789762951.509977:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c57142d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.509988:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c57142d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.509995:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c57142d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.510000:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762951.510004:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c57142d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.510010:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c57142d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.510024:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c57142d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.510029:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c57142d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762951.510099:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140865920:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11848us (95926us total) trans 4294967991 rc 0/0 00000100:00100000:0.0:1789762951.510107:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 787 00000100:00100000:0.0:1789762951.510117:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355971304119 time 355971366615 state 0x2 ref 0 00000100:00100000:2.0:1789762951.512222:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762951.512265:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140866048 00000100:00100000:3.0:1789762951.512273:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140866048 00000100:00100000:3.0:1789762951.512330:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 355971304119 time 355971366615 state 0x0 ref 1 00000100:00100000:3.0:1789762951.512343:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356071366615 time 355971366615 state 0x1 ref 1 00000100:00100000:3.0:1789762951.598318:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356071366615 time 356071449087 state 0x0 ref 1 00000100:00100000:3.0:1789762951.598344:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140866048:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762951.598395:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 63963136, mtime: 0x6aad9d86, atime: 0x0, ctime: 0x6aad9d86, blocks: 0x1e809 00010000:00010000:3.0:1789762951.598403:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571434 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.598416:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1789762951.598420:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762951.598425:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571434 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.598438:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571434 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762951.609819:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967992 is committed 00002000:00010000:0.0:1789762951.609874:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:0.0:1789762951.609880:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 124937 -> 126985 00010000:00010000:0.0:1789762951.609894:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571434 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.609906:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571434 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.609913:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571434 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.609918:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762951.609922:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571434 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.609929:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571434 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.609944:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571434 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.609960:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad0b1892/0xd08452c77c571434 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762951.610051:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140866048:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11711us (97823us total) trans 4294967992 rc 0/0 00000100:00100000:0.0:1789762951.610062:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 788 00000100:00100000:0.0:1789762951.610075:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356071366615 time 356071449087 state 0x2 ref 0 00000100:00100000:2.0:1789762951.612439:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762951.612476:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140866176 00000100:00100000:0.0:1789762951.612483:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140866176 00000100:00100000:0.0:1789762951.612540:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356071366615 time 356071449087 state 0x0 ref 1 00000100:00100000:0.0:1789762951.612551:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356171449087 time 356071449087 state 0x1 ref 1 00000100:00100000:1.0:1789762951.698388:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356171449087 time 356171535670 state 0x0 ref 1 00000100:00100000:1.0:1789762951.698410:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140866176:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762951.698459:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 65011712, mtime: 0x6aad9d86, atime: 0x0, ctime: 0x6aad9d86, blocks: 0x1f009 00010000:00010000:1.0:1789762951.698466:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008b10849/0xd08452c77c57143b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762951.698480:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1789762951.698483:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762951.698488:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008b10849/0xd08452c77c57143b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762951.698498:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008b10849/0xd08452c77c57143b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762951.710325:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967993 is committed 00002000:00010000:0.0:1789762951.710334:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:0.0:1789762951.710339:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 1789762950 -> 1789762951 00002000:00010000:0.0:1789762951.710342:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 1789762950 -> 1789762951 00002000:00010000:0.0:1789762951.710344:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 126985 -> 129033 00010000:00010000:0.0:1789762951.710356:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008b10849/0xd08452c77c57143b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.710370:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008b10849/0xd08452c77c57143b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.710395:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008b10849/0xd08452c77c57143b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.710404:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762951.710409:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008b10849/0xd08452c77c57143b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.710416:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008b10849/0xd08452c77c57143b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.710431:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008b10849/0xd08452c77c57143b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.710436:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008b10849/0xd08452c77c57143b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762951.710502:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140866176:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12097us (98061us total) trans 4294967993 rc 0/0 00000100:00100000:0.0:1789762951.710509:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 789 00000100:00100000:0.0:1789762951.710519:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356171449087 time 356171535670 state 0x2 ref 0 00000100:00100000:2.0:1789762951.712598:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762951.712636:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140866304 00000100:00100000:0.0:1789762951.712644:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140866304 00000100:00100000:0.0:1789762951.712680:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356171449087 time 356171535670 state 0x0 ref 1 00000100:00100000:0.0:1789762951.712699:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356271535670 time 356171535670 state 0x1 ref 1 00000100:00100000:2.0:1789762951.798472:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356271535670 time 356271619610 state 0x0 ref 1 00000100:00100000:2.0:1789762951.798496:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140866304:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762951.798571:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 66060288, mtime: 0x6aad9d87, atime: 0x0, ctime: 0x6aad9d87, blocks: 0x1f809 00010000:00010000:2.0:1789762951.798580:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c571442 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762951.798594:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=356s v=(0 0) 00010000:00010000:2.0:1789762951.798598:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762951.798603:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c571442 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762951.798618:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c571442 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762951.810415:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967994 is committed 00002000:00010000:0.0:1789762951.810434:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:0.0:1789762951.810440:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 129033 -> 131081 00010000:00010000:0.0:1789762951.810451:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c571442 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.810462:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c571442 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.810469:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c571442 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.810474:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762951.810477:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c571442 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.810484:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c571442 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.810499:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c571442 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.810504:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a133afe3/0xd08452c77c571442 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762951.810584:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140866304:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12092us (97983us total) trans 4294967994 rc 0/0 00000100:00100000:0.0:1789762951.810593:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 790 00000100:00100000:0.0:1789762951.810603:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356271535670 time 356271619610 state 0x2 ref 0 00000100:00100000:2.0:1789762951.812868:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762951.812894:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140866432 00000100:00100000:0.0:1789762951.812902:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140866432 00000100:00100000:0.0:1789762951.812941:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356271535670 time 356271619610 state 0x0 ref 1 00000100:00100000:0.0:1789762951.812952:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356371619610 time 356271619610 state 0x1 ref 1 00000100:00100000:2.0:1789762951.846969:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d04271a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149049344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762951.846975:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d145528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149049472:0@lo:400:kworker.0 00000100:00100000:1.0:1789762951.846987:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d145528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149049600:0@lo:400:kworker.0 00000100:00100000:0.0:1789762951.847041:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d145529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149049728:0@lo:400:kworker.0 00000100:00100000:3.0:1789762951.847049:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762951.847051:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762951.847053:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762951.847103:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762951.847127:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d14552aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149050112:0@lo:400:kworker.0 00000100:00100000:2.0:1789762951.847130:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d14552a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149049856:0@lo:400:kworker.0 00000100:00100000:3.0:1789762951.847131:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d145529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149049984:0@lo:400:kworker.0 00000100:00100000:0.0:1789762951.847152:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149049472 00000100:00100000:0.0:1789762951.847158:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149049472 00000100:00100000:1.0:1789762951.847163:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762951.847180:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762951.847192:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149049344 00000100:00100000:2.0:1789762951.847199:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149049344 00000100:00100000:0.0:1789762951.847206:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789762951.847219:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149049472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762951.847230:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149049600 00000100:00100000:3.0:1789762951.847234:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149049728 00000100:00100000:1.0:1789762951.847235:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149049600 00000100:00100000:3.0:1789762951.847239:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149049728 00000100:00100000:2.0:1789762951.847251:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789762951.847262:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149049344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762951.847276:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149049984 00000100:00100000:1.0:1789762951.847281:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149049984 00000100:00100000:0.0:1789762951.847305:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149049472:12345-0@lo:400:kworker.0 Request processed in 89us (260us total) trans 0 rc 0/0 00002000:00000024:2.0:1789762951.847305:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789762951.847305:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789762951.847318:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789762951.847322:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149049600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762951.847335:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789762951.847346:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149049728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762951.847353:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149049344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762951.847362:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789762951.847385:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149050112 00000100:00100000:3.0:1789762951.847386:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149049600:12345-0@lo:400:kworker.0 Request processed in 66us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762951.847390:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149050112 00000100:00100000:3.0:1789762951.847396:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789762951.847409:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789762951.847411:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149049728:12345-0@lo:400:kworker.0 Request processed in 63us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762951.847419:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149049984:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789762951.847423:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762951.847424:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789762951.847430:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789762951.847441:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149050112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762951.847457:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d145528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149049472:0@lo:400:kworker.0 00000100:00100000:2.0:1789762951.847462:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149049984:12345-0@lo:400:kworker.0 Request processed in 45us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762951.847469:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789762951.847493:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d145529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149049728:0@lo:400:kworker.0 00000100:00100000:3.0:1789762951.847500:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d145529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149049984:0@lo:400:kworker.0 00000100:00100000:0.0:1789762951.847507:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149050112:12345-0@lo:400:kworker.0 Request processed in 68us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762951.847516:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762951.847521:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789762951.847534:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d14552aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149050112:0@lo:400:kworker.0 00000100:00100000:0.0:1789762951.847543:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149049856 00000100:00100000:0.0:1789762951.847548:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149049856 00000100:00100000:1.0:1789762951.847551:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d145528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149049600:0@lo:400:kworker.0 00000100:00100000:2.0:1789762951.847565:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d04271a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149049344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762951.847585:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789762951.847593:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149049856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762951.847621:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149049856:12345-0@lo:400:kworker.0 Request processed in 30us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762951.847625:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789762951.847645:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967984 gen 2 00000004:00080000:2.0:1789762951.847652:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d14552ad80, transno 4294967984 00000100:00100000:2.0:1789762951.847666:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d14552a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149049856:0@lo:400:kworker.0 00000100:00100000:3.0:1789762951.898563:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356371619610 time 356371710257 state 0x0 ref 1 00000100:00100000:3.0:1789762951.898596:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140866432:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762951.898653:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 67108864, mtime: 0x6aad9d87, atime: 0x0, ctime: 0x6aad9d87, blocks: 0x20009 00010000:00010000:3.0:1789762951.898663:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a3fc21e/0xd08452c77c571449 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.898679:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1789762951.898682:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762951.898687:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a3fc21e/0xd08452c77c571449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.898715:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a3fc21e/0xd08452c77c571449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762951.910329:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967995 is committed 00002000:00010000:0.0:1789762951.910349:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:0.0:1789762951.910354:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 131081 -> 133129 00010000:00010000:0.0:1789762951.910364:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a3fc21e/0xd08452c77c571449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.910374:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a3fc21e/0xd08452c77c571449 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.910381:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a3fc21e/0xd08452c77c571449 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.910386:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762951.910390:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a3fc21e/0xd08452c77c571449 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.910396:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a3fc21e/0xd08452c77c571449 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.910417:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a3fc21e/0xd08452c77c571449 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762951.910423:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a3fc21e/0xd08452c77c571449 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762951.910485:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140866432:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11904us (97618us total) trans 4294967995 rc 0/0 00000100:00100000:0.0:1789762951.910492:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 791 00000100:00100000:0.0:1789762951.910502:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356371619610 time 356371710257 state 0x2 ref 0 00000100:00100000:1.0:1789762951.912673:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762951.912713:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140866560 00000100:00100000:0.0:1789762951.912722:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140866560 00000100:00100000:0.0:1789762951.912761:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356371619610 time 356371710257 state 0x0 ref 1 00000100:00100000:0.0:1789762951.912776:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356471710257 time 356371710257 state 0x1 ref 1 00000100:00100000:3.0:1789762951.998673:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356471710257 time 356471818820 state 0x0 ref 1 00000100:00100000:3.0:1789762951.998698:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140866560:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762951.998747:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 68157440, mtime: 0x6aad9d87, atime: 0x0, ctime: 0x6aad9d87, blocks: 0x20809 00010000:00010000:3.0:1789762951.998755:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c571450 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.998768:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1789762951.998772:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762951.998777:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c571450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762951.998788:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c571450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762952.011358:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967996 is committed 00002000:00010000:0.0:1789762952.011424:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:0.0:1789762952.011429:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 133129 -> 135177 00010000:00010000:0.0:1789762952.011438:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c571450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.011448:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c571450 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.011465:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c571450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.011470:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762952.011474:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c571450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.011480:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c571450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.011494:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c571450 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.011500:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000192c3ba8/0xd08452c77c571450 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762952.011561:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140866560:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12869us (98886us total) trans 4294967996 rc 0/0 00000100:00100000:0.0:1789762952.011569:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 792 00000100:00100000:0.0:1789762952.011579:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356471710257 time 356471818820 state 0x2 ref 0 00000100:00100000:0.0:1789762952.013651:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762952.013691:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140866688 00000100:00100000:3.0:1789762952.013699:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140866688 00000100:00100000:3.0:1789762952.013737:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356471710257 time 356471818820 state 0x0 ref 1 00000100:00100000:3.0:1789762952.013748:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356571818820 time 356471818820 state 0x1 ref 1 00000100:00100000:2.0:1789762952.052177:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762952.052205:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762952.052225:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762952.052233:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140866816 00000100:00100000:1.0:1789762952.052244:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140866816 00000100:00100000:3.0:1789762952.052248:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140866944 00000100:00100000:2.0:1789762952.052254:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762952.052255:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140866944 00000100:00100000:0.0:1789762952.052292:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140867200 00000100:00100000:2.0:1789762952.052297:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140867072 00000100:00100000:0.0:1789762952.052300:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140867200 00000100:00100000:2.0:1789762952.052303:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140867072 00000100:00100000:1.0:1789762952.052313:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 311 00000100:00100000:3.0:1789762952.052321:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 265 00000100:00100000:1.0:1789762952.052330:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140866816:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762952.052335:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140866944:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762952.052346:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:0.0:1789762952.052360:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 266 00000100:00100000:2.0:1789762952.052360:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140867072:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762952.052383:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140867200:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762952.052403:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+8:2344:x1876702140866944:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762952.052405:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2345:x1876702140866816:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 77us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762952.052405:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140867072:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 48us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762952.052421:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140867200:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 39us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762952.052426:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:3.0:1789762952.052426:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 265 00000100:00100000:1.0:1789762952.052430:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 311 00000100:00100000:0.0:1789762952.052440:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 266 00000100:00080000:2.0:1789762952.052466:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789762952.052470:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762952.098729:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356571818820 time 356571876799 state 0x0 ref 1 00000100:00100000:3.0:1789762952.098750:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140866688:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762952.098807:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 69206016, mtime: 0x6aad9d87, atime: 0x0, ctime: 0x6aad9d87, blocks: 0x21009 00010000:00010000:3.0:1789762952.098815:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c571457 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.098829:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1789762952.098847:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762952.098853:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c571457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.098864:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c571457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762952.110148:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967997 is committed 00002000:00010000:0.0:1789762952.110174:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 69206016 -> 70254592 00002000:00010000:0.0:1789762952.110181:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 135177 -> 137225 00010000:00010000:0.0:1789762952.110196:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c571457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.110211:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c571457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.110222:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c571457 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.110230:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762952.110235:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c571457 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.110246:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c571457 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.110264:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c571457 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.110271:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000292afd41/0xd08452c77c571457 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762952.110364:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140866688:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11616us (96709us total) trans 4294967997 rc 0/0 00000100:00100000:0.0:1789762952.110376:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 793 00000100:00100000:0.0:1789762952.110388:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356571818820 time 356571876799 state 0x2 ref 0 00000100:00100000:2.0:1789762952.112552:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762952.112591:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140867328 00000100:00100000:0.0:1789762952.112600:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140867328 00000100:00100000:0.0:1789762952.112637:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356571818820 time 356571876799 state 0x0 ref 1 00000100:00100000:0.0:1789762952.112648:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356671876799 time 356571876799 state 0x1 ref 1 00000100:00100000:3.0:1789762952.198870:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356671876799 time 356671994119 state 0x0 ref 1 00000100:00100000:3.0:1789762952.198905:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140867328:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762952.198957:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 70254592, mtime: 0x6aad9d87, atime: 0x0, ctime: 0x6aad9d87, blocks: 0x21809 00010000:00010000:3.0:1789762952.198967:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57145e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.198985:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1789762952.198991:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762952.198999:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57145e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.199013:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57145e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762952.210116:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967998 is committed 00002000:00010000:0.0:1789762952.210135:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:0.0:1789762952.210140:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 137225 -> 139273 00010000:00010000:0.0:1789762952.210151:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57145e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.210161:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57145e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.210168:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57145e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.210173:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762952.210176:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57145e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.210191:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57145e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.210211:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57145e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.210220:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3514683/0xd08452c77c57145e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762952.210301:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140867328:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11399us (97747us total) trans 4294967998 rc 0/0 00000100:00100000:0.0:1789762952.210312:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 794 00000100:00100000:0.0:1789762952.210320:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356671876799 time 356671994119 state 0x2 ref 0 00000100:00100000:2.0:1789762952.212443:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762952.212477:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140867456 00000100:00100000:0.0:1789762952.212485:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140867456 00000100:00100000:0.0:1789762952.212521:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356671876799 time 356671994119 state 0x0 ref 1 00000100:00100000:0.0:1789762952.212532:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356771994119 time 356671994119 state 0x1 ref 1 00010000:00010000:3.0:1789762952.230984:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762952.298937:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356771994119 time 356772083067 state 0x0 ref 1 00000100:00100000:0.0:1789762952.298961:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140867456:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762952.299024:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 71303168, mtime: 0x6aad9d87, atime: 0x0, ctime: 0x6aad9d87, blocks: 0x22009 00010000:00010000:0.0:1789762952.299032:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c571465 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.299046:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=356s v=(0 0) 00010000:00010000:0.0:1789762952.299049:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762952.299054:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c571465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.299065:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c571465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762952.310673:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967999 is committed 00002000:00010000:0.0:1789762952.310702:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:0.0:1789762952.310707:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 139273 -> 141321 00010000:00010000:0.0:1789762952.310720:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c571465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.310731:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c571465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.310738:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c571465 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.310742:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762952.310746:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c571465 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.310764:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c571465 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.310779:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c571465 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.310784:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c347983a/0xd08452c77c571465 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762952.310872:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140867456:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11917us (98426us total) trans 4294967999 rc 0/0 00000100:00100000:0.0:1789762952.310881:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 795 00000100:00100000:0.0:1789762952.310891:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356771994119 time 356772083067 state 0x2 ref 0 00000100:00100000:2.0:1789762952.312915:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762952.312949:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140867584 00000100:00100000:0.0:1789762952.312956:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140867584 00000100:00100000:0.0:1789762952.312995:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356771994119 time 356772083067 state 0x0 ref 1 00000100:00100000:0.0:1789762952.313006:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356872083067 time 356772083067 state 0x1 ref 1 00000100:00100000:1.0:1789762952.359025:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d14552bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149050240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762952.359114:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762952.359181:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149050240 00000100:00100000:3.0:1789762952.359191:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149050240 00000100:00080000:2.0:1789762952.359236:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762952.359268:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789762952.359295:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149050240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762952.359320:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 525926400 pending 0 free 3795845120 avail 3785359360 00000100:00100000:3.0:1789762952.359373:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149050240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762952.359384:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789762952.359413:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d14552bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149050240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762952.399074:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356872083067 time 356872220849 state 0x0 ref 1 00000100:00100000:1.0:1789762952.399100:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140867584:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762952.399155:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 72351744, mtime: 0x6aad9d87, atime: 0x0, ctime: 0x6aad9d87, blocks: 0x22809 00010000:00010000:1.0:1789762952.399175:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c57146c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.399188:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1789762952.399191:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762952.399196:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c57146c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.399207:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c57146c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762952.410349:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968000 is committed 00002000:00010000:0.0:1789762952.410365:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:0.0:1789762952.410370:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 141321 -> 143369 00010000:00010000:0.0:1789762952.410382:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c57146c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.410405:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c57146c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.410412:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c57146c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.410417:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762952.410420:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c57146c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.410427:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c57146c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.410441:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c57146c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.410447:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a6b09d3/0xd08452c77c57146c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762952.410518:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140867584:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11426us (97600us total) trans 4294968000 rc 0/0 00000100:00100000:0.0:1789762952.410530:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 796 00000100:00100000:0.0:1789762952.410544:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356872083067 time 356872220849 state 0x2 ref 0 00000100:00100000:1.0:1789762952.412800:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762952.412854:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140867712 00000100:00100000:0.0:1789762952.412868:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140867712 00000100:00100000:0.0:1789762952.412907:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356872083067 time 356872220849 state 0x0 ref 1 00000100:00100000:0.0:1789762952.412919:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356972220849 time 356872220849 state 0x1 ref 1 00000100:00100000:3.0:1789762952.499153:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356972220849 time 356972300029 state 0x0 ref 1 00000100:00100000:3.0:1789762952.499177:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140867712:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762952.499235:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 73400320, mtime: 0x6aad9d87, atime: 0x0, ctime: 0x6aad9d87, blocks: 0x23009 00010000:00010000:3.0:1789762952.499242:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571473 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.499256:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1789762952.499259:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762952.499264:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.499276:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762952.511872:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968001 is committed 00002000:00010000:0.0:1789762952.511885:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:0.0:1789762952.511893:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 143369 -> 145417 00010000:00010000:0.0:1789762952.511908:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.511920:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571473 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.511927:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571473 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.511932:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762952.511935:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571473 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.511943:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571473 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.511958:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571473 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.511963:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f394c5a1/0xd08452c77c571473 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762952.512048:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140867712:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12875us (99245us total) trans 4294968001 rc 0/0 00000100:00100000:0.0:1789762952.512057:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 797 00000100:00100000:0.0:1789762952.512067:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356972220849 time 356972300029 state 0x2 ref 0 00000100:00100000:1.0:1789762952.514667:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762952.514716:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140867840 00000100:00100000:0.0:1789762952.514724:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140867840 00000100:00100000:0.0:1789762952.514764:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 356972220849 time 356972300029 state 0x0 ref 1 00000100:00100000:0.0:1789762952.514777:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357072300029 time 356972300029 state 0x1 ref 1 00000100:00100000:3.0:1789762952.599273:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357072300029 time 357072419222 state 0x0 ref 1 00000100:00100000:3.0:1789762952.599314:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140867840:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762952.599363:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 74448896, mtime: 0x6aad9d87, atime: 0x0, ctime: 0x6aad9d87, blocks: 0x23809 00010000:00010000:3.0:1789762952.599371:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57147a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.599385:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1789762952.599388:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762952.599393:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57147a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.599405:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57147a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762952.610594:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968002 is committed 00002000:00010000:0.0:1789762952.610622:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:0.0:1789762952.610629:0:11723:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 1789762951 -> 1789762952 00002000:00010000:0.0:1789762952.610631:0:11723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 1789762951 -> 1789762952 00002000:00010000:0.0:1789762952.610634:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 145417 -> 147465 00010000:00010000:0.0:1789762952.610647:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57147a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.610660:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57147a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.610670:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57147a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.610690:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762952.610696:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57147a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.610707:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57147a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.610728:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57147a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.610737:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d63c71c4/0xd08452c77c57147a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762952.610820:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140867840:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11512us (96150us total) trans 4294968002 rc 0/0 00000100:00100000:0.0:1789762952.610868:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 798 00000100:00100000:0.0:1789762952.610881:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357072300029 time 357072419222 state 0x2 ref 0 00000100:00100000:0.0:1789762952.612981:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762952.613023:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140867968 00000100:00100000:1.0:1789762952.613031:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140867968 00000100:00100000:1.0:1789762952.613079:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357072300029 time 357072419222 state 0x0 ref 1 00000100:00100000:1.0:1789762952.613094:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357172419222 time 357072419222 state 0x1 ref 1 00000100:00100000:3.0:1789762952.699360:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357172419222 time 357172507484 state 0x0 ref 1 00000100:00100000:3.0:1789762952.699386:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140867968:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762952.699448:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 75497472, mtime: 0x6aad9d88, atime: 0x0, ctime: 0x6aad9d88, blocks: 0x24009 00010000:00010000:3.0:1789762952.699457:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571481 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.699476:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1789762952.699481:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762952.699488:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.699503:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762952.711641:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968003 is committed 00002000:00010000:0.0:1789762952.711664:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 75497472 -> 76546048 00002000:00010000:0.0:1789762952.711669:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 147465 -> 149513 00010000:00010000:0.0:1789762952.711681:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.711692:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.711705:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.711710:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762952.711714:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.711720:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571481 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.711735:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571481 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.711740:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031f7988e/0xd08452c77c571481 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762952.711829:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140867968:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12450us (98844us total) trans 4294968003 rc 0/0 00000100:00100000:0.0:1789762952.711864:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 799 00000100:00100000:0.0:1789762952.711874:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357172419222 time 357172507484 state 0x2 ref 0 00000100:00100000:2.0:1789762952.713969:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762952.714019:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140868096 00000100:00100000:0.0:1789762952.714027:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140868096 00000100:00100000:0.0:1789762952.714064:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357172419222 time 357172507484 state 0x0 ref 1 00000100:00100000:0.0:1789762952.714083:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357272507484 time 357172507484 state 0x1 ref 1 00000100:00100000:3.0:1789762952.799460:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357272507484 time 357272605967 state 0x0 ref 1 00000100:00100000:3.0:1789762952.799486:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140868096:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762952.799547:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 76546048, mtime: 0x6aad9d88, atime: 0x0, ctime: 0x6aad9d88, blocks: 0x24809 00010000:00010000:3.0:1789762952.799554:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c571488 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.799568:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1789762952.799599:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762952.799604:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c571488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.799615:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c571488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762952.810773:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968004 is committed 00002000:00010000:0.0:1789762952.810796:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:0.0:1789762952.810803:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 149513 -> 151561 00010000:00010000:0.0:1789762952.810816:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c571488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.810846:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c571488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.810858:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c571488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.810867:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762952.810872:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c571488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.810883:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c571488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.810902:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c571488 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.810908:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008818931a/0xd08452c77c571488 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762952.810990:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140868096:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11501us (97009us total) trans 4294968004 rc 0/0 00000100:00100000:0.0:1789762952.810998:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 800 00000100:00100000:0.0:1789762952.811007:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357272507484 time 357272605967 state 0x2 ref 0 00000100:00100000:1.0:1789762952.813176:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762952.813246:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140868224 00000100:00100000:0.0:1789762952.813255:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140868224 00000100:00100000:0.0:1789762952.813316:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357272507484 time 357272605967 state 0x0 ref 1 00000100:00100000:0.0:1789762952.813328:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357372605967 time 357272605967 state 0x1 ref 1 00000100:00100000:0.0:1789762952.899542:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357372605967 time 357372683901 state 0x0 ref 1 00000100:00100000:0.0:1789762952.899572:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d04271a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140868224:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762952.899638:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 77594624, mtime: 0x6aad9d88, atime: 0x0, ctime: 0x6aad9d88, blocks: 0x25009 00010000:00010000:0.0:1789762952.899647:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c57148f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.899676:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1789762952.899681:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762952.899688:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c57148f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.899703:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c57148f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762952.911320:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968005 is committed 00002000:00010000:0.0:1789762952.911330:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:0.0:1789762952.911336:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 151561 -> 153609 00010000:00010000:0.0:1789762952.911347:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c57148f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.911360:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c57148f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.911370:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c57148f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.911378:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762952.911382:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c57148f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.911392:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c57148f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.911423:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c57148f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.911432:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4993fa0/0xd08452c77c57148f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762952.911502:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d04271a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140868224:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11939us (98334us total) trans 4294968005 rc 0/0 00000100:00100000:0.0:1789762952.911520:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 801 00000100:00100000:0.0:1789762952.911532:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357372605967 time 357372683901 state 0x2 ref 0 00000100:00100000:1.0:1789762952.913908:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762952.913946:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140868352 00000100:00100000:0.0:1789762952.913955:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140868352 00000100:00100000:0.0:1789762952.913996:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357372605967 time 357372683901 state 0x0 ref 1 00000100:00100000:0.0:1789762952.914011:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357472683901 time 357372683901 state 0x1 ref 1 00000100:00100000:3.0:1789762952.999654:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357472683901 time 357472797692 state 0x0 ref 1 00000100:00100000:3.0:1789762952.999682:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140868352:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762952.999745:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 78643200, mtime: 0x6aad9d88, atime: 0x0, ctime: 0x6aad9d88, blocks: 0x25809 00010000:00010000:3.0:1789762952.999754:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571496 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.999772:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1789762952.999788:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762952.999795:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.999810:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762953.012177:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 78643200 -> 79691776 00000001:00080000:0.0:1789762953.012183:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968006 is committed 00002000:00010000:3.0:1789762953.012184:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 153609 -> 155657 00010000:00010000:3.0:1789762953.012201:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.012235:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571496 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.012247:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571496 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.012255:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762953.012261:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571496 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.012269:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.012300:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571496 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.012307:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c571496 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762953.012381:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140868352:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12707us (98470us total) trans 4294968006 rc 0/0 00000100:00100000:3.0:1789762953.012390:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 802 00000100:00100000:3.0:1789762953.012401:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357472683901 time 357472797692 state 0x2 ref 0 00000100:00100000:2.0:1789762953.014861:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762953.014907:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140868480 00000100:00100000:0.0:1789762953.014915:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140868480 00000100:00080000:2.0:1789762953.014964:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762953.014973:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357472683901 time 357472797692 state 0x0 ref 1 00000100:00100000:0.0:1789762953.014990:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357572797692 time 357472797692 state 0x1 ref 1 00000100:00100000:1.0:1789762953.099787:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357572797692 time 357572932987 state 0x0 ref 1 00000100:00100000:1.0:1789762953.099812:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140868480:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762953.099894:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 79691776, mtime: 0x6aad9d88, atime: 0x0, ctime: 0x6aad9d88, blocks: 0x26009 00010000:00010000:1.0:1789762953.099902:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57149d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.099930:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1789762953.099933:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762953.099938:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57149d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.099950:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57149d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762953.111123:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968007 is committed 00002000:00010000:0.0:1789762953.111161:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:0.0:1789762953.111164:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 155657 -> 157705 00010000:00010000:0.0:1789762953.111175:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57149d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.111184:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57149d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.111191:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57149d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.111203:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c7400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762953.111206:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57149d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.111214:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57149d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.111227:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57149d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.111232:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d69e8c41/0xd08452c77c57149d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.111302:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140868480:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11498us (96441us total) trans 4294968007 rc 0/0 00000100:00100000:0.0:1789762953.111311:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 803 00000100:00100000:0.0:1789762953.111331:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357572797692 time 357572932987 state 0x2 ref 0 00000100:00100000:0.0:1789762953.113690:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762953.113740:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140868608 00000100:00100000:3.0:1789762953.113753:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140868608 00000100:00100000:3.0:1789762953.113790:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357572797692 time 357572932987 state 0x0 ref 1 00000100:00100000:3.0:1789762953.113801:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357672932987 time 357572932987 state 0x1 ref 1 00000100:00100000:3.0:1789762953.199863:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357672932987 time 357672993861 state 0x0 ref 1 00000100:00100000:3.0:1789762953.199889:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140868608:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762953.199936:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 80740352, mtime: 0x6aad9d88, atime: 0x0, ctime: 0x6aad9d88, blocks: 0x26809 00010000:00010000:3.0:1789762953.199944:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c5714a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.199958:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1789762953.199962:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762953.199966:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c5714a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.199977:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c5714a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762953.210984:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 80740352 -> 81788928 00002000:00010000:0.0:1789762953.210990:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 157705 -> 159753 00010000:00010000:0.0:1789762953.210999:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c5714a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.211009:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c5714a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.211022:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c5714a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.211028:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762953.211031:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c5714a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.211038:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c5714a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.211052:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c5714a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.211057:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc24d909/0xd08452c77c5714a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.211118:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+7:2344:x1876702140868608:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11236us (97425us total) trans 4294968008 rc 0/0 00000100:00100000:0.0:1789762953.211126:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 804 00000100:00100000:0.0:1789762953.211135:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357672932987 time 357672993861 state 0x2 ref 0 00000001:00080000:0.0:1789762953.211166:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968008 is committed 00000100:00100000:2.0:1789762953.213367:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762953.213411:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140868736 00000100:00100000:3.0:1789762953.213420:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140868736 00000100:00100000:3.0:1789762953.213455:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357672932987 time 357672993861 state 0x0 ref 1 00000100:00100000:3.0:1789762953.213466:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357772993861 time 357672993861 state 0x1 ref 1 00010000:00010000:1.0:1789762953.254952:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762953.299922:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357772993861 time 357773068776 state 0x0 ref 1 00000100:00100000:3.0:1789762953.299945:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140868736:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762953.299992:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 81788928, mtime: 0x6aad9d88, atime: 0x0, ctime: 0x6aad9d88, blocks: 0x27009 00010000:00010000:3.0:1789762953.299999:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.300013:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1789762953.300016:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762953.300021:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.300032:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762953.311660:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 81788928 -> 82837504 00002000:00010000:3.0:1789762953.311667:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 159753 -> 161801 00000001:00080000:0.0:1789762953.311669:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968009 is committed 00010000:00010000:3.0:1789762953.311678:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.311689:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.311697:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.311712:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762953.311716:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.311723:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.311738:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.311743:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762953.311806:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140868736:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11867us (98437us total) trans 4294968009 rc 0/0 00000100:00100000:3.0:1789762953.311814:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 805 00000100:00100000:3.0:1789762953.311824:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357772993861 time 357773068776 state 0x2 ref 0 00000100:00100000:0.0:1789762953.313938:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762953.313993:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140868864 00000100:00100000:2.0:1789762953.314003:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140868864 00000100:00100000:2.0:1789762953.314044:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357772993861 time 357773068776 state 0x0 ref 1 00000100:00100000:2.0:1789762953.314055:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357873068776 time 357773068776 state 0x1 ref 1 00000100:00100000:0.0:1789762953.399997:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357873068776 time 357873141686 state 0x0 ref 1 00000100:00100000:0.0:1789762953.400042:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140868864:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762953.400100:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 82837504, mtime: 0x6aad9d88, atime: 0x0, ctime: 0x6aad9d88, blocks: 0x27809 00010000:00010000:0.0:1789762953.400111:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5714b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.400125:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1789762953.400129:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762953.400134:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5714b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.400145:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5714b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762953.410868:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968010 is committed 00002000:00010000:3.0:1789762953.410880:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:3.0:1789762953.410887:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 161801 -> 163849 00010000:00010000:3.0:1789762953.410899:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5714b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.410909:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5714b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.410926:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5714b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.410931:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762953.410935:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5714b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.410941:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5714b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.410955:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5714b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.410961:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000222bd182/0xd08452c77c5714b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762953.411020:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140868864:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10987us (97082us total) trans 4294968010 rc 0/0 00000100:00100000:3.0:1789762953.411028:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 806 00000100:00100000:3.0:1789762953.411038:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357873068776 time 357873141686 state 0x2 ref 0 00000100:00100000:0.0:1789762953.413296:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762953.413330:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140868992 00000100:00100000:3.0:1789762953.413345:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140868992 00000100:00100000:3.0:1789762953.413382:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357873068776 time 357873141686 state 0x0 ref 1 00000100:00100000:3.0:1789762953.413402:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357973141686 time 357873141686 state 0x1 ref 1 00000100:00100000:0.0:1789762953.500107:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357973141686 time 357973252701 state 0x0 ref 1 00000100:00100000:0.0:1789762953.500132:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140868992:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762953.500181:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 83886080, mtime: 0x6aad9d88, atime: 0x0, ctime: 0x6aad9d88, blocks: 0x28009 00010000:00010000:0.0:1789762953.500190:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.500208:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1789762953.500213:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762953.500233:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.500247:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762953.514053:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:0.0:1789762953.514079:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 163849 -> 165897 00010000:00010000:0.0:1789762953.514095:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.514113:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.514124:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.514133:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762953.514139:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.514150:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.514172:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.514196:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.514323:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+7:2345:x1876702140868992:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14197us (101022us total) trans 4294968011 rc 0/0 00000100:00100000:0.0:1789762953.514336:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 807 00000100:00100000:0.0:1789762953.514351:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357973141686 time 357973252701 state 0x2 ref 0 00000001:00080000:0.0:1789762953.514401:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968011 is committed 00000100:00100000:0.0:1789762953.517404:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762953.517457:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140869120 00000100:00100000:3.0:1789762953.517466:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140869120 00000100:00100000:3.0:1789762953.517531:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 357973141686 time 357973252701 state 0x0 ref 1 00000100:00100000:3.0:1789762953.517548:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358073252701 time 357973252701 state 0x1 ref 1 00000100:00100000:3.0:1789762953.600161:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358073252701 time 358073308097 state 0x0 ref 1 00000100:00100000:3.0:1789762953.600187:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140869120:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762953.600237:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 84934656, mtime: 0x6aad9d88, atime: 0x0, ctime: 0x6aad9d88, blocks: 0x28809 00010000:00010000:3.0:1789762953.600245:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.600258:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1789762953.600262:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762953.600267:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.600291:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762953.610889:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968012 is committed 00002000:00010000:0.0:1789762953.610914:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:0.0:1789762953.610919:0:13229:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 1789762952 -> 1789762953 00002000:00010000:0.0:1789762953.610922:0:13229:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 1789762952 -> 1789762953 00002000:00010000:0.0:1789762953.610925:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 165897 -> 167945 00010000:00010000:0.0:1789762953.610937:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.610951:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.610961:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.610970:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762953.610975:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.610992:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.611011:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.611020:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008fe44e6/0xd08452c77c5714c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.611089:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140869120:12345-192.168.203.31@tcp:4:dd.500 Request processed in 10909us (93687us total) trans 4294968012 rc 0/0 00000100:00100000:0.0:1789762953.611100:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 808 00000100:00100000:0.0:1789762953.611113:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358073252701 time 358073308097 state 0x2 ref 0 00000100:00100000:1.0:1789762953.613378:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762953.613420:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140869248 00000100:00100000:3.0:1789762953.613434:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140869248 00000100:00100000:3.0:1789762953.613470:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358073252701 time 358073308097 state 0x0 ref 1 00000100:00100000:3.0:1789762953.613482:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358173308097 time 358073308097 state 0x1 ref 1 00000100:00100000:0.0:1789762953.700309:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358173308097 time 358173455571 state 0x0 ref 1 00000100:00100000:0.0:1789762953.700336:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140869248:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762953.700389:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 85983232, mtime: 0x6aad9d89, atime: 0x0, ctime: 0x6aad9d89, blocks: 0x29009 00010000:00010000:0.0:1789762953.700396:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.700409:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1789762953.700413:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762953.700418:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.700442:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762953.711569:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968013 is committed 00002000:00010000:0.0:1789762953.711590:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:0.0:1789762953.711595:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 167945 -> 169993 00010000:00010000:0.0:1789762953.711608:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.711624:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.711635:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.711643:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762953.711648:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.711658:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.711675:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.711681:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da50d5a/0xd08452c77c5714c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.711746:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140869248:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11418us (98365us total) trans 4294968013 rc 0/0 00000100:00100000:0.0:1789762953.711754:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 809 00000100:00100000:0.0:1789762953.711764:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358173308097 time 358173455571 state 0x2 ref 0 00000100:00100000:1.0:1789762953.713883:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762953.713917:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140869376 00000100:00100000:0.0:1789762953.713925:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140869376 00000100:00100000:0.0:1789762953.713962:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358173308097 time 358173455571 state 0x0 ref 1 00000100:00100000:0.0:1789762953.713973:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358273455571 time 358173455571 state 0x1 ref 1 00000100:00100000:2.0:1789762953.800405:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358273455571 time 358273552772 state 0x0 ref 1 00000100:00100000:2.0:1789762953.800431:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140869376:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:2.0:1789762953.800482:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 87031808, mtime: 0x6aad9d89, atime: 0x0, ctime: 0x6aad9d89, blocks: 0x29809 00010000:00010000:2.0:1789762953.800489:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5ab5f2/0xd08452c77c5714ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.800517:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1789762953.800521:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762953.800526:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a5ab5f2/0xd08452c77c5714ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.800537:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a5ab5f2/0xd08452c77c5714ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762953.811615:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968014 is committed 00002000:00010000:0.0:1789762953.811629:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 87031808 -> 88080384 00002000:00010000:0.0:1789762953.811634:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 169993 -> 172041 00010000:00010000:0.0:1789762953.811644:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5ab5f2/0xd08452c77c5714ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.811655:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a5ab5f2/0xd08452c77c5714ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.811662:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a5ab5f2/0xd08452c77c5714ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.811667:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762953.811671:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5ab5f2/0xd08452c77c5714ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.811678:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5ab5f2/0xd08452c77c5714ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.811692:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a5ab5f2/0xd08452c77c5714ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.811698:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a5ab5f2/0xd08452c77c5714ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.811761:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140869376:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11338us (97876us total) trans 4294968014 rc 0/0 00000100:00100000:0.0:1789762953.811771:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 810 00000100:00100000:0.0:1789762953.811780:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358273455571 time 358273552772 state 0x2 ref 0 00000100:00100000:0.0:1789762953.814229:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762953.814284:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140869504 00000100:00100000:3.0:1789762953.814292:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140869504 00000100:00100000:3.0:1789762953.814331:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358273455571 time 358273552772 state 0x0 ref 1 00000100:00100000:3.0:1789762953.814342:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358373552772 time 358273552772 state 0x1 ref 1 00000100:00100000:0.0:1789762953.900489:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358373552772 time 358373636887 state 0x0 ref 1 00000100:00100000:0.0:1789762953.900514:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140869504:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762953.900581:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 88080384, mtime: 0x6aad9d89, atime: 0x0, ctime: 0x6aad9d89, blocks: 0x2a009 00010000:00010000:0.0:1789762953.900589:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.900603:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1789762953.900607:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762953.900612:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.900624:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762953.911737:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968015 is committed 00002000:00010000:0.0:1789762953.911756:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:0.0:1789762953.911761:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 172041 -> 174089 00010000:00010000:0.0:1789762953.911773:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.911784:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.911791:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.911796:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762953.911800:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.911806:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.911821:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.911830:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.911913:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140869504:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11405us (97680us total) trans 4294968015 rc 0/0 00000100:00100000:0.0:1789762953.911923:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 811 00000100:00100000:0.0:1789762953.911936:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358373552772 time 358373636887 state 0x2 ref 0 00000100:00100000:0.0:1789762953.914190:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762953.914233:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140869632 00000100:00100000:3.0:1789762953.914242:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140869632 00000100:00100000:3.0:1789762953.914386:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358373552772 time 358373636887 state 0x0 ref 1 00000100:00100000:3.0:1789762953.914398:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358473636887 time 358373636887 state 0x1 ref 1 00000100:00100000:3.0:1789762954.000555:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358473636887 time 358473701379 state 0x0 ref 1 00000100:00100000:3.0:1789762954.000580:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d14552aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140869632:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762954.000638:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 89128960, mtime: 0x6aad9d89, atime: 0x0, ctime: 0x6aad9d89, blocks: 0x2a809 00010000:00010000:3.0:1789762954.000645:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.000659:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1789762954.000676:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762954.000682:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.000694:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762954.014191:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:3.0:1789762954.014201:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 174089 -> 176137 00010000:00010000:3.0:1789762954.014217:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.014250:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762954.014255:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968016 is committed 00010000:00010000:3.0:1789762954.014258:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.014265:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762954.014283:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.014294:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.014314:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.014337:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762954.014409:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d14552aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140869632:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13836us (100216us total) trans 4294968016 rc 0/0 00000100:00100000:3.0:1789762954.014417:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 812 00000100:00100000:3.0:1789762954.014428:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358473636887 time 358473701379 state 0x2 ref 0 00000100:00100000:2.0:1789762954.016974:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762954.017075:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140869760 00000100:00100000:0.0:1789762954.017089:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140869760 00000100:00100000:0.0:1789762954.017150:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358473636887 time 358473701379 state 0x0 ref 1 00000100:00100000:0.0:1789762954.017168:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358573701379 time 358473701379 state 0x1 ref 1 00000100:00100000:0.0:1789762954.100627:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358573701379 time 358573774577 state 0x0 ref 1 00000100:00100000:0.0:1789762954.100651:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140869760:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762954.100699:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 90177536, mtime: 0x6aad9d89, atime: 0x0, ctime: 0x6aad9d89, blocks: 0x2b009 00010000:00010000:0.0:1789762954.100706:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.100720:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1789762954.100724:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762954.100735:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.100747:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762954.112034:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968017 is committed 00002000:00010000:0.0:1789762954.112052:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:0.0:1789762954.112058:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 176137 -> 178185 00010000:00010000:0.0:1789762954.112069:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.112079:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.112085:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.112091:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762954.112094:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.112101:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.112115:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.112125:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.112183:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140869760:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11539us (95230us total) trans 4294968017 rc 0/0 00000100:00100000:0.0:1789762954.112192:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 813 00000100:00100000:0.0:1789762954.112201:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358573701379 time 358573774577 state 0x2 ref 0 00000100:00100000:1.0:1789762954.114145:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762954.114181:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140869888 00000100:00100000:0.0:1789762954.114189:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140869888 00000100:00100000:0.0:1789762954.114229:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358573701379 time 358573774577 state 0x0 ref 1 00000100:00100000:0.0:1789762954.114244:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358673774577 time 358573774577 state 0x1 ref 1 00000100:00100000:0.0:1789762954.200693:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358673774577 time 358673839741 state 0x0 ref 1 00000100:00100000:0.0:1789762954.200716:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140869888:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762954.200764:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 91226112, mtime: 0x6aad9d89, atime: 0x0, ctime: 0x6aad9d89, blocks: 0x2b809 00010000:00010000:0.0:1789762954.200771:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.200784:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1789762954.200788:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762954.200793:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.200805:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762954.212457:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968018 is committed 00002000:00010000:3.0:1789762954.212457:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:3.0:1789762954.212463:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 178185 -> 180233 00010000:00010000:3.0:1789762954.212478:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.212493:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.212504:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.212513:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762954.212519:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.212526:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.212553:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.212559:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000725cb579/0xd08452c77c5714ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762954.212632:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140869888:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11921us (98484us total) trans 4294968018 rc 0/0 00000100:00100000:3.0:1789762954.212641:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 814 00000100:00100000:3.0:1789762954.212651:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358673774577 time 358673839741 state 0x2 ref 0 00000100:00100000:1.0:1789762954.214771:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762954.214805:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140870016 00000100:00100000:3.0:1789762954.214814:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140870016 00000100:00100000:3.0:1789762954.214872:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358673774577 time 358673839741 state 0x0 ref 1 00000100:00100000:3.0:1789762954.214884:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358773839741 time 358673839741 state 0x1 ref 1 00010000:00010000:0.0:1789762954.278926:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762954.300769:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358773839741 time 358773917672 state 0x0 ref 1 00000100:00100000:3.0:1789762954.300794:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140870016:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762954.300877:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 92274688, mtime: 0x6aad9d89, atime: 0x0, ctime: 0x6aad9d89, blocks: 0x2c009 00010000:00010000:3.0:1789762954.300885:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.300915:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1789762954.300918:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762954.300923:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.300934:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762954.311986:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 92274688 -> 93323264 00000001:00080000:0.0:1789762954.311990:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968019 is committed 00002000:00010000:3.0:1789762954.311991:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 180233 -> 182281 00010000:00010000:3.0:1789762954.312005:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.312014:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.312021:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.312026:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762954.312030:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.312037:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.312061:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.312067:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762954.312123:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140870016:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11337us (97350us total) trans 4294968019 rc 0/0 00000100:00100000:3.0:1789762954.312130:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 815 00000100:00100000:3.0:1789762954.312139:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358773839741 time 358773917672 state 0x2 ref 0 00000100:00100000:0.0:1789762954.314437:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762954.314471:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140870144 00000100:00100000:3.0:1789762954.314478:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140870144 00000100:00100000:3.0:1789762954.314513:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358773839741 time 358773917672 state 0x0 ref 1 00000100:00100000:3.0:1789762954.314524:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358873917672 time 358773917672 state 0x1 ref 1 00000100:00100000:3.0:1789762954.400871:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358873917672 time 358873989407 state 0x0 ref 1 00000100:00100000:3.0:1789762954.400895:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140870144:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762954.400943:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 93323264, mtime: 0x6aad9d89, atime: 0x0, ctime: 0x6aad9d89, blocks: 0x2c809 00010000:00010000:3.0:1789762954.400950:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.400978:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1789762954.400982:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762954.400987:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.400998:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762954.415051:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 93323264 -> 94371840 00000001:00080000:0.0:1789762954.415059:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968020 is committed 00002000:00010000:3.0:1789762954.415059:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 182281 -> 184329 00010000:00010000:3.0:1789762954.415076:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.415091:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.415103:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.415111:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762954.415118:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.415129:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.415166:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.415174:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c5714f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762954.415362:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140870144:12345-192.168.203.31@tcp:4:dd.500 Request processed in 14471us (100919us total) trans 4294968020 rc 0/0 00000100:00100000:3.0:1789762954.415374:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 816 00000100:00100000:3.0:1789762954.415386:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358873917672 time 358873989407 state 0x2 ref 0 00000100:00100000:1.0:1789762954.417985:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762954.418014:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140870272 00000100:00100000:3.0:1789762954.418022:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140870272 00000100:00100000:3.0:1789762954.418060:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358873917672 time 358873989407 state 0x0 ref 1 00000100:00100000:3.0:1789762954.418071:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358973989407 time 358873989407 state 0x1 ref 1 00000001:00080000:2.0:1789762954.419961:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967416 is committed 00000100:00100000:0.0:1789762954.500960:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358973989407 time 358974106991 state 0x0 ref 1 00000100:00100000:0.0:1789762954.500986:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140870272:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762954.501035:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 94371840, mtime: 0x6aad9d89, atime: 0x0, ctime: 0x6aad9d89, blocks: 0x2d009 00010000:00010000:0.0:1789762954.501043:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5714ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.501057:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1789762954.501060:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762954.501065:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5714ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.501076:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5714ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762954.512012:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 94371840 -> 95420416 00000001:00080000:1.0:1789762954.512015:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968021 is committed 00002000:00010000:0.0:1789762954.512019:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 184329 -> 186379 00010000:00010000:0.0:1789762954.512030:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5714ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.512041:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5714ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.512048:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5714ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.512054:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762954.512060:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5714ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.512070:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5714ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.512090:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5714ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.512099:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c5714ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.512163:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140870272:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11185us (94180us total) trans 4294968021 rc 0/0 00000100:00100000:0.0:1789762954.512172:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 817 00000100:00100000:0.0:1789762954.512181:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358973989407 time 358974106991 state 0x2 ref 0 00000100:00100000:1.0:1789762954.514255:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762954.514304:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140870400 00000100:00100000:3.0:1789762954.514312:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140870400 00000100:00100000:3.0:1789762954.514349:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 358973989407 time 358974106991 state 0x0 ref 1 00000100:00100000:3.0:1789762954.514360:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359074106991 time 358974106991 state 0x1 ref 1 00000100:00100000:0.0:1789762954.601061:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359074106991 time 359074194336 state 0x0 ref 1 00000100:00100000:0.0:1789762954.601085:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140870400:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762954.601135:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 95420416, mtime: 0x6aad9d89, atime: 0x0, ctime: 0x6aad9d89, blocks: 0x2d80b 00010000:00010000:0.0:1789762954.601142:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571506 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.601156:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1789762954.601160:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762954.601164:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571506 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.601176:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571506 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762954.613690:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 95420416 -> 96468992 00000001:00080000:1.0:1789762954.613691:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968022 is committed 00002000:00010000:2.0:1789762954.613696:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 1789762953 -> 1789762954 00002000:00010000:2.0:1789762954.613700:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 1789762953 -> 1789762954 00002000:00010000:2.0:1789762954.613702:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 186379 -> 188427 00010000:00010000:2.0:1789762954.613713:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571506 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.613723:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571506 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.613730:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571506 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.613735:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762954.613752:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571506 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.613760:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571506 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.613774:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571506 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.613779:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571506 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762954.613872:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140870400:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12794us (99615us total) trans 4294968022 rc 0/0 00000100:00100000:2.0:1789762954.613880:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 818 00000100:00100000:2.0:1789762954.613890:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359074106991 time 359074194336 state 0x2 ref 0 00000100:00100000:1.0:1789762954.616973:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762954.617019:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140870528 00000100:00100000:3.0:1789762954.617033:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140870528 00000100:00100000:3.0:1789762954.617070:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359074106991 time 359074194336 state 0x0 ref 1 00000100:00100000:3.0:1789762954.617081:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359174194336 time 359074194336 state 0x1 ref 1 00000100:00100000:1.0:1789762954.701161:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359174194336 time 359174307136 state 0x0 ref 1 00000100:00100000:1.0:1789762954.701187:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140870528:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762954.701239:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 96468992, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x2e00b 00010000:00010000:1.0:1789762954.701246:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4b0024b/0xd08452c77c57150d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762954.701296:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1789762954.701301:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762954.701309:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4b0024b/0xd08452c77c57150d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762954.701324:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4b0024b/0xd08452c77c57150d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.713338:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968023 is committed 00002000:00010000:2.0:1789762954.713351:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:2.0:1789762954.713356:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 188427 -> 190475 00010000:00010000:2.0:1789762954.713369:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4b0024b/0xd08452c77c57150d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.713384:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4b0024b/0xd08452c77c57150d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.713394:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4b0024b/0xd08452c77c57150d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.713417:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c7600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762954.713423:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4b0024b/0xd08452c77c57150d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.713432:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4b0024b/0xd08452c77c57150d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.713449:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4b0024b/0xd08452c77c57150d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.713455:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4b0024b/0xd08452c77c57150d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762954.713516:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140870528:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12337us (96540us total) trans 4294968023 rc 0/0 00000100:00100000:2.0:1789762954.713526:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 819 00000100:00100000:2.0:1789762954.713537:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359174194336 time 359174307136 state 0x2 ref 0 00000100:00100000:0.0:1789762954.716195:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762954.716260:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140870656 00000100:00100000:2.0:1789762954.716282:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140870656 00000100:00100000:2.0:1789762954.716329:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359174194336 time 359174307136 state 0x0 ref 1 00000100:00100000:2.0:1789762954.716340:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359274307136 time 359174307136 state 0x1 ref 1 00000100:00100000:0.0:1789762954.801294:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359274307136 time 359274441983 state 0x0 ref 1 00000100:00100000:0.0:1789762954.801316:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140870656:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762954.801364:0:14626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 97517568, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x2e80b 00010000:00010000:0.0:1789762954.801371:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571514 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.801384:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1789762954.801388:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762954.801393:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571514 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.801404:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571514 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762954.812260:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968024 is committed 00002000:00010000:2.0:1789762954.812291:0:14626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 97517568 -> 98566144 00002000:00010000:2.0:1789762954.812302:0:14626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 190475 -> 192523 00010000:00010000:2.0:1789762954.812312:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571514 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.812321:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571514 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.812328:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571514 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.812333:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762954.812336:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571514 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.812342:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571514 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.812356:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571514 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.812361:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f622ea79/0xd08452c77c571514 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762954.812419:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140870656:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11108us (96223us total) trans 4294968024 rc 0/0 00000100:00100000:2.0:1789762954.812427:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 820 00000100:00100000:2.0:1789762954.812436:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359274307136 time 359274441983 state 0x2 ref 0 00000100:00100000:1.0:1789762954.814493:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762954.814527:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140870784 00000100:00100000:2.0:1789762954.814535:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140870784 00000100:00100000:2.0:1789762954.814569:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359274307136 time 359274441983 state 0x0 ref 1 00000100:00100000:2.0:1789762954.814580:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359374441983 time 359274441983 state 0x1 ref 1 00000100:00100000:0.0:1789762954.901414:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359374441983 time 359374562164 state 0x0 ref 1 00000100:00100000:0.0:1789762954.901440:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140870784:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762954.901490:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 98566144, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x2f00b 00010000:00010000:0.0:1789762954.901497:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57151b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.901512:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1789762954.901516:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762954.901521:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57151b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.901533:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57151b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762954.912551:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968025 is committed 00002000:00010000:2.0:1789762954.912575:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:2.0:1789762954.912582:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 192523 -> 194571 00010000:00010000:2.0:1789762954.912595:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57151b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.912605:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57151b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.912611:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57151b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.912617:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762954.912620:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57151b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.912627:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57151b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.912641:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57151b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.912656:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033000e04/0xd08452c77c57151b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762954.912729:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140870784:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11297us (98234us total) trans 4294968025 rc 0/0 00000100:00100000:2.0:1789762954.912738:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 821 00000100:00100000:2.0:1789762954.912748:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359374441983 time 359374562164 state 0x2 ref 0 00000100:00100000:1.0:1789762954.915426:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762954.915468:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140870912 00000100:00100000:2.0:1789762954.915475:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140870912 00000100:00100000:2.0:1789762954.915512:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359374441983 time 359374562164 state 0x0 ref 1 00000100:00100000:2.0:1789762954.915523:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359474562164 time 359374562164 state 0x1 ref 1 00000100:00100000:3.0:1789762955.001528:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359474562164 time 359474673664 state 0x0 ref 1 00000100:00100000:3.0:1789762955.001569:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140870912:12345-192.168.203.31@tcp:4:dd.500 00000100:00080000:2.0:1789762955.001592:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762955.001619:0:13229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 99614720, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x2f80b 00010000:00010000:3.0:1789762955.001627:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c571522 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.001642:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1789762955.001647:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.001653:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c571522 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.001669:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c571522 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762955.012812:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968026 is committed 00002000:00010000:2.0:1789762955.012855:0:13229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:2.0:1789762955.012862:0:13229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 194571 -> 196619 00010000:00010000:2.0:1789762955.012876:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c571522 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.012887:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c571522 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.012894:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c571522 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.012909:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762955.012913:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c571522 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.012920:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c571522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.012934:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c571522 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.012939:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8b7ed68/0xd08452c77c571522 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762955.013003:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140870912:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11458us (97577us total) trans 4294968026 rc 0/0 00000100:00100000:2.0:1789762955.013011:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 822 00000100:00100000:2.0:1789762955.013022:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359474562164 time 359474673664 state 0x2 ref 0 00000100:00100000:1.0:1789762955.015441:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762955.015480:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140871040 00000100:00100000:2.0:1789762955.015487:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140871040 00000100:00100000:2.0:1789762955.015525:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359474562164 time 359474673664 state 0x0 ref 1 00000100:00100000:2.0:1789762955.015537:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359574673664 time 359474673664 state 0x1 ref 1 00000100:00100000:3.0:1789762955.101672:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359574673664 time 359574817861 state 0x0 ref 1 00000100:00100000:3.0:1789762955.101698:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140871040:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:3.0:1789762955.101760:0:11722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 100663296, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x3000b 00010000:00010000:3.0:1789762955.101768:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c571529 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.101782:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1789762955.101786:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.101790:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c571529 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.101802:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c571529 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.113115:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968027 is committed 00002000:00010000:0.0:1789762955.113117:0:11722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:0.0:1789762955.113122:0:11722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 196619 -> 198667 00010000:00010000:0.0:1789762955.113133:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c571529 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.113148:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c571529 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.113155:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c571529 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.113160:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160192400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762955.113164:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c571529 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.113170:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c571529 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.113184:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c571529 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.113189:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8177e28/0xd08452c77c571529 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.113269:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140871040:12345-192.168.203.31@tcp:4:dd.500 Request processed in 11562us (97809us total) trans 4294968027 rc 0/0 00000100:00100000:0.0:1789762955.113281:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 823 00000100:00100000:0.0:1789762955.113291:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359574673664 time 359574817861 state 0x2 ref 0 00000100:00100000:1.0:1789762955.115777:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762955.115827:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140871168 00000100:00100000:2.0:1789762955.115856:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140871168 00000100:00100000:2.0:1789762955.115895:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359574673664 time 359574817861 state 0x0 ref 1 00000100:00100000:2.0:1789762955.115905:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359674817861 time 359574817861 state 0x1 ref 1 00000100:00100000:0.0:1789762955.201790:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359674817861 time 359674936421 state 0x0 ref 1 00000100:00100000:0.0:1789762955.201817:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140871168:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762955.201907:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 101711872, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x3080b 00010000:00010000:0.0:1789762955.201915:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571530 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.201930:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1789762955.201934:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762955.201939:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571530 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.201949:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571530 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762955.214704:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968028 is committed 00002000:00010000:2.0:1789762955.214768:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 101711872 -> 102760448 00002000:00010000:2.0:1789762955.214775:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 198667 -> 200715 00010000:00010000:2.0:1789762955.214789:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571530 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.214822:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571530 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.214837:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571530 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.214846:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762955.214888:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571530 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.214895:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571530 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.214909:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571530 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.214915:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571530 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762955.215026:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140871168:12345-192.168.203.31@tcp:4:dd.500 Request processed in 13212us (99242us total) trans 4294968028 rc 0/0 00000100:00100000:2.0:1789762955.215042:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 824 00000100:00100000:2.0:1789762955.215060:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359674817861 time 359674936421 state 0x2 ref 0 00000100:00100000:2.0:1789762955.217393:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762955.217445:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140871296 00000100:00100000:3.0:1789762955.217456:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140871296 00000100:00100000:3.0:1789762955.217499:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359674817861 time 359674936421 state 0x0 ref 1 00000100:00100000:3.0:1789762955.217514:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359774936421 time 359674936421 state 0x1 ref 1 00000100:00100000:0.0:1789762955.301908:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359774936421 time 359775053306 state 0x0 ref 1 00000100:00100000:0.0:1789762955.301934:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140871296:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:0.0:1789762955.301991:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 102760448, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x3100b 00010000:00010000:0.0:1789762955.301999:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571537 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.302013:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1789762955.302017:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762955.302023:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571537 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.302039:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571537 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.302964:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789762955.314174:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968029 is committed 00002000:00010000:2.0:1789762955.314200:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:2.0:1789762955.314205:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 200715 -> 202763 00010000:00010000:2.0:1789762955.314218:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571537 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.314233:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571537 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.314244:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571537 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.314252:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c98800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762955.314267:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571537 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.314275:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571537 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.314318:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571537 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.314328:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb05363b/0xd08452c77c571537 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762955.314419:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140871296:12345-192.168.203.31@tcp:4:dd.500 Request processed in 12491us (97021us total) trans 4294968029 rc 0/0 00000100:00100000:2.0:1789762955.314432:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 825 00000100:00100000:2.0:1789762955.314447:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359774936421 time 359775053306 state 0x2 ref 0 00000100:00100000:1.0:1789762955.316998:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762955.317120:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140871424 00000100:00100000:0.0:1789762955.317129:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140871424 00000100:00100000:0.0:1789762955.317224:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359774936421 time 359775053306 state 0x0 ref 1 00000100:00100000:0.0:1789762955.317240:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359875053306 time 359775053306 state 0x1 ref 1 00000100:00100000:1.0:1789762955.402075:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359875053306 time 359875213826 state 0x0 ref 1 00000100:00100000:1.0:1789762955.402115:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140871424:12345-192.168.203.31@tcp:4:dd.500 00002000:00010000:1.0:1789762955.402187:0:11723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 103809024, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x3180b 00010000:00010000:1.0:1789762955.402199:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c57153e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762955.402221:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1789762955.402227:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762955.402235:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c57153e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762955.402301:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c57153e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762955.425128:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968030 is committed 00002000:00010000:2.0:1789762955.425163:0:11723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:2.0:1789762955.425174:0:11723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 202763 -> 204811 00010000:00010000:2.0:1789762955.425193:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c57153e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.425211:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c57153e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.425225:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c57153e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.425234:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d0493c6800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762955.425241:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c57153e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.425298:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c57153e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.425325:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c57153e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.425336:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000241b4338/0xd08452c77c57153e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762955.425442:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140871424:12345-192.168.203.31@tcp:4:dd.500 Request processed in 23338us (108445us total) trans 4294968030 rc 0/0 00000100:00100000:2.0:1789762955.425456:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 826 00000100:00100000:2.0:1789762955.425472:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d17442f000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 359875053306 time 359875213826 state 0x2 ref 0 00000100:00100000:1.0:1789762955.427492:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762955.427589:0:8160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140871680 00000100:00100000:3.0:1789762955.427604:0:8160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140871680 00000100:00080000:2.0:1789762955.427677:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762955.427686:0:8160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:3.0:1789762955.427703:0:8160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+8:14052:x1876702140871680:12345-192.168.203.31@tcp:35:dd.500 00000001:00080000:3.0:1789762955.428076:0:8160:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967558 00000100:00100000:3.0:1789762955.428214:0:8160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:77777931-b235-4c03-82d2-4b1d12553008+10:14052:x1876702140871680:12345-192.168.203.31@tcp:35:dd.500 Request processed in 513us (723us total) trans 4294967559 rc 0/0 00000100:00100000:3.0:1789762955.428226:0:8160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000020:00080000:3.0:1789762955.428234:0:8160:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789762955.474938:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762955.475053:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140871936 00000100:00100000:2.0:1789762955.475068:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140871936 00000100:00100000:2.0:1789762955.475139:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 303 00000100:00100000:2.0:1789762955.475152:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+10:14069:x1876702140871936:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:2.0:1789762955.475181:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762955.475218:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7000/0xd08452c77c571545 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ebe7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.475375:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c57154c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.475416:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c57154c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.475430:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c57154c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762955.475444:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 104857600 00010000:00010000:2.0:1789762955.475580:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf7000/0xd08452c77c571545 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebe7 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.475602:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c57154c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebe7 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.475613:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff95d15055d000) 00010000:00010000:2.0:1789762955.475616:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789762955.475620:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d144cf6600, rc 0) 00000100:00100000:2.0:1789762955.475687:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+12:14069:x1876702140871936:12345-192.168.203.31@tcp:101:dd.500 Request processed in 537us (763us total) trans 4294967560 rc 0/0 00000100:00100000:2.0:1789762955.475695:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 303 00000100:00100000:2.0:1789762955.477197:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762955.477287:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140872064 00000100:00100000:3.0:1789762955.477296:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140872064 00000100:00100000:3.0:1789762955.477346:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:3.0:1789762955.477357:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140872064:12345-192.168.203.31@tcp:101:dd.500 00010000:00010000:3.0:1789762955.477370:0:8803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762955.477386:0:8803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c57155a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ebee expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762955.477413:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 104857600, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x3200b 00010000:00010000:3.0:1789762955.477430:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1789762955.477436:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.477446:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c57155a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebee expref: 6 pid: 8803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.477462:0:8803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c57155a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebee expref: 6 pid: 8803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.477474:0:8803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d160192a00, rc 0) 00000100:00100000:3.0:1789762955.477533:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140872064:12345-192.168.203.31@tcp:101:dd.500 Request processed in 178us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762955.477541:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:1.0:1789762955.480137:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762955.480195:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140872192 00000100:00100000:2.0:1789762955.480204:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140872192 00000100:00100000:2.0:1789762955.480252:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328701620230 time 328701724814 state 0x0 ref 1 00000100:00100000:2.0:1789762955.480294:0:6661:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x1, head sequence 8: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d17b1a3d00 gen 0 rate 20 depth 3 token 0 deadline 328701620230 time 328701724814 state 0x0 ref 1 00000100:00100000:2.0:1789762955.480348:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 3 deadline 360053504929 time 359953504929 state 0x1 ref 1 00000100:00100000:2.0:1789762955.480394:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 360053504929 time 359953553949 state 0x0 ref 1 00000100:00100000:2.0:1789762955.480409:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140872192:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762955.480435:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042031c8c/0xd08452c77c571561 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.480449:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762955.480453:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762955.480459:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042031c8c/0xd08452c77c571561 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.480471:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042031c8c/0xd08452c77c571561 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.485211:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042031c8c/0xd08452c77c571561 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.485225:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042031c8c/0xd08452c77c571561 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.485234:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042031c8c/0xd08452c77c571561 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.485243:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762955.485248:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042031c8c/0xd08452c77c571561 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.485292:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042031c8c/0xd08452c77c571561 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.485310:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042031c8c/0xd08452c77c571561 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.485318:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042031c8c/0xd08452c77c571561 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762955.485388:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140872192:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4980us (5253us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762955.485396:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 827 00000100:00100000:2.0:1789762955.485405:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 360053504929 time 359953553949 state 0x2 ref 0 00000100:00100000:2.0:1789762955.487111:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762955.487164:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140872320 00000100:00100000:3.0:1789762955.487174:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140872320 00000100:00100000:3.0:1789762955.487232:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 360053504929 time 359953553949 state 0x0 ref 1 00000100:00100000:3.0:1789762955.487249:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 2 deadline 360053553949 time 359953553949 state 0x1 ref 1 00000100:00100000:3.0:1789762955.487305:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 1 deadline 360053553949 time 359960462769 state 0x0 ref 1 00000100:00100000:3.0:1789762955.487325:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140872320:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762955.487352:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571568 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.487368:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.487374:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.487381:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571568 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.487397:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571568 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.490751:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571568 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.490769:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571568 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.490783:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571568 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.490812:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762955.490819:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571568 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.490857:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571568 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.490880:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571568 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.490893:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571568 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762955.490986:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140872320:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3660us (3869us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762955.491003:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 828 00000100:00100000:3.0:1789762955.491020:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 1 deadline 360053553949 time 359960462769 state 0x2 ref 0 00000100:00100000:2.0:1789762955.492874:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762955.492939:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140872448 00000100:00100000:0.0:1789762955.492951:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140872448 00000100:00100000:0.0:1789762955.493001:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 1 deadline 360053553949 time 359960462769 state 0x0 ref 1 00000100:00100000:0.0:1789762955.493019:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 1 deadline 360060462769 time 359960462769 state 0x1 ref 1 00000100:00100000:0.0:1789762955.493061:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360060462769 time 359966221281 state 0x0 ref 1 00000100:00100000:0.0:1789762955.493078:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140872448:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762955.493108:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e54a92c0/0xd08452c77c57156f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.493126:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762955.493131:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762955.493138:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e54a92c0/0xd08452c77c57156f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.493154:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e54a92c0/0xd08452c77c57156f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.496649:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e54a92c0/0xd08452c77c57156f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.496661:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e54a92c0/0xd08452c77c57156f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.496669:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e54a92c0/0xd08452c77c57156f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.496676:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160078400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762955.496680:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54a92c0/0xd08452c77c57156f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.496687:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54a92c0/0xd08452c77c57156f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.496701:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e54a92c0/0xd08452c77c57156f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.496709:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e54a92c0/0xd08452c77c57156f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.496762:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140872448:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3687us (3889us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762955.496772:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 829 00000100:00100000:0.0:1789762955.496781:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360060462769 time 359966221281 state 0x2 ref 0 00000100:00100000:2.0:1789762955.499820:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762955.500168:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140872576 00000100:00100000:3.0:1789762955.500184:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140872576 00000100:00100000:3.0:1789762955.500295:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360060462769 time 359966221281 state 0x0 ref 1 00000100:00100000:3.0:1789762955.500320:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360066221281 time 359966221281 state 0x1 ref 1 00000100:00100000:2.0:1789762955.593177:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360066221281 time 360066324764 state 0x0 ref 1 00000100:00100000:2.0:1789762955.593200:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140872576:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762955.593237:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ee688a08/0xd08452c77c571576 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.593251:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762955.593281:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762955.593286:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee688a08/0xd08452c77c571576 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.593300:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee688a08/0xd08452c77c571576 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.596345:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ee688a08/0xd08452c77c571576 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.596359:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee688a08/0xd08452c77c571576 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.596368:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee688a08/0xd08452c77c571576 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.596376:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a895800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762955.596381:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee688a08/0xd08452c77c571576 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.596392:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee688a08/0xd08452c77c571576 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.596410:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee688a08/0xd08452c77c571576 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.596421:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee688a08/0xd08452c77c571576 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762955.596497:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140872576:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3305us (96690us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762955.596504:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 830 00000100:00100000:2.0:1789762955.596512:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360066221281 time 360066324764 state 0x2 ref 0 00000100:00100000:2.0:1789762955.598576:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762955.598631:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140872704 00000100:00100000:0.0:1789762955.598639:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140872704 00000100:00100000:0.0:1789762955.598676:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360066221281 time 360066324764 state 0x0 ref 1 00000100:00100000:0.0:1789762955.598695:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360166324764 time 360066324764 state 0x1 ref 1 00000100:00100000:3.0:1789762955.693214:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360166324764 time 360166365842 state 0x0 ref 1 00000100:00100000:3.0:1789762955.693237:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140872704:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762955.693289:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57157d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.693303:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.693307:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.693312:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57157d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.693323:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57157d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.696319:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57157d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.696331:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57157d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.696338:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57157d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.696343:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762955.696349:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57157d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.696361:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57157d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.696387:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57157d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.696398:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57157d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762955.696456:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140872704:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3221us (97881us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762955.696464:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 831 00000100:00100000:3.0:1789762955.696473:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360166324764 time 360166365842 state 0x2 ref 0 00000100:00100000:0.0:1789762955.698542:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762955.698596:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140872832 00000100:00100000:2.0:1789762955.698604:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140872832 00000100:00100000:2.0:1789762955.698644:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360166324764 time 360166365842 state 0x0 ref 1 00000100:00100000:2.0:1789762955.698655:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360266365842 time 360166365842 state 0x1 ref 1 00000100:00100000:2.0:1789762955.793364:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360266365842 time 360266504687 state 0x0 ref 1 00000100:00100000:2.0:1789762955.793397:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d145528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140872832:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762955.793450:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c571584 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.793471:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762955.793477:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762955.793501:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c571584 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.793534:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c571584 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.798684:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c571584 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.798709:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c571584 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.798729:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c571584 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.798747:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762955.798757:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c571584 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.798776:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c571584 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.798803:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c571584 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.798814:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071dd43ec/0xd08452c77c571584 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762955.798963:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d145528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140872832:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5573us (100417us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762955.798987:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 832 00000100:00100000:2.0:1789762955.799013:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360266365842 time 360266504687 state 0x2 ref 0 00000100:00100000:2.0:1789762955.802393:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762955.802474:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140872960 00000100:00100000:0.0:1789762955.802487:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140872960 00000100:00100000:0.0:1789762955.802561:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360266365842 time 360266504687 state 0x0 ref 1 00000100:00100000:0.0:1789762955.802579:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360366504687 time 360266504687 state 0x1 ref 1 00000100:00100000:3.0:1789762955.893577:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360366504687 time 360366690424 state 0x0 ref 1 00000100:00100000:3.0:1789762955.893627:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140872960:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762955.893696:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57158b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.893720:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.893726:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.893735:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57158b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.893752:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57158b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.898729:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57158b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.898749:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57158b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.898764:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57158b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.898780:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762955.898789:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57158b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.898808:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57158b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.898880:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57158b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.898894:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57158b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762955.898998:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140872960:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5386us (96603us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762955.899016:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 833 00000100:00100000:3.0:1789762955.899044:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360366504687 time 360366690424 state 0x2 ref 0 00000100:00100000:0.0:1789762955.902901:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762955.902980:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140873088 00000100:00100000:3.0:1789762955.902994:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140873088 00000100:00100000:3.0:1789762955.903054:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360366504687 time 360366690424 state 0x0 ref 1 00000100:00100000:3.0:1789762955.903073:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360466690424 time 360366690424 state 0x1 ref 1 00000001:00080000:2.0:1789762955.958303:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967560 is committed 00000100:00100000:3.0:1789762955.993656:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360466690424 time 360466796949 state 0x0 ref 1 00000100:00100000:3.0:1789762955.993690:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140873088:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762955.993752:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571592 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.993783:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.993793:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.993806:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571592 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.993866:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571592 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.998800:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571592 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.998829:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571592 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.998894:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571592 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.998906:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762955.998913:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571592 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.998926:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571592 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.998950:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571592 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.998961:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571592 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762955.999045:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140873088:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5365us (96146us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762955.999058:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 834 00000100:00100000:3.0:1789762955.999074:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360466690424 time 360466796949 state 0x2 ref 0 00000100:00100000:0.0:1789762956.003167:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762956.003289:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140873216 00000100:00100000:2.0:1789762956.003303:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140873216 00000100:00100000:2.0:1789762956.003364:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360466690424 time 360466796949 state 0x0 ref 1 00000100:00100000:2.0:1789762956.003384:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360566796949 time 360466796949 state 0x1 ref 1 00000100:00100000:2.0:1789762956.093794:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360566796949 time 360566925221 state 0x0 ref 1 00000100:00100000:2.0:1789762956.093871:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140873216:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762956.093929:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c571599 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.093958:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.093967:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.093978:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c571599 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.094006:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c571599 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.099150:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c571599 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.099180:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c571599 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.099200:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c571599 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.099219:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fe000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762956.099230:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c571599 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.099271:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c571599 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.099310:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c571599 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.099324:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000767b11fe/0xd08452c77c571599 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.099421:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140873216:12345-192.168.203.31@tcp:3:dd.500 Request processed in 5596us (96255us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762956.099433:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 835 00000100:00100000:0.0:1789762956.099449:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360566796949 time 360566925221 state 0x2 ref 0 00000100:00100000:0.0:1789762956.103151:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762956.103227:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140873344 00000100:00100000:3.0:1789762956.103241:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140873344 00000100:00100000:3.0:1789762956.103324:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360566796949 time 360566925221 state 0x0 ref 1 00000100:00100000:3.0:1789762956.103379:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360666925221 time 360566925221 state 0x1 ref 1 00000100:00100000:2.0:1789762956.193895:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360666925221 time 360667039272 state 0x0 ref 1 00000100:00100000:2.0:1789762956.193947:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140873344:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762956.193989:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715a0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.194007:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.194011:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.194017:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.194031:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.198092:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.198110:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.198121:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.198130:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747ffa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762956.198135:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.198147:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.198177:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.198189:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762956.198267:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140873344:12345-192.168.203.31@tcp:3:dd.500 Request processed in 4312us (95106us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762956.198279:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 836 00000100:00100000:2.0:1789762956.198289:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360666925221 time 360667039272 state 0x2 ref 0 00000100:00100000:2.0:1789762956.200354:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762956.200393:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140873472 00000100:00100000:3.0:1789762956.200402:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140873472 00000100:00100000:3.0:1789762956.200443:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360666925221 time 360667039272 state 0x0 ref 1 00000100:00100000:3.0:1789762956.200455:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360767039272 time 360667039272 state 0x1 ref 1 00000100:00100000:0.0:1789762956.294024:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360767039272 time 360767170584 state 0x0 ref 1 00000100:00100000:0.0:1789762956.294049:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140873472:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762956.294086:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715a7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.294105:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762956.294108:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762956.294113:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.294124:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.296989:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.297001:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.297010:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.297016:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cde00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762956.297020:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.297026:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.297039:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.297049:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.297097:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140873472:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3057us (96744us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762956.297103:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 837 00000100:00100000:0.0:1789762956.297111:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360767039272 time 360767170584 state 0x2 ref 0 00000100:00100000:1.0:1789762956.298985:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762956.299017:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140873600 00000100:00100000:0.0:1789762956.299026:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140873600 00000100:00100000:0.0:1789762956.299062:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360767039272 time 360767170584 state 0x0 ref 1 00000100:00100000:0.0:1789762956.299074:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360867170584 time 360767170584 state 0x1 ref 1 00010000:00010000:3.0:1789762956.326953:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762956.394091:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360867170584 time 360867236843 state 0x0 ref 1 00000100:00100000:0.0:1789762956.394117:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140873600:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762956.394155:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715ae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.394169:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762956.394173:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762956.394178:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.394194:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.397303:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.397316:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.397324:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.397330:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1588cde00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762956.397334:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.397341:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.397354:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.397362:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f9302c/0xd08452c77c5715ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.397431:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140873600:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3322us (98444us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762956.397443:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 838 00000100:00100000:0.0:1789762956.397452:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360867170584 time 360867236843 state 0x2 ref 0 00000100:00100000:1.0:1789762956.399307:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762956.399359:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140873728 00000100:00100000:2.0:1789762956.399368:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140873728 00000100:00100000:2.0:1789762956.399406:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360867170584 time 360867236843 state 0x0 ref 1 00000100:00100000:2.0:1789762956.399418:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360967236843 time 360867236843 state 0x1 ref 1 00000100:00100000:2.0:1789762956.494155:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360967236843 time 360967301351 state 0x0 ref 1 00000100:00100000:2.0:1789762956.494180:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140873728:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762956.494217:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005364d4a8/0xd08452c77c5715b5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.494247:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.494264:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.494269:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005364d4a8/0xd08452c77c5715b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.494281:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005364d4a8/0xd08452c77c5715b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.497062:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005364d4a8/0xd08452c77c5715b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.497075:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005364d4a8/0xd08452c77c5715b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.497082:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005364d4a8/0xd08452c77c5715b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.497087:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cc4600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762956.497090:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005364d4a8/0xd08452c77c5715b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.497104:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005364d4a8/0xd08452c77c5715b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.497117:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005364d4a8/0xd08452c77c5715b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.497129:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005364d4a8/0xd08452c77c5715b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762956.497180:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140873728:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3010us (97873us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762956.497188:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 839 00000100:00100000:3.0:1789762956.497197:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360967236843 time 360967301351 state 0x2 ref 0 00000100:00100000:1.0:1789762956.498991:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762956.499041:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140873856 00000100:00100000:0.0:1789762956.499050:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140873856 00000100:00100000:0.0:1789762956.499101:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 360967236843 time 360967301351 state 0x0 ref 1 00000100:00100000:0.0:1789762956.499113:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361067301351 time 360967301351 state 0x1 ref 1 00000100:00100000:3.0:1789762956.594296:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361067301351 time 361067431809 state 0x0 ref 1 00000100:00100000:3.0:1789762956.594320:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140873856:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762956.594356:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715bc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.594378:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762956.594381:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762956.594386:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.594399:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.597626:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.597657:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.597667:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.597676:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762956.597681:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.597691:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.597708:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.597714:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762956.597757:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140873856:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3447us (98768us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762956.597765:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 840 00000100:00100000:3.0:1789762956.597773:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361067301351 time 361067431809 state 0x2 ref 0 00000100:00100000:0.0:1789762956.599801:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762956.599848:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140873984 00000100:00100000:3.0:1789762956.599861:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140873984 00000100:00100000:3.0:1789762956.599898:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361067301351 time 361067431809 state 0x0 ref 1 00000100:00100000:3.0:1789762956.599912:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361167431809 time 361067431809 state 0x1 ref 1 00000100:00100000:3.0:1789762956.694358:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361167431809 time 361167505764 state 0x0 ref 1 00000100:00100000:3.0:1789762956.694385:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140873984:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762956.694421:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715c3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.694436:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762956.694439:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762956.694444:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.694454:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.697654:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.697666:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.697673:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.697688:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762956.697692:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.697699:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.697711:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.697716:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762956.697776:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140873984:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3402us (97976us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762956.697784:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 841 00000100:00100000:3.0:1789762956.697792:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361167431809 time 361167505764 state 0x2 ref 0 00000100:00100000:2.0:1789762956.699566:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762956.699601:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140874112 00000100:00100000:3.0:1789762956.699609:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140874112 00000100:00100000:3.0:1789762956.699643:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361167431809 time 361167505764 state 0x0 ref 1 00000100:00100000:3.0:1789762956.699655:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361267505764 time 361167505764 state 0x1 ref 1 00000100:00100000:2.0:1789762956.794489:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361267505764 time 361267633144 state 0x0 ref 1 00000100:00100000:2.0:1789762956.794515:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140874112:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762956.794554:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715ca lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.794568:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.794572:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.794577:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.794589:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.797710:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.797722:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.797730:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.797736:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747ffa00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762956.797740:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.797751:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.797766:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.797771:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fee90402/0xd08452c77c5715ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.797820:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140874112:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3315us (98253us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762956.797827:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 842 00000100:00100000:0.0:1789762956.797868:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361267505764 time 361267633144 state 0x2 ref 0 00000100:00100000:1.0:1789762956.799666:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762956.799715:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140874240 00000100:00100000:3.0:1789762956.799735:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140874240 00000100:00100000:3.0:1789762956.799778:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361267505764 time 361267633144 state 0x0 ref 1 00000100:00100000:3.0:1789762956.799793:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361367633144 time 361267633144 state 0x1 ref 1 00000100:00100000:2.0:1789762956.894624:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361367633144 time 361367771034 state 0x0 ref 1 00000100:00100000:2.0:1789762956.894665:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140874240:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762956.894703:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c5715d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.894718:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.894721:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.894726:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c5715d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.894738:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c5715d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.897490:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c5715d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.897502:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c5715d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.897509:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c5715d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.897513:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747ff000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762956.897517:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c5715d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.897523:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c5715d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.897536:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c5715d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.897541:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c353a4/0xd08452c77c5715d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.897602:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140874240:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2944us (97935us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762956.897610:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 843 00000100:00100000:0.0:1789762956.897618:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361367633144 time 361367771034 state 0x2 ref 0 00000100:00100000:1.0:1789762956.899381:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762956.899424:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140874368 00000100:00100000:3.0:1789762956.899433:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140874368 00000100:00100000:3.0:1789762956.899468:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361367633144 time 361367771034 state 0x0 ref 1 00000100:00100000:3.0:1789762956.899479:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361467771034 time 361367771034 state 0x1 ref 1 00000100:00100000:1.0:1789762956.966976:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762956.967009:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149050752:0@lo:400:kworker.0 00000100:00100000:2.0:1789762956.967010:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149050624:0@lo:400:kworker.0 00000100:00100000:3.0:1789762956.967010:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149050368:0@lo:400:kworker.0 00000100:00100000:1.0:1789762956.967098:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762956.967103:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762956.967120:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149050880:0@lo:400:kworker.0 00000100:00100000:0.0:1789762956.967145:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149050752 00000100:00100000:0.0:1789762956.967154:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149050752 00000100:00100000:1.0:1789762956.967162:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17463ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149050496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762956.967165:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762956.967167:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149051008:0@lo:400:kworker.0 00000100:00080000:2.0:1789762956.967212:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762956.967213:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762956.967218:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789762956.967223:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762956.967232:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149050752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762956.967240:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149050496 00000100:00100000:2.0:1789762956.967262:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149050496 00000100:00100000:1.0:1789762956.967272:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762956.967273:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789762956.967283:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149051136:0@lo:400:kworker.0 00000100:00100000:0.0:1789762956.967327:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149050752:12345-0@lo:400:kworker.0 Request processed in 99us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762956.967333:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789762956.967333:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762956.967339:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149050752:0@lo:400:kworker.0 00000100:00100000:0.0:1789762956.967343:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789762956.967352:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149050496:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762956.967370:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149051008 00000100:00100000:0.0:1789762956.967374:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149051008 00002000:00000024:2.0:1789762956.967383:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762956.967384:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149050368 00000100:00100000:1.0:1789762956.967387:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149050624 00000100:00100000:3.0:1789762956.967390:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149050368 00000100:00100000:1.0:1789762956.967393:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149050624 00000100:00100000:0.0:1789762956.967413:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789762956.967422:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149051008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762956.967448:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149050496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762956.967450:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789762956.967454:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789762956.967467:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789762956.967468:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149050624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762956.967470:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149050368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762956.967472:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149051008:12345-0@lo:400:kworker.0 Request processed in 50us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762956.967485:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789762956.967509:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149050880 00000100:00100000:2.0:1789762956.967527:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149050880 00000100:00100000:0.0:1789762956.967536:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149051008:0@lo:400:kworker.0 00000100:00100000:1.0:1789762956.967545:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149050624:12345-0@lo:400:kworker.0 Request processed in 84us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762956.967552:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149050368:12345-0@lo:400:kworker.0 Request processed in 85us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762956.967553:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149050368:0@lo:400:kworker.0 00000100:00100000:1.0:1789762956.967558:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789762956.967568:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789762956.967570:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149051136 00000100:00100000:2.0:1789762956.967575:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149051136 00000100:00100000:2.0:1789762956.967610:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789762956.967620:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149050624:0@lo:400:kworker.0 00000100:00100000:0.0:1789762956.967621:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789762956.967623:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149050880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762956.967639:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149051136:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789762956.967650:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762956.967662:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762956.967665:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762956.967685:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149050880:12345-0@lo:400:kworker.0 Request processed in 66us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762956.967694:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967416 gen 2 00000100:00100000:2.0:1789762956.967698:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789762956.967700:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149051136:12345-0@lo:400:kworker.0 Request processed in 64us (368us total) trans 0 rc 0/0 00000004:00080000:3.0:1789762956.967701:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d148cc0700, transno 4294967416 00000100:00100000:0.0:1789762956.967711:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789762956.967720:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149051136:0@lo:400:kworker.0 00000100:00100000:3.0:1789762956.967725:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17463ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149050496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762956.967752:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149050880:0@lo:400:kworker.0 00000100:00100000:0.0:1789762956.994713:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361467771034 time 361467852311 state 0x0 ref 1 00000100:00100000:0.0:1789762956.994732:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140874368:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762956.994761:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.994787:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762956.994790:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762956.994795:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.994806:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.998618:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.998630:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.998637:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.998643:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762956.998646:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.998652:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.998665:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.998669:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.998719:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140874368:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3992us (99338us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762956.998727:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 844 00000100:00100000:0.0:1789762956.998736:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361467771034 time 361467852311 state 0x2 ref 0 00000100:00100000:2.0:1789762957.000720:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762957.000763:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140874496 00000100:00100000:0.0:1789762957.000771:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140874496 00000100:00100000:0.0:1789762957.000807:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361467771034 time 361467852311 state 0x0 ref 1 00000100:00100000:0.0:1789762957.000818:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361567852311 time 361467852311 state 0x1 ref 1 00000100:00100000:0.0:1789762957.094808:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361567852311 time 361567950708 state 0x0 ref 1 00000100:00100000:0.0:1789762957.094877:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140874496:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:3.0:1789762957.094914:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762957.094916:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715df lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.094932:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762957.094935:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762957.094940:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.094952:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.097663:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.097674:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.097681:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.097687:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141525000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762957.097690:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.097697:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.097711:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.097716:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa3a121b/0xd08452c77c5715df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762957.097767:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140874496:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2941us (97048us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762957.097775:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 845 00000100:00100000:0.0:1789762957.097782:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361567852311 time 361567950708 state 0x2 ref 0 00000100:00100000:0.0:1789762957.099600:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762957.099649:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140874624 00000100:00100000:2.0:1789762957.099657:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140874624 00000100:00100000:2.0:1789762957.099698:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361567852311 time 361567950708 state 0x0 ref 1 00000100:00100000:2.0:1789762957.099709:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361667950708 time 361567950708 state 0x1 ref 1 00000100:00100000:2.0:1789762957.172322:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762957.172354:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762957.172377:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762957.172389:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140874752 00000100:00100000:0.0:1789762957.172400:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140874752 00000100:00100000:3.0:1789762957.172406:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140874880 00000100:00100000:2.0:1789762957.172407:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762957.172414:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140874880 00000100:00100000:2.0:1789762957.172435:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140875136 00000100:00100000:1.0:1789762957.172438:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140875008 00000100:00100000:2.0:1789762957.172440:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140875136 00000100:00100000:1.0:1789762957.172445:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140875008 00000100:00100000:0.0:1789762957.172455:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 313 00000100:00100000:0.0:1789762957.172468:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140874752:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762957.172476:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 270 00000100:00100000:3.0:1789762957.172486:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+9:2345:x1876702140874880:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762957.172496:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:2.0:1789762957.172502:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 271 00000100:00100000:1.0:1789762957.172508:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140875008:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762957.172516:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140875136:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762957.172537:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+9:2345:x1876702140874880:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 49us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762957.172538:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140874752:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 68us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762957.172551:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140875008:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 45us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762957.172555:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140875136:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 44us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762957.172562:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 313 00000100:00100000:3.0:1789762957.172562:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 270 00000100:00100000:1.0:1789762957.172569:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:2.0:1789762957.172574:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 271 00000100:00080000:3.0:1789762957.172600:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762957.172607:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762957.194886:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361667950708 time 361668036739 state 0x0 ref 1 00000100:00100000:2.0:1789762957.194903:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140874624:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762957.194934:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5715e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.194948:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762957.194952:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762957.194956:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5715e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.194967:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5715e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.197756:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5715e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.197768:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5715e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.197775:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5715e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.197780:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762957.197783:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5715e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.197801:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5715e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.197815:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5715e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.197819:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5715e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762957.197892:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140874624:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2993us (98292us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762957.197899:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 846 00000100:00100000:2.0:1789762957.197907:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361667950708 time 361668036739 state 0x2 ref 0 00000100:00100000:2.0:1789762957.199758:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762957.199811:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140875264 00000100:00100000:0.0:1789762957.199821:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140875264 00000100:00100000:0.0:1789762957.199874:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361667950708 time 361668036739 state 0x0 ref 1 00000100:00100000:0.0:1789762957.199885:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361768036739 time 361668036739 state 0x1 ref 1 00000100:00100000:0.0:1789762957.294959:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361768036739 time 361768105021 state 0x0 ref 1 00000100:00100000:0.0:1789762957.294983:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140875264:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762957.295020:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0a6d9a2/0xd08452c77c5715ed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.295033:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762957.295037:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762957.295042:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0a6d9a2/0xd08452c77c5715ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.295053:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0a6d9a2/0xd08452c77c5715ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.297968:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0a6d9a2/0xd08452c77c5715ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.297985:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0a6d9a2/0xd08452c77c5715ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.297995:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0a6d9a2/0xd08452c77c5715ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.298004:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762957.298010:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0a6d9a2/0xd08452c77c5715ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.298021:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0a6d9a2/0xd08452c77c5715ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.298039:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0a6d9a2/0xd08452c77c5715ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.298047:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0a6d9a2/0xd08452c77c5715ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762957.298104:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140875264:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3127us (98342us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762957.298115:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 847 00000100:00100000:0.0:1789762957.298126:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361768036739 time 361768105021 state 0x2 ref 0 00000100:00100000:0.0:1789762957.299883:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762957.299926:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140875392 00000100:00100000:3.0:1789762957.299934:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140875392 00000100:00100000:3.0:1789762957.299968:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361768036739 time 361768105021 state 0x0 ref 1 00000100:00100000:3.0:1789762957.299978:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361868105021 time 361768105021 state 0x1 ref 1 00010000:00010000:1.0:1789762957.350936:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762957.395056:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361868105021 time 361868201746 state 0x0 ref 1 00000100:00100000:3.0:1789762957.395082:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140875392:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762957.395118:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715f4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.395150:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762957.395153:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762957.395158:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.395177:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.397726:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.397734:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.397740:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.397745:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762957.397748:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.397754:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.397767:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.397781:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762957.397826:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140875392:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2755us (97944us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762957.397867:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 848 00000100:00100000:3.0:1789762957.397878:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361868105021 time 361868201746 state 0x2 ref 0 00000100:00100000:1.0:1789762957.399718:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762957.399796:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140875520 00000100:00100000:2.0:1789762957.399805:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140875520 00000100:00100000:2.0:1789762957.399883:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361868105021 time 361868201746 state 0x0 ref 1 00000100:00100000:2.0:1789762957.399896:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361968201746 time 361868201746 state 0x1 ref 1 00000100:00100000:2.0:1789762957.479051:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789762957.479073:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d043c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149051264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762957.479133:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762957.479198:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149051264 00000100:00100000:3.0:1789762957.479209:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149051264 00000100:00100000:3.0:1789762957.479277:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789762957.479289:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1747f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149051264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762957.479323:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526581760 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789762957.479379:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1747f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149051264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762957.479388:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789762957.479409:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d043c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149051264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762957.495179:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361968201746 time 361968327811 state 0x0 ref 1 00000100:00100000:3.0:1789762957.495199:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140875520:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762957.495232:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715fb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.495258:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762957.495262:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762957.495277:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.495288:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.498357:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.498371:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.498378:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.498384:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762957.498388:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.498395:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.498410:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.498416:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5715fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762957.498478:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140875520:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3284us (98759us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762957.498487:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 849 00000100:00100000:3.0:1789762957.498495:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361968201746 time 361968327811 state 0x2 ref 0 00000100:00100000:2.0:1789762957.500393:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762957.500447:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140875648 00000100:00100000:0.0:1789762957.500455:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140875648 00000100:00100000:0.0:1789762957.500493:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 361968201746 time 361968327811 state 0x0 ref 1 00000100:00100000:0.0:1789762957.500504:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362068327811 time 361968327811 state 0x1 ref 1 00000100:00100000:2.0:1789762957.595302:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362068327811 time 362068443760 state 0x0 ref 1 00000100:00100000:2.0:1789762957.595328:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140875648:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762957.595365:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c571602 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.595379:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762957.595382:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762957.595387:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c571602 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.595400:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c571602 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.598002:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c571602 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.598013:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c571602 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.598019:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c571602 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.598023:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762957.598033:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c571602 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.598040:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c571602 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.598053:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c571602 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.598057:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e86f33e/0xd08452c77c571602 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762957.598105:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140875648:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2786us (97711us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762957.598112:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 850 00000100:00100000:2.0:1789762957.598119:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362068327811 time 362068443760 state 0x2 ref 0 00000100:00100000:2.0:1789762957.599870:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762957.599908:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140875776 00000100:00100000:3.0:1789762957.599917:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140875776 00000100:00100000:3.0:1789762957.599954:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362068327811 time 362068443760 state 0x0 ref 1 00000100:00100000:3.0:1789762957.599965:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362168443760 time 362068443760 state 0x1 ref 1 00000100:00100000:0.0:1789762957.695397:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362168443760 time 362168543966 state 0x0 ref 1 00000100:00100000:0.0:1789762957.695423:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140875776:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762957.695467:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571609 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.695480:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762957.695484:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762957.695489:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571609 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.695500:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571609 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.698516:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571609 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.698535:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571609 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.698552:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571609 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.698561:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14880d600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762957.698567:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571609 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.698577:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571609 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.698593:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571609 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.698602:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571609 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762957.698663:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140875776:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3247us (98790us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762957.698673:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 851 00000100:00100000:0.0:1789762957.698685:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362168443760 time 362168543966 state 0x2 ref 0 00000100:00100000:1.0:1789762957.700411:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762957.700444:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140875904 00000100:00100000:3.0:1789762957.700452:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140875904 00000100:00100000:3.0:1789762957.700489:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362168443760 time 362168543966 state 0x0 ref 1 00000100:00100000:3.0:1789762957.700500:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362268543966 time 362168543966 state 0x1 ref 1 00000100:00100000:3.0:1789762957.795455:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362268543966 time 362268602388 state 0x0 ref 1 00000100:00100000:3.0:1789762957.795480:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140875904:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762957.795516:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571610 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.795531:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762957.795547:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762957.795552:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571610 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.795564:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571610 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.798317:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571610 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.798329:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571610 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.798337:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571610 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.798343:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762957.798346:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571610 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.798352:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571610 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.798364:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571610 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.798369:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571610 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762957.798422:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140875904:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2950us (98010us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762957.798429:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 852 00000100:00100000:3.0:1789762957.798438:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362268543966 time 362268602388 state 0x2 ref 0 00000100:00100000:2.0:1789762957.800201:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762957.800254:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140876032 00000100:00100000:0.0:1789762957.800264:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140876032 00000100:00100000:0.0:1789762957.800308:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362268543966 time 362268602388 state 0x0 ref 1 00000100:00100000:0.0:1789762957.800323:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362368602388 time 362268602388 state 0x1 ref 1 00000100:00100000:2.0:1789762957.895559:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362368602388 time 362368704768 state 0x0 ref 1 00000100:00100000:2.0:1789762957.895585:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140876032:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762957.895621:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571617 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.895635:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762957.895650:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762957.895655:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571617 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.895666:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571617 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.898586:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571617 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.898598:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571617 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.898609:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571617 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.898618:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762957.898624:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571617 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.898635:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571617 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.898654:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571617 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.898662:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571617 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762957.898731:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140876032:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3155us (98528us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762957.898742:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 853 00000100:00100000:3.0:1789762957.898753:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362368602388 time 362368704768 state 0x2 ref 0 00000100:00100000:0.0:1789762957.900455:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762957.900506:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140876160 00000100:00100000:2.0:1789762957.900513:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140876160 00000100:00100000:2.0:1789762957.900555:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362368602388 time 362368704768 state 0x0 ref 1 00000100:00100000:2.0:1789762957.900571:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362468704768 time 362368704768 state 0x1 ref 1 00000100:00100000:0.0:1789762957.995648:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362468704768 time 362468794571 state 0x0 ref 1 00000100:00100000:0.0:1789762957.995673:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140876160:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762957.995717:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57161e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.995735:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762957.995741:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762957.995748:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57161e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.995763:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57161e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.998560:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57161e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.998574:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57161e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.998584:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57161e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.998596:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14880d600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762957.998600:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57161e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.998606:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57161e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.998620:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57161e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.998626:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57161e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762957.998672:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140876160:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3009us (98218us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762957.998678:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 854 00000100:00100000:0.0:1789762957.998688:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362468704768 time 362468794571 state 0x2 ref 0 00000100:00100000:0.0:1789762958.000347:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762958.000385:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140876288 00000100:00100000:3.0:1789762958.000393:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140876288 00000100:00100000:3.0:1789762958.000429:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362468704768 time 362468794571 state 0x0 ref 1 00000100:00100000:3.0:1789762958.000440:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362568794571 time 362468794571 state 0x1 ref 1 00000100:00100000:3.0:1789762958.095715:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362568794571 time 362568862688 state 0x0 ref 1 00000100:00100000:3.0:1789762958.095741:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140876288:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762958.095776:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571625 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.095790:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.095793:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.095798:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571625 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.095809:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571625 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.099274:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571625 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.099291:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571625 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.099299:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571625 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.099305:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762958.099309:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571625 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.099316:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571625 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.099333:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571625 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.099339:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571625 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.099399:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140876288:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3667us (99051us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762958.099407:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 855 00000100:00100000:3.0:1789762958.099426:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362568794571 time 362568862688 state 0x2 ref 0 00000100:00100000:2.0:1789762958.101154:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762958.101195:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140876416 00000100:00100000:3.0:1789762958.101205:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140876416 00000100:00100000:3.0:1789762958.101256:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362568794571 time 362568862688 state 0x0 ref 1 00000100:00100000:3.0:1789762958.101268:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362668862688 time 362568862688 state 0x1 ref 1 00000100:00100000:3.0:1789762958.195780:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362668862688 time 362668928088 state 0x0 ref 1 00000100:00100000:3.0:1789762958.195803:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140876416:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762958.195855:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57162c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.195868:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.195872:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.195877:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57162c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.195888:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57162c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.199145:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57162c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.199161:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57162c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.199191:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57162c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.199202:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762958.199209:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57162c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.199224:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57162c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.199267:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57162c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.199280:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57162c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.199361:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140876416:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3564us (98207us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762958.199371:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 856 00000100:00100000:3.0:1789762958.199381:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362668862688 time 362668928088 state 0x2 ref 0 00000100:00100000:1.0:1789762958.201697:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762958.201766:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140876544 00000100:00100000:0.0:1789762958.201778:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140876544 00000100:00100000:0.0:1789762958.201858:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362668862688 time 362668928088 state 0x0 ref 1 00000100:00100000:0.0:1789762958.201889:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362768928088 time 362668928088 state 0x1 ref 1 00000100:00100000:0.0:1789762958.295888:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362768928088 time 362768995193 state 0x0 ref 1 00000100:00100000:0.0:1789762958.295911:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140876544:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762958.295947:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c571633 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.295962:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762958.295965:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762958.295970:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c571633 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.295981:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c571633 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.298539:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c571633 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.298550:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c571633 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.298558:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c571633 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.298564:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d1747fee00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762958.298568:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c571633 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.298575:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c571633 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.298590:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c571633 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.298595:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b2c84c7/0xd08452c77c571633 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762958.298643:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140876544:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2739us (96949us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762958.298651:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 857 00000100:00100000:0.0:1789762958.298659:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362768928088 time 362768995193 state 0x2 ref 0 00000100:00100000:0.0:1789762958.300333:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762958.300363:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140876672 00000100:00100000:3.0:1789762958.300371:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140876672 00000100:00100000:3.0:1789762958.300406:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362768928088 time 362768995193 state 0x0 ref 1 00000100:00100000:3.0:1789762958.300429:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362868995193 time 362768995193 state 0x1 ref 1 00010000:00010000:0.0:1789762958.374959:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762958.395943:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362868995193 time 362869088161 state 0x0 ref 1 00000100:00100000:2.0:1789762958.395995:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140876672:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762958.396040:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57163a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.396059:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762958.396064:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762958.396071:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57163a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.396086:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57163a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.399142:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57163a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.399155:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57163a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.399165:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57163a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.399184:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762958.399189:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57163a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.399199:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57163a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.399213:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57163a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.399218:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c57163a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762958.399278:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140876672:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3297us (98946us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762958.399285:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 858 00000100:00100000:2.0:1789762958.399299:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362868995193 time 362869088161 state 0x2 ref 0 00000100:00100000:1.0:1789762958.401196:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762958.401250:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140876800 00000100:00100000:3.0:1789762958.401258:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140876800 00000100:00100000:3.0:1789762958.401306:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362868995193 time 362869088161 state 0x0 ref 1 00000100:00100000:3.0:1789762958.401316:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362969088161 time 362869088161 state 0x1 ref 1 00000100:00100000:3.0:1789762958.496002:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362969088161 time 362969147538 state 0x0 ref 1 00000100:00100000:3.0:1789762958.496028:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140876800:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762958.496065:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571641 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.496079:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.496083:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.496087:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571641 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.496098:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571641 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.498790:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571641 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.498812:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571641 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.498820:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571641 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.498826:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762958.498829:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571641 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.498863:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571641 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.498876:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571641 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.498882:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571641 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.498940:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140876800:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2922us (97754us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762958.498948:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 859 00000100:00100000:3.0:1789762958.498956:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362969088161 time 362969147538 state 0x2 ref 0 00000100:00100000:0.0:1789762958.500730:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762958.500782:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140876928 00000100:00100000:2.0:1789762958.500790:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140876928 00000100:00100000:2.0:1789762958.500827:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 362969088161 time 362969147538 state 0x0 ref 1 00000100:00100000:2.0:1789762958.500855:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363069147538 time 362969147538 state 0x1 ref 1 00000100:00100000:2.0:1789762958.596054:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363069147538 time 363069201160 state 0x0 ref 1 00000100:00100000:2.0:1789762958.596078:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140876928:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762958.596115:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571648 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.596128:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762958.596131:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762958.596136:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571648 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.596148:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571648 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.599352:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571648 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.599362:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571648 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.599376:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.599382:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762958.599385:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.599392:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571648 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.599405:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571648 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.599411:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571648 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762958.599458:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140876928:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3390us (98728us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762958.599465:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 860 00000100:00100000:2.0:1789762958.599474:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363069147538 time 363069201160 state 0x2 ref 0 00000100:00100000:0.0:1789762958.601339:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762958.601375:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140877056 00000100:00100000:2.0:1789762958.601383:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140877056 00000100:00100000:2.0:1789762958.601416:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363069147538 time 363069201160 state 0x0 ref 1 00000100:00100000:2.0:1789762958.601435:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363169201160 time 363069201160 state 0x1 ref 1 00000100:00100000:0.0:1789762958.696137:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363169201160 time 363169283176 state 0x0 ref 1 00000100:00100000:0.0:1789762958.696164:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140877056:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762958.696204:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003da1bd9c/0xd08452c77c57164f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.696228:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762958.696247:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762958.696255:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003da1bd9c/0xd08452c77c57164f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.696268:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003da1bd9c/0xd08452c77c57164f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.699221:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003da1bd9c/0xd08452c77c57164f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.699249:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003da1bd9c/0xd08452c77c57164f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.699256:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003da1bd9c/0xd08452c77c57164f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.699262:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148d23600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762958.699265:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003da1bd9c/0xd08452c77c57164f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.699272:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003da1bd9c/0xd08452c77c57164f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.699288:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003da1bd9c/0xd08452c77c57164f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.699298:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003da1bd9c/0xd08452c77c57164f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762958.699345:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140877056:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3191us (98006us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762958.699353:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 861 00000100:00100000:0.0:1789762958.699362:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363169201160 time 363169283176 state 0x2 ref 0 00000100:00100000:0.0:1789762958.701054:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762958.701084:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140877184 00000100:00100000:3.0:1789762958.701101:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140877184 00000100:00100000:3.0:1789762958.701138:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363169201160 time 363169283176 state 0x0 ref 1 00000100:00100000:3.0:1789762958.701150:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363269283176 time 363169283176 state 0x1 ref 1 00000100:00100000:2.0:1789762958.796248:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363269283176 time 363269375685 state 0x0 ref 1 00000100:00100000:2.0:1789762958.796276:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140877184:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762958.796315:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571656 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.796330:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762958.796334:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762958.796339:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571656 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.796349:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571656 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.799113:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571656 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.799125:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571656 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.799133:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571656 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.799159:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762958.799163:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571656 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.799173:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571656 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.799192:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571656 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.799201:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571656 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762958.799272:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140877184:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3005us (98216us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762958.799280:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 862 00000100:00100000:2.0:1789762958.799288:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363269283176 time 363269375685 state 0x2 ref 0 00000100:00100000:1.0:1789762958.801043:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762958.801078:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140877312 00000100:00100000:2.0:1789762958.801087:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140877312 00000100:00100000:2.0:1789762958.801124:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363269283176 time 363269375685 state 0x0 ref 1 00000100:00100000:2.0:1789762958.801135:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363369375685 time 363269375685 state 0x1 ref 1 00000100:00100000:3.0:1789762958.896371:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363369375685 time 363369517616 state 0x0 ref 1 00000100:00100000:3.0:1789762958.896398:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140877312:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762958.896436:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57165d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.896451:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.896454:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.896460:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57165d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.896471:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57165d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.899549:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57165d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.899563:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57165d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.899570:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57165d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.899587:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762958.899592:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57165d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.899599:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57165d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.899614:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57165d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.899619:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57165d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.899676:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140877312:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3286us (98631us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762958.899688:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 863 00000100:00100000:3.0:1789762958.899700:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363369375685 time 363369517616 state 0x2 ref 0 00000100:00100000:1.0:1789762958.901645:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762958.901693:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140877440 00000100:00100000:0.0:1789762958.901700:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140877440 00000100:00100000:0.0:1789762958.901737:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363369375685 time 363369517616 state 0x0 ref 1 00000100:00100000:0.0:1789762958.901748:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363469517616 time 363369517616 state 0x1 ref 1 00000100:00100000:2.0:1789762958.996469:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363469517616 time 363469615343 state 0x0 ref 1 00000100:00100000:2.0:1789762958.996507:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140877440:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762958.996554:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571664 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.996569:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762958.996573:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762958.996578:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571664 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.996589:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571664 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.999494:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571664 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.999503:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571664 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.999509:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571664 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.999514:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762958.999517:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571664 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.999539:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571664 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.999553:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571664 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.999559:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e877540/0xd08452c77c571664 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762958.999605:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140877440:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3104us (97960us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762958.999612:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 864 00000100:00100000:2.0:1789762958.999620:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363469517616 time 363469615343 state 0x2 ref 0 00000100:00100000:1.0:1789762959.001439:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762959.001477:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140877568 00000100:00100000:2.0:1789762959.001485:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140877568 00000100:00080000:3.0:1789762959.001531:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762959.001542:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363469517616 time 363469615343 state 0x0 ref 1 00000100:00100000:2.0:1789762959.001554:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363569615343 time 363469615343 state 0x1 ref 1 00000100:00100000:0.0:1789762959.096539:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363569615343 time 363569686477 state 0x0 ref 1 00000100:00100000:0.0:1789762959.096561:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140877568:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762959.096596:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c57166b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.096610:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762959.096614:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762959.096618:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c57166b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.096629:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c57166b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.099313:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c57166b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.099324:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c57166b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.099331:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c57166b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.099337:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d182041c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762959.099341:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c57166b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.099347:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c57166b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.099361:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c57166b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.099366:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c84d6bf/0xd08452c77c57166b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762959.099418:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140877568:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2864us (97980us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762959.099425:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 865 00000100:00100000:0.0:1789762959.099433:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363569615343 time 363569686477 state 0x2 ref 0 00000100:00100000:0.0:1789762959.101257:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762959.101291:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140877696 00000100:00100000:3.0:1789762959.101299:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140877696 00000100:00100000:3.0:1789762959.101334:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363569615343 time 363569686477 state 0x0 ref 1 00000100:00100000:3.0:1789762959.101345:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363669686477 time 363569686477 state 0x1 ref 1 00000100:00100000:3.0:1789762959.196602:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363669686477 time 363669746308 state 0x0 ref 1 00000100:00100000:3.0:1789762959.196628:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140877696:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762959.196667:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571672 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.196685:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762959.196690:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762959.196697:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571672 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.196711:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571672 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.199593:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571672 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.199606:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571672 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.199615:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571672 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.199624:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762959.199628:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571672 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.199646:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571672 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.199664:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571672 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.199672:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571672 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762959.199728:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140877696:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3106us (98469us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762959.199737:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 866 00000100:00100000:3.0:1789762959.199748:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363669686477 time 363669746308 state 0x2 ref 0 00000100:00100000:2.0:1789762959.201510:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762959.201551:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140877824 00000100:00100000:3.0:1789762959.201560:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140877824 00000100:00100000:3.0:1789762959.201600:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363669686477 time 363669746308 state 0x0 ref 1 00000100:00100000:3.0:1789762959.201614:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363769746308 time 363669746308 state 0x1 ref 1 00000100:00100000:3.0:1789762959.296664:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363769746308 time 363769808808 state 0x0 ref 1 00000100:00100000:3.0:1789762959.296689:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140877824:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762959.296726:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571679 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.296756:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762959.296761:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762959.296768:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571679 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.296783:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571679 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.299585:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571679 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.299598:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571679 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.299608:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571679 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.299616:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762959.299621:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571679 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.299632:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571679 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.299651:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571679 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.299673:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571679 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762959.299732:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140877824:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3049us (98221us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762959.299743:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 867 00000100:00100000:3.0:1789762959.299754:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363769746308 time 363769808808 state 0x2 ref 0 00000100:00100000:2.0:1789762959.301554:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762959.301630:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140877952 00000100:00100000:0.0:1789762959.301638:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140877952 00000100:00100000:0.0:1789762959.301674:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363769746308 time 363769808808 state 0x0 ref 1 00000100:00100000:0.0:1789762959.301685:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363869808808 time 363769808808 state 0x1 ref 1 00000100:00100000:0.0:1789762959.396740:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363869808808 time 363869885943 state 0x0 ref 1 00000100:00100000:0.0:1789762959.396765:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140877952:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762959.396803:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571680 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.396817:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762959.396820:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762959.396825:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571680 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.396877:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571680 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.398926:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762959.399760:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571680 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.399776:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571680 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.399786:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571680 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.399792:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148c99c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762959.399796:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571680 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.399803:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571680 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.399817:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571680 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.399823:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000875d9e09/0xd08452c77c571680 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762959.399898:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140877952:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3141us (98350us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762959.399909:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 868 00000100:00100000:0.0:1789762959.399922:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363869808808 time 363869885943 state 0x2 ref 0 00000100:00100000:0.0:1789762959.402077:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762959.402121:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140878080 00000100:00100000:3.0:1789762959.402129:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140878080 00000100:00100000:3.0:1789762959.402170:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363869808808 time 363869885943 state 0x0 ref 1 00000100:00100000:3.0:1789762959.402185:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363969885943 time 363869885943 state 0x1 ref 1 00000100:00100000:2.0:1789762959.496886:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363969885943 time 363970033532 state 0x0 ref 1 00000100:00100000:2.0:1789762959.496922:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140878080:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762959.496958:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571687 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.496973:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.496977:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.496981:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571687 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.496992:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571687 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.499581:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571687 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.499592:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571687 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.499599:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571687 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.499605:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762959.499609:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571687 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.499615:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571687 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.499637:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571687 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.499643:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571687 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762959.499693:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140878080:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2776us (97616us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762959.499700:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 869 00000100:00100000:2.0:1789762959.499707:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363969885943 time 363970033532 state 0x2 ref 0 00000100:00100000:0.0:1789762959.501401:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762959.501448:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140878208 00000100:00100000:3.0:1789762959.501456:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140878208 00000100:00100000:3.0:1789762959.501497:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 363969885943 time 363970033532 state 0x0 ref 1 00000100:00100000:3.0:1789762959.501513:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364070033532 time 363970033532 state 0x1 ref 1 00000100:00100000:3.0:1789762959.596943:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364070033532 time 364070089112 state 0x0 ref 1 00000100:00100000:3.0:1789762959.596969:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140878208:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762959.597021:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57168e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.597038:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762959.597043:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762959.597049:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57168e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.597064:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57168e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.599907:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57168e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.599919:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57168e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.599929:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57168e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.599936:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762959.599941:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57168e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.599951:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57168e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.599980:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57168e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.599989:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57168e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762959.600042:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140878208:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3080us (98641us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762959.600052:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 870 00000100:00100000:3.0:1789762959.600062:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364070033532 time 364070089112 state 0x2 ref 0 00000100:00100000:0.0:1789762959.601894:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762959.601951:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140878336 00000100:00100000:2.0:1789762959.601959:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140878336 00000100:00100000:2.0:1789762959.601998:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364070033532 time 364070089112 state 0x0 ref 1 00000100:00100000:2.0:1789762959.602008:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364170089112 time 364070089112 state 0x1 ref 1 00000100:00100000:2.0:1789762959.697007:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364170089112 time 364170148645 state 0x0 ref 1 00000100:00100000:2.0:1789762959.697039:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140878336:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762959.697078:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571695 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.697092:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.697106:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.697112:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571695 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.697123:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571695 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.699818:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571695 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.699828:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571695 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.699865:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571695 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.699874:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d141524000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762959.699880:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571695 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.699890:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571695 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.699908:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571695 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.699918:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831fda55/0xd08452c77c571695 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762959.699974:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140878336:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2948us (98080us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762959.699982:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 871 00000100:00100000:2.0:1789762959.699992:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364170089112 time 364170148645 state 0x2 ref 0 00000100:00100000:1.0:1789762959.701794:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762959.701830:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140878464 00000100:00100000:2.0:1789762959.701852:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140878464 00000100:00100000:2.0:1789762959.701891:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364170089112 time 364170148645 state 0x0 ref 1 00000100:00100000:2.0:1789762959.701905:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364270148645 time 364170148645 state 0x1 ref 1 00000100:00100000:0.0:1789762959.797092:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364270148645 time 364270238820 state 0x0 ref 1 00000100:00100000:0.0:1789762959.797116:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140878464:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762959.797154:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a938f74/0xd08452c77c57169c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.797168:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762959.797172:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762959.797177:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a938f74/0xd08452c77c57169c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.797188:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a938f74/0xd08452c77c57169c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.799810:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a938f74/0xd08452c77c57169c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.799821:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a938f74/0xd08452c77c57169c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.799828:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a938f74/0xd08452c77c57169c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.799847:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148d0a200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762959.799851:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a938f74/0xd08452c77c57169c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.799858:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a938f74/0xd08452c77c57169c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.799870:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a938f74/0xd08452c77c57169c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.799875:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a938f74/0xd08452c77c57169c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762959.799923:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140878464:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2814us (98129us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762959.799930:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 872 00000100:00100000:0.0:1789762959.799938:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364270148645 time 364270238820 state 0x2 ref 0 00000100:00100000:1.0:1789762959.801682:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762959.801730:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140878592 00000100:00100000:3.0:1789762959.801738:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140878592 00000100:00100000:3.0:1789762959.801779:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364270148645 time 364270238820 state 0x0 ref 1 00000100:00100000:3.0:1789762959.801796:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364370238820 time 364270238820 state 0x1 ref 1 00000100:00100000:3.0:1789762959.897185:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364370238820 time 364370327553 state 0x0 ref 1 00000100:00100000:3.0:1789762959.897216:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140878592:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762959.897279:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.897297:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762959.897315:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762959.897322:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.897337:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.900119:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.900131:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.900141:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.900150:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762959.900155:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.900164:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.900183:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.900192:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762959.900268:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140878592:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3064us (98585us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762959.900279:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 873 00000100:00100000:3.0:1789762959.900290:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364370238820 time 364370327553 state 0x2 ref 0 00000100:00100000:2.0:1789762959.902065:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762959.902106:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140878720 00000100:00100000:3.0:1789762959.902115:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140878720 00000100:00100000:3.0:1789762959.902151:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364370238820 time 364370327553 state 0x0 ref 1 00000100:00100000:3.0:1789762959.902166:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364470327553 time 364370327553 state 0x1 ref 1 00000100:00100000:3.0:1789762959.997274:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364470327553 time 364470417150 state 0x0 ref 1 00000100:00100000:3.0:1789762959.997302:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140878720:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762959.997343:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716aa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.997360:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762959.997365:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762959.997372:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.997386:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.000262:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.000274:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.000284:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.000293:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762960.000298:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.000308:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.000324:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.000333:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762960.000388:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140878720:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3096us (98323us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762960.000398:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 874 00000100:00100000:3.0:1789762960.000415:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364470327553 time 364470417150 state 0x2 ref 0 00000100:00100000:2.0:1789762960.002250:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762960.002311:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140878848 00000100:00100000:0.0:1789762960.002321:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140878848 00000100:00100000:0.0:1789762960.002367:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364470327553 time 364470417150 state 0x0 ref 1 00000100:00100000:0.0:1789762960.002380:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364570417150 time 364470417150 state 0x1 ref 1 00000100:00100000:2.0:1789762960.097354:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364570417150 time 364570497173 state 0x0 ref 1 00000100:00100000:2.0:1789762960.097380:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140878848:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762960.097419:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c5716b1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.097435:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.097440:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.097447:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c5716b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.097480:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c5716b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.100127:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c5716b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.100139:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c5716b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.100147:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c5716b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.100153:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638000 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762960.100157:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c5716b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.100164:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c5716b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.100176:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c5716b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.100181:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054ca25fb/0xd08452c77c5716b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762960.100247:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140878848:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2874us (97997us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762960.100255:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 875 00000100:00100000:0.0:1789762960.100264:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364570417150 time 364570497173 state 0x2 ref 0 00000100:00100000:1.0:1789762960.101942:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762960.101974:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140878976 00000100:00100000:3.0:1789762960.101982:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140878976 00000100:00100000:3.0:1789762960.102017:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364570417150 time 364570497173 state 0x0 ref 1 00000100:00100000:3.0:1789762960.102028:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364670497173 time 364570497173 state 0x1 ref 1 00000100:00100000:2.0:1789762960.197434:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364670497173 time 364670577000 state 0x0 ref 1 00000100:00100000:2.0:1789762960.197460:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17463ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140878976:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762960.197497:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5716b8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.197514:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.197519:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.197525:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5716b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.197539:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5716b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.200218:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5716b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.200244:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5716b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.200254:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5716b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.200263:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762960.200268:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5716b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.200279:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5716b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.200297:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5716b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.200303:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e452006a/0xd08452c77c5716b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762960.200356:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17463ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140878976:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2902us (98413us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762960.200366:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 876 00000100:00100000:0.0:1789762960.200376:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364670497173 time 364670577000 state 0x2 ref 0 00000100:00100000:1.0:1789762960.202136:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762960.202176:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140879104 00000100:00100000:3.0:1789762960.202185:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140879104 00000100:00100000:3.0:1789762960.202232:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364670497173 time 364670577000 state 0x0 ref 1 00000100:00100000:3.0:1789762960.202244:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364770577000 time 364670577000 state 0x1 ref 1 00000100:00100000:3.0:1789762960.297483:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364770577000 time 364770629800 state 0x0 ref 1 00000100:00100000:3.0:1789762960.297504:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140879104:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762960.297539:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716bf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.297553:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762960.297557:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762960.297562:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.297572:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.300275:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.300287:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.300295:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.300300:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762960.300304:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.300311:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.300324:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.300329:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762960.300381:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140879104:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2883us (98246us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762960.300388:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 877 00000100:00100000:3.0:1789762960.300401:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364770577000 time 364770629800 state 0x2 ref 0 00000100:00100000:1.0:1789762960.302247:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762960.302306:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140879232 00000100:00100000:0.0:1789762960.302316:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140879232 00000100:00100000:0.0:1789762960.302358:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364770577000 time 364770629800 state 0x0 ref 1 00000100:00100000:0.0:1789762960.302373:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364870629800 time 364770629800 state 0x1 ref 1 00000100:00100000:2.0:1789762960.397576:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364870629800 time 364870721112 state 0x0 ref 1 00000100:00100000:2.0:1789762960.397603:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140879232:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762960.397645:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b9e19ee/0xd08452c77c5716c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.397662:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.397679:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.397686:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b9e19ee/0xd08452c77c5716c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.397701:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b9e19ee/0xd08452c77c5716c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.400534:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b9e19ee/0xd08452c77c5716c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.400544:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b9e19ee/0xd08452c77c5716c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.400551:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b9e19ee/0xd08452c77c5716c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.400557:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d182041600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762960.400560:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b9e19ee/0xd08452c77c5716c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.400566:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b9e19ee/0xd08452c77c5716c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.400578:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b9e19ee/0xd08452c77c5716c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.400583:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b9e19ee/0xd08452c77c5716c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762960.400638:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140879232:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3044us (98390us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762960.400650:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 878 00000100:00100000:3.0:1789762960.400666:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364870629800 time 364870721112 state 0x2 ref 0 00000100:00100000:1.0:1789762960.402425:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762960.402469:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140879360 00000100:00100000:0.0:1789762960.402477:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140879360 00000100:00100000:0.0:1789762960.402514:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364870629800 time 364870721112 state 0x0 ref 1 00000100:00100000:0.0:1789762960.402524:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364970721112 time 364870721112 state 0x1 ref 1 00010000:00010000:3.0:1789762960.422960:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762960.497641:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364970721112 time 364970790788 state 0x0 ref 1 00000100:00100000:0.0:1789762960.497665:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140879360:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762960.497702:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716cd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.497716:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762960.497719:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762960.497724:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.497735:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.500343:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.500358:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.500369:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.500378:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762960.500384:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.500395:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.500412:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.500418:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762960.500467:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140879360:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2811us (98044us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762960.500474:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 879 00000100:00100000:0.0:1789762960.500482:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364970721112 time 364970790788 state 0x2 ref 0 00000100:00100000:0.0:1789762960.502288:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762960.502332:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140879488 00000100:00100000:3.0:1789762960.502341:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140879488 00000100:00100000:3.0:1789762960.502377:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 364970721112 time 364970790788 state 0x0 ref 1 00000100:00100000:3.0:1789762960.502388:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365070790788 time 364970790788 state 0x1 ref 1 00000100:00100000:0.0:1789762960.597763:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365070790788 time 365070907882 state 0x0 ref 1 00000100:00100000:0.0:1789762960.597786:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140879488:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762960.597820:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716d4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.597855:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762960.597860:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762960.597869:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.597887:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.600452:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.600463:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.600471:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.600476:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762960.600480:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.600491:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.600503:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.600508:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762960.600561:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140879488:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2779us (98271us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762960.600568:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 880 00000100:00100000:0.0:1789762960.600576:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365070790788 time 365070907882 state 0x2 ref 0 00000100:00100000:0.0:1789762960.602292:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762960.602325:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140879616 00000100:00100000:3.0:1789762960.602333:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140879616 00000100:00100000:3.0:1789762960.602366:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365070790788 time 365070907882 state 0x0 ref 1 00000100:00100000:3.0:1789762960.602377:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365170907882 time 365070907882 state 0x1 ref 1 00000100:00100000:3.0:1789762960.697815:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365170907882 time 365170956288 state 0x0 ref 1 00000100:00100000:3.0:1789762960.697858:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d043c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140879616:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762960.697900:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716db lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.697920:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762960.697925:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762960.697932:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.697957:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.700574:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.700588:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.700598:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.700607:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762960.700612:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.700623:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.700640:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.700646:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762960.700701:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d043c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140879616:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2868us (98410us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762960.700708:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 881 00000100:00100000:3.0:1789762960.700716:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365170907882 time 365170956288 state 0x2 ref 0 00000100:00100000:0.0:1789762960.702492:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762960.702569:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140879744 00000100:00100000:2.0:1789762960.702578:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140879744 00000100:00100000:2.0:1789762960.702615:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365170907882 time 365170956288 state 0x0 ref 1 00000100:00100000:2.0:1789762960.702626:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365270956288 time 365170956288 state 0x1 ref 1 00000100:00100000:0.0:1789762960.797888:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365270956288 time 365271036878 state 0x0 ref 1 00000100:00100000:0.0:1789762960.797911:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d148cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140879744:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762960.797947:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716e2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.797961:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762960.797964:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762960.797970:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.797980:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.800503:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.800514:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.800521:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.800525:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762960.800529:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.800535:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.800547:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.800552:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c5ea5da/0xd08452c77c5716e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762960.800609:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d148cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140879744:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2706us (98117us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762960.800616:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 882 00000100:00100000:3.0:1789762960.800623:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365270956288 time 365271036878 state 0x2 ref 0 00000100:00100000:0.0:1789762960.802399:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762960.802445:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140879872 00000100:00100000:2.0:1789762960.802454:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140879872 00000100:00100000:2.0:1789762960.802490:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365270956288 time 365271036878 state 0x0 ref 1 00000100:00100000:2.0:1789762960.802501:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365371036878 time 365271036878 state 0x1 ref 1 00000100:00100000:0.0:1789762960.897991:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365371036878 time 365371136870 state 0x0 ref 1 00000100:00100000:0.0:1789762960.898016:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140879872:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762960.898052:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082a0c5db/0xd08452c77c5716e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.898066:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762960.898069:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762960.898074:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082a0c5db/0xd08452c77c5716e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.898085:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082a0c5db/0xd08452c77c5716e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.900585:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082a0c5db/0xd08452c77c5716e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.900596:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082a0c5db/0xd08452c77c5716e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.900608:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082a0c5db/0xd08452c77c5716e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.900613:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf6a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762960.900617:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a0c5db/0xd08452c77c5716e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.900623:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a0c5db/0xd08452c77c5716e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.900636:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082a0c5db/0xd08452c77c5716e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762960.900641:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082a0c5db/0xd08452c77c5716e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762960.900689:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140879872:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2683us (98290us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762960.900697:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 883 00000100:00100000:0.0:1789762960.900708:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365371036878 time 365371136870 state 0x2 ref 0 00000100:00100000:0.0:1789762960.902649:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762960.902686:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140880000 00000100:00100000:3.0:1789762960.902695:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140880000 00000100:00100000:3.0:1789762960.902730:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365371036878 time 365371136870 state 0x0 ref 1 00000100:00100000:3.0:1789762960.902741:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365471136870 time 365371136870 state 0x1 ref 1 00000100:00100000:3.0:1789762960.998053:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365471136870 time 365471200060 state 0x0 ref 1 00000100:00100000:3.0:1789762960.998075:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140880000:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762960.998112:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.998126:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762960.998130:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762960.998135:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.998146:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.000856:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.000865:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.000871:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.000876:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762961.000879:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.000885:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.000897:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.000902:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762961.000947:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140880000:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2879us (98298us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762961.000954:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 884 00000100:00100000:3.0:1789762961.000967:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365471136870 time 365471200060 state 0x2 ref 0 00000100:00100000:0.0:1789762961.002727:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762961.002763:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140880128 00000100:00100000:3.0:1789762961.002772:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140880128 00000100:00080000:0.0:1789762961.002815:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762961.002851:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365471136870 time 365471200060 state 0x0 ref 1 00000100:00100000:3.0:1789762961.002863:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365571200060 time 365471200060 state 0x1 ref 1 00000100:00100000:3.0:1789762961.098096:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365571200060 time 365571247322 state 0x0 ref 1 00000100:00100000:3.0:1789762961.098117:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140880128:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762961.098151:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.098165:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762961.098169:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762961.098174:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.098184:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.101008:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.101024:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.101042:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.101051:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762961.101056:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.101065:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.101083:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.101092:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5716f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762961.101145:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140880128:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3034us (98419us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762961.101152:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 885 00000100:00100000:3.0:1789762961.101159:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365571200060 time 365571247322 state 0x2 ref 0 00000100:00100000:1.0:1789762961.102989:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762961.103034:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140880256 00000100:00100000:0.0:1789762961.103042:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140880256 00000100:00100000:0.0:1789762961.103078:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365571200060 time 365571247322 state 0x0 ref 1 00000100:00100000:0.0:1789762961.103089:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365671247322 time 365571247322 state 0x1 ref 1 00000100:00100000:2.0:1789762961.198205:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365671247322 time 365671352985 state 0x0 ref 1 00000100:00100000:2.0:1789762961.198243:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140880256:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762961.198280:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c5716fe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.198294:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.198308:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.198313:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c5716fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.198324:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c5716fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.201070:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c5716fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.201085:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c5716fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.201095:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c5716fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.201103:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762961.201108:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c5716fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.201118:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c5716fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.201134:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c5716fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.201143:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c5716fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762961.201199:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140880256:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2963us (98211us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762961.201206:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 886 00000100:00100000:2.0:1789762961.201224:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365671247322 time 365671352985 state 0x2 ref 0 00000100:00100000:2.0:1789762961.202981:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762961.203024:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140880384 00000100:00100000:3.0:1789762961.203032:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140880384 00000100:00100000:3.0:1789762961.203067:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365671247322 time 365671352985 state 0x0 ref 1 00000100:00100000:3.0:1789762961.203088:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365771352985 time 365671352985 state 0x1 ref 1 00000100:00100000:2.0:1789762961.298299:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365771352985 time 365771437682 state 0x0 ref 1 00000100:00100000:2.0:1789762961.298325:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140880384:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762961.298361:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c571705 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.298377:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.298383:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.298390:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c571705 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.298403:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c571705 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.301062:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c571705 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.301075:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c571705 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.301098:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c571705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.301106:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762961.301110:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c571705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.301119:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c571705 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.301136:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c571705 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.301143:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003434dc5b/0xd08452c77c571705 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762961.301198:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140880384:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2880us (98216us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762961.301207:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 887 00000100:00100000:2.0:1789762961.301231:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365771352985 time 365771437682 state 0x2 ref 0 00000100:00100000:2.0:1789762961.303001:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762961.303050:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140880512 00000100:00100000:3.0:1789762961.303060:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140880512 00000100:00100000:3.0:1789762961.303098:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365771352985 time 365771437682 state 0x0 ref 1 00000100:00100000:3.0:1789762961.303109:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365871437682 time 365771437682 state 0x1 ref 1 00000100:00100000:3.0:1789762961.398338:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365871437682 time 365871486615 state 0x0 ref 1 00000100:00100000:3.0:1789762961.398361:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140880512:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762961.398396:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57170c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.398411:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762961.398414:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762961.398419:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57170c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.398429:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57170c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.401022:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57170c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.401055:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57170c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.401065:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57170c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.401070:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762961.401074:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57170c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.401081:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57170c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.401094:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57170c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.401099:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57170c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762961.401143:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140880512:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2790us (98144us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762961.401150:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 888 00000100:00100000:3.0:1789762961.401157:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365871437682 time 365871486615 state 0x2 ref 0 00000100:00100000:1.0:1789762961.402968:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762961.403020:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140880640 00000100:00100000:2.0:1789762961.403029:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140880640 00000100:00100000:2.0:1789762961.403067:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365871437682 time 365871486615 state 0x0 ref 1 00000100:00100000:2.0:1789762961.403089:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365971486615 time 365871486615 state 0x1 ref 1 00010000:00010000:1.0:1789762961.446926:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762961.498427:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365971486615 time 365971576982 state 0x0 ref 1 00000100:00100000:0.0:1789762961.498448:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140880640:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762961.498482:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571713 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.498497:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762961.498500:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762961.498505:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571713 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.498515:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571713 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.501045:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571713 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.501068:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571713 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.501076:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571713 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.501082:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762961.501086:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571713 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.501093:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571713 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.501108:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571713 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.501114:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95c4d0f/0xd08452c77c571713 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762961.501165:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140880640:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2724us (98198us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762961.501172:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 889 00000100:00100000:3.0:1789762961.501180:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365971486615 time 365971576982 state 0x2 ref 0 00000100:00100000:1.0:1789762961.503043:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762961.503085:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140880768 00000100:00100000:2.0:1789762961.503093:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140880768 00000100:00100000:2.0:1789762961.503128:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 365971486615 time 365971576982 state 0x0 ref 1 00000100:00100000:2.0:1789762961.503138:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366071576982 time 365971576982 state 0x1 ref 1 00000100:00100000:0.0:1789762961.598539:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366071576982 time 366071688127 state 0x0 ref 1 00000100:00100000:0.0:1789762961.598561:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140880768:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762961.598595:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c57171a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.598613:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762961.598617:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762961.598621:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c57171a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.598633:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c57171a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.601347:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c57171a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.601359:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c57171a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.601366:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c57171a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.601371:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762961.601375:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c57171a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.601381:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c57171a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.601394:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c57171a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.601403:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c57171a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762961.601451:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140880768:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2897us (98409us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762961.601458:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 890 00000100:00100000:0.0:1789762961.601466:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366071576982 time 366071688127 state 0x2 ref 0 00000100:00100000:1.0:1789762961.603668:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762961.603708:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140880896 00000100:00100000:3.0:1789762961.603731:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140880896 00000100:00100000:3.0:1789762961.603774:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366071576982 time 366071688127 state 0x0 ref 1 00000100:00100000:3.0:1789762961.603787:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366171688127 time 366071688127 state 0x1 ref 1 00000100:00100000:3.0:1789762961.698592:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366171688127 time 366171738989 state 0x0 ref 1 00000100:00100000:3.0:1789762961.698625:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140880896:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762961.698662:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571721 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.698676:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762961.698679:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762961.698684:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571721 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.698695:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571721 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.701513:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571721 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.701523:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571721 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.701530:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571721 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.701542:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762961.701546:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571721 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.701553:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571721 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.701568:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571721 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.701573:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571721 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762961.701619:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140880896:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3003us (97950us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762961.701629:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 891 00000100:00100000:3.0:1789762961.701640:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366171688127 time 366171738989 state 0x2 ref 0 00000100:00100000:1.0:1789762961.703643:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762961.703675:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140881024 00000100:00100000:3.0:1789762961.703683:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140881024 00000100:00100000:3.0:1789762961.703718:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366171688127 time 366171738989 state 0x0 ref 1 00000100:00100000:3.0:1789762961.703733:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366271738989 time 366171738989 state 0x1 ref 1 00000100:00100000:3.0:1789762961.798642:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366271738989 time 366271789059 state 0x0 ref 1 00000100:00100000:3.0:1789762961.798676:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140881024:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762961.798711:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571728 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.798728:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762961.798733:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762961.798740:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571728 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.798756:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571728 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.801588:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571728 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.801599:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571728 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.801607:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.801612:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762961.801616:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.801631:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571728 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.801644:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571728 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.801649:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571728 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762961.801694:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140881024:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3025us (98052us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762961.801701:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 892 00000100:00100000:3.0:1789762961.801709:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366271738989 time 366271789059 state 0x2 ref 0 00000100:00100000:2.0:1789762961.803467:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762961.803528:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140881152 00000100:00100000:0.0:1789762961.803537:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140881152 00000100:00100000:0.0:1789762961.803574:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366271738989 time 366271789059 state 0x0 ref 1 00000100:00100000:0.0:1789762961.803585:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366371789059 time 366271789059 state 0x1 ref 1 00000100:00100000:2.0:1789762961.898735:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366371789059 time 366371882979 state 0x0 ref 1 00000100:00100000:2.0:1789762961.898761:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140881152:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762961.898798:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57172f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.898812:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.898815:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.898820:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57172f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.898848:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57172f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.901774:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57172f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.901796:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57172f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.901803:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57172f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.901809:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14880d600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762961.901813:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57172f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.901819:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57172f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.901849:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57172f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.901854:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c57172f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762961.901901:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140881152:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3150us (98434us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762961.901908:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 893 00000100:00100000:2.0:1789762961.901915:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366371789059 time 366371882979 state 0x2 ref 0 00000100:00100000:2.0:1789762961.903879:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762961.903932:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140881280 00000100:00100000:3.0:1789762961.903940:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140881280 00000100:00100000:3.0:1789762961.903975:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366371789059 time 366371882979 state 0x0 ref 1 00000100:00100000:3.0:1789762961.903986:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366471882979 time 366371882979 state 0x1 ref 1 00000100:00100000:2.0:1789762961.998819:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366471882979 time 366471966397 state 0x0 ref 1 00000100:00100000:2.0:1789762961.998864:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140881280:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762961.998905:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571736 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.998924:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.998929:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.998936:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571736 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.998952:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571736 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.001546:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571736 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.001558:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571736 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.001565:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571736 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.001571:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d14880d600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762962.001575:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571736 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.001593:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571736 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.001608:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571736 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.001617:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c759e2f/0xd08452c77c571736 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762962.001670:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140881280:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2836us (97791us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762962.001677:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 894 00000100:00100000:2.0:1789762962.001685:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366471882979 time 366471966397 state 0x2 ref 0 00000100:00100000:2.0:1789762962.003399:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762962.003441:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140881408 00000100:00100000:3.0:1789762962.003449:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140881408 00000100:00100000:3.0:1789762962.003484:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366471882979 time 366471966397 state 0x0 ref 1 00000100:00100000:3.0:1789762962.003496:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366571966397 time 366471966397 state 0x1 ref 1 00000100:00100000:1.0:1789762962.086990:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149051648:0@lo:400:kworker.0 00000100:00100000:3.0:1789762962.087000:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149051520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762962.087020:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149051392:0@lo:400:kworker.0 00000100:00100000:3.0:1789762962.087069:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762962.087072:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762962.087073:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762962.087116:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149051520 00000100:00100000:2.0:1789762962.087124:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149051520 00000100:00100000:1.0:1789762962.087148:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149052160:0@lo:400:kworker.0 00000100:00100000:3.0:1789762962.087151:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149052032:0@lo:400:kworker.0 00000100:00100000:0.0:1789762962.087154:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173cead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149051904:0@lo:400:kworker.0 00000100:00100000:2.0:1789762962.087182:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789762962.087187:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762962.087194:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149051520:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789762962.087202:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762962.087203:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762962.087235:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789762962.087241:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762962.087256:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149052160 00000100:00100000:1.0:1789762962.087263:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149052160 00000100:00100000:3.0:1789762962.087273:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149051776:0@lo:400:kworker.0 00000100:00100000:0.0:1789762962.087282:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149051904 00000100:00100000:0.0:1789762962.087287:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149051904 00000100:00100000:2.0:1789762962.087296:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149051520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762962.087305:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789762962.087306:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789762962.087314:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762962.087320:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876702149052160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762962.087345:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789762962.087358:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149051648 00000100:00100000:0.0:1789762962.087359:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149051904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762962.087363:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149051648 00000100:00100000:1.0:1789762962.087368:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149052160:12345-0@lo:400:kworker.0 Request processed in 52us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762962.087369:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149052032 00000100:00100000:1.0:1789762962.087376:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789762962.087376:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149052032 00000100:00100000:3.0:1789762962.087403:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149051776 00000100:00100000:3.0:1789762962.087408:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149051776 00000100:00100000:0.0:1789762962.087415:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149051904:12345-0@lo:400:kworker.0 Request processed in 61us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762962.087422:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149052160:0@lo:400:kworker.0 00000100:00100000:0.0:1789762962.087427:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789762962.087428:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789762962.087442:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149051648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762962.087457:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789762962.087468:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149052032:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762962.087475:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762962.087480:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762962.087487:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173cead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149051904:0@lo:400:kworker.0 00000100:00100000:2.0:1789762962.087493:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876702149051648:12345-0@lo:400:kworker.0 Request processed in 54us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762962.087501:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789762962.087512:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789762962.087520:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1876702149052032:12345-0@lo:400:kworker.0 Request processed in 54us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762962.087523:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149051776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762962.087527:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149051392 00000100:00100000:0.0:1789762962.087532:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149051392 00000100:00100000:3.0:1789762962.087539:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789762962.087569:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789762962.087571:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876702149051648:0@lo:400:kworker.0 00000100:00100000:1.0:1789762962.087577:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149051776:12345-0@lo:400:kworker.0 Request processed in 56us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762962.087582:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149051392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762962.087589:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789762962.087593:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149051776:0@lo:400:kworker.0 00000100:00100000:0.0:1789762962.087628:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3277:x1876702149051392:12345-0@lo:400:kworker.0 Request processed in 50us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762962.087632:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149051520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762962.087638:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789762962.087647:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173ce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1876702149052032:0@lo:400:kworker.0 00000100:00100000:0.0:1789762962.087674:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3277:1876702149051392:0@lo:400:kworker.0 00000100:00100000:3.0:1789762962.098864:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366571966397 time 366572018227 state 0x0 ref 1 00000100:00100000:3.0:1789762962.098880:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140881408:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762962.098910:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57173d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.098930:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.098934:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.098945:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57173d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.098957:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57173d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.101694:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57173d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.101707:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57173d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.101717:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57173d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.101725:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762962.101730:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57173d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.101741:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57173d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.101759:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57173d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.101769:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57173d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762962.101862:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140881408:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2954us (98430us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762962.101874:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 895 00000100:00100000:3.0:1789762962.101885:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366571966397 time 366572018227 state 0x2 ref 0 00000100:00100000:0.0:1789762962.103666:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762962.103738:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140881536 00000100:00100000:2.0:1789762962.103744:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140881536 00000100:00100000:2.0:1789762962.103775:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366571966397 time 366572018227 state 0x0 ref 1 00000100:00100000:2.0:1789762962.103785:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366672018227 time 366572018227 state 0x1 ref 1 00000100:00100000:0.0:1789762962.198985:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366672018227 time 366672132445 state 0x0 ref 1 00000100:00100000:0.0:1789762962.199007:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140881536:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762962.199043:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c571744 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.199058:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762962.199061:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762962.199066:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c571744 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.199077:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c571744 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.201577:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c571744 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.201589:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c571744 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.201595:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c571744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.201600:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762962.201604:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c571744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.201610:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c571744 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.201622:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c571744 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.201627:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ce4337c/0xd08452c77c571744 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762962.201683:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140881536:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2684us (98018us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762962.201690:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 896 00000100:00100000:3.0:1789762962.201699:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366672018227 time 366672132445 state 0x2 ref 0 00000100:00100000:1.0:1789762962.203462:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762962.203515:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140881664 00000100:00100000:2.0:1789762962.203523:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140881664 00000100:00100000:2.0:1789762962.203559:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366672018227 time 366672132445 state 0x0 ref 1 00000100:00100000:2.0:1789762962.203569:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366772132445 time 366672132445 state 0x1 ref 1 00000100:00100000:0.0:1789762962.292309:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762962.292343:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762962.292361:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140881920 00000100:00100000:0.0:1789762962.292368:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762962.292371:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140881920 00000100:00100000:1.0:1789762962.292389:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140881792 00000100:00100000:0.0:1789762962.292391:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762962.292398:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140881792 00000100:00100000:3.0:1789762962.292416:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140882176 00000100:00100000:3.0:1789762962.292423:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140882176 00000100:00100000:0.0:1789762962.292429:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762962.292445:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140882304 00000100:00100000:1.0:1789762962.292447:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 315 00000100:00100000:2.0:1789762962.292451:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140882304 00000100:00100000:1.0:1789762962.292460:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140881792:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:0.0:1789762962.292471:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762962.292471:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140882048 00000100:00100000:3.0:1789762962.292477:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140882048 00000100:00080000:0.0:1789762962.292479:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762962.292489:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 275 00000100:00100000:0.0:1789762962.292501:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:2.0:1789762962.292505:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+9:2343:x1876702140881920:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762962.292514:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:0.0:1789762962.292516:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140882176:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762962.292526:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+7:2342:x1876702140882048:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762962.292533:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2342:x1876702140881792:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 71us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762962.292544:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 315 00000100:00100000:2.0:1789762962.292556:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+9:2343:x1876702140881920:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 58us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762962.292562:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140882176:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 51us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762962.292568:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+7:2342:x1876702140882048:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 44us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762962.292576:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:2.0:1789762962.292589:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 275 00000100:00100000:3.0:1789762962.292590:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:2.0:1789762962.292621:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 276 00000100:00100000:2.0:1789762962.292634:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140882304:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762962.292671:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140882304:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 41us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762962.292677:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 276 00000100:00100000:0.0:1789762962.299041:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366772132445 time 366772196400 state 0x0 ref 1 00000100:00100000:0.0:1789762962.299054:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140881664:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762962.299081:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57174b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.299095:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762962.299098:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762962.299103:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57174b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.299114:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57174b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.301505:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57174b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.301514:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57174b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.301520:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57174b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.301526:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17a894600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762962.301529:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57174b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.301536:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57174b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.301549:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57174b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.301555:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063e66ef4/0xd08452c77c57174b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762962.301590:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140881664:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2538us (98129us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762962.301597:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 897 00000100:00100000:0.0:1789762962.301604:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366772132445 time 366772196400 state 0x2 ref 0 00000100:00100000:0.0:1789762962.303283:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762962.303314:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140882432 00000100:00100000:3.0:1789762962.303320:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140882432 00000100:00100000:3.0:1789762962.303350:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366772132445 time 366772196400 state 0x0 ref 1 00000100:00100000:3.0:1789762962.303359:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366872196400 time 366772196400 state 0x1 ref 1 00000100:00100000:3.0:1789762962.399127:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366872196400 time 366872272140 state 0x0 ref 1 00000100:00100000:3.0:1789762962.399153:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140882432:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762962.399218:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571752 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.399233:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.399237:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.399242:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571752 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.399253:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571752 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.401883:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571752 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.401893:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571752 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.401900:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.401904:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762962.401908:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.401914:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571752 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.401937:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571752 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.401942:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571752 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762962.401994:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140882432:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2850us (98710us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762962.402004:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 898 00000100:00100000:3.0:1789762962.402015:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366872196400 time 366872272140 state 0x2 ref 0 00000100:00100000:1.0:1789762962.403743:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762962.403776:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140882560 00000100:00100000:3.0:1789762962.403784:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140882560 00000100:00100000:3.0:1789762962.403815:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366872196400 time 366872272140 state 0x0 ref 1 00000100:00100000:3.0:1789762962.403826:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366972272140 time 366872272140 state 0x1 ref 1 00010000:00010000:0.0:1789762962.470990:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762962.499186:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366972272140 time 366972334065 state 0x0 ref 1 00000100:00100000:3.0:1789762962.499221:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140882560:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762962.499258:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571759 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.499273:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.499289:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.499294:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571759 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.499305:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571759 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.502062:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571759 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.502074:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571759 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.502082:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571759 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.502088:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762962.502092:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571759 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.502098:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571759 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.502113:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571759 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.502118:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571759 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762962.502185:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140882560:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2984us (98441us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762962.502193:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 899 00000100:00100000:3.0:1789762962.502201:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366972272140 time 366972334065 state 0x2 ref 0 00000100:00100000:1.0:1789762962.503913:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762962.503962:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140882688 00000100:00100000:0.0:1789762962.503971:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140882688 00000100:00100000:0.0:1789762962.504014:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 366972272140 time 366972334065 state 0x0 ref 1 00000100:00100000:0.0:1789762962.504029:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367072334065 time 366972334065 state 0x1 ref 1 00000100:00100000:1.0:1789762962.599015:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789762962.599041:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149052288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762962.599115:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762962.599160:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149052288 00000100:00100000:3.0:1789762962.599170:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149052288 00000100:00100000:2.0:1789762962.599242:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367072334065 time 367072395509 state 0x0 ref 1 00000100:00100000:2.0:1789762962.599258:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140882688:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762962.599292:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571760 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.599306:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762962.599310:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762962.599316:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571760 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762962.599319:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789762962.599334:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149052288:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762962.599335:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571760 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:3.0:1789762962.599362:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526581760 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789762962.599410:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149052288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762962.599415:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789762962.599467:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149052288:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762962.602143:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571760 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.602157:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571760 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.602181:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571760 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.602190:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762962.602195:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571760 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.602220:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571760 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.602238:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571760 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.602248:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571760 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762962.602301:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140882688:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3044us (98387us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762962.602312:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 900 00000100:00100000:2.0:1789762962.602323:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367072334065 time 367072395509 state 0x2 ref 0 00000100:00100000:1.0:1789762962.604048:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762962.604088:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140882816 00000100:00100000:3.0:1789762962.604094:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140882816 00000100:00100000:3.0:1789762962.604125:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367072334065 time 367072395509 state 0x0 ref 1 00000100:00100000:3.0:1789762962.604135:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367172395509 time 367072395509 state 0x1 ref 1 00000100:00100000:2.0:1789762962.699351:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367172395509 time 367172498300 state 0x0 ref 1 00000100:00100000:2.0:1789762962.699377:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140882816:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762962.699428:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571767 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.699443:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762962.699447:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762962.699451:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571767 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.699462:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571767 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.702298:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571767 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.702309:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571767 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.702317:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571767 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.702322:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030800 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762962.702326:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571767 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.702333:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571767 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.702358:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571767 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.702364:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a9b7c9/0xd08452c77c571767 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762962.702411:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140882816:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3046us (98363us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762962.702418:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 901 00000100:00100000:2.0:1789762962.702426:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367172395509 time 367172498300 state 0x2 ref 0 00000100:00100000:0.0:1789762962.704328:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762962.704369:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140882944 00000100:00100000:3.0:1789762962.704377:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140882944 00000100:00100000:3.0:1789762962.704412:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367172395509 time 367172498300 state 0x0 ref 1 00000100:00100000:3.0:1789762962.704423:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367272498300 time 367172498300 state 0x1 ref 1 00000100:00100000:3.0:1789762962.799413:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367272498300 time 367272558792 state 0x0 ref 1 00000100:00100000:3.0:1789762962.799442:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140882944:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762962.799480:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57176e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.799494:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.799498:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.799502:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57176e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.799513:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57176e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.802106:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57176e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.802116:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57176e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.802122:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57176e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.802126:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762962.802130:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57176e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.802149:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57176e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.802162:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57176e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.802167:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57176e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762962.802228:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140882944:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2796us (97900us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762962.802239:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 902 00000100:00100000:3.0:1789762962.802249:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367272498300 time 367272558792 state 0x2 ref 0 00000100:00100000:0.0:1789762962.803990:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762962.804034:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140883072 00000100:00100000:2.0:1789762962.804043:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140883072 00000100:00100000:2.0:1789762962.804081:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367272498300 time 367272558792 state 0x0 ref 1 00000100:00100000:2.0:1789762962.804092:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367372558792 time 367272558792 state 0x1 ref 1 00000100:00100000:0.0:1789762962.899501:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367372558792 time 367372647079 state 0x0 ref 1 00000100:00100000:0.0:1789762962.899525:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140883072:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762962.899560:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c571775 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.899575:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762962.899578:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762962.899583:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c571775 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.899594:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c571775 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.902297:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c571775 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.902308:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c571775 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.902315:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c571775 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.902321:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762962.902325:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c571775 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.902341:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c571775 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.902356:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c571775 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.902360:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025fd1532/0xd08452c77c571775 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762962.902411:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140883072:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2893us (98419us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762962.902420:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 903 00000100:00100000:3.0:1789762962.902431:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367372558792 time 367372647079 state 0x2 ref 0 00000100:00100000:1.0:1789762962.904120:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762962.904171:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140883200 00000100:00100000:2.0:1789762962.904179:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140883200 00000100:00100000:2.0:1789762962.904233:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367372558792 time 367372647079 state 0x0 ref 1 00000100:00100000:2.0:1789762962.904244:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367472647079 time 367372647079 state 0x1 ref 1 00000100:00100000:0.0:1789762962.999656:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367472647079 time 367472795742 state 0x0 ref 1 00000100:00100000:0.0:1789762962.999692:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140883200:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762962.999728:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c57177c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.999743:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762962.999747:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762962.999752:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c57177c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.999763:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c57177c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.002374:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c57177c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.002392:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c57177c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.002403:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c57177c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.002411:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762963.002418:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c57177c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.002429:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c57177c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.002447:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c57177c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.002457:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020991cca/0xd08452c77c57177c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762963.002524:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140883200:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2840us (98402us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762963.002537:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 904 00000100:00100000:0.0:1789762963.002549:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367472647079 time 367472795742 state 0x2 ref 0 00000100:00100000:2.0:1789762963.004304:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762963.004352:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140883328 00000100:00100000:3.0:1789762963.004360:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140883328 00000100:00080000:0.0:1789762963.004398:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762963.004410:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367472647079 time 367472795742 state 0x0 ref 1 00000100:00100000:3.0:1789762963.004422:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367572795742 time 367472795742 state 0x1 ref 1 00000100:00100000:3.0:1789762963.099744:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367572795742 time 367572886495 state 0x0 ref 1 00000100:00100000:3.0:1789762963.099775:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140883328:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762963.099819:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571783 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.099875:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.099880:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.099887:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571783 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.099904:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571783 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.102744:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571783 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.102762:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571783 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.102769:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.102777:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762963.102782:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.102792:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571783 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.102814:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571783 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.102851:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571783 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762963.102902:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140883328:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3140us (98597us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762963.102909:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 905 00000100:00100000:3.0:1789762963.102918:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367572795742 time 367572886495 state 0x2 ref 0 00000100:00100000:2.0:1789762963.104904:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762963.104941:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140883456 00000100:00100000:3.0:1789762963.104950:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140883456 00000100:00100000:3.0:1789762963.104990:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367572795742 time 367572886495 state 0x0 ref 1 00000100:00100000:3.0:1789762963.105001:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367672886495 time 367572886495 state 0x1 ref 1 00000100:00100000:3.0:1789762963.199828:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367672886495 time 367672969782 state 0x0 ref 1 00000100:00100000:3.0:1789762963.199895:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140883456:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762963.199937:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57178a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.199955:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.199960:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.199966:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57178a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.199999:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57178a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.202909:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57178a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.202921:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57178a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.202928:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57178a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.202932:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762963.202936:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57178a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.202942:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57178a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.202954:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57178a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.202959:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57178a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762963.203016:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140883456:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3133us (98113us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762963.203023:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 906 00000100:00100000:3.0:1789762963.203032:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367672886495 time 367672969782 state 0x2 ref 0 00000100:00100000:1.0:1789762963.204884:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762963.204944:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140883584 00000100:00100000:0.0:1789762963.204953:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140883584 00000100:00100000:0.0:1789762963.204999:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367672886495 time 367672969782 state 0x0 ref 1 00000100:00100000:0.0:1789762963.205015:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367772969782 time 367672969782 state 0x1 ref 1 00000100:00100000:2.0:1789762963.299929:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367772969782 time 367773076077 state 0x0 ref 1 00000100:00100000:2.0:1789762963.299971:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140883584:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762963.300015:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571791 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.300033:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762963.300037:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762963.300044:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571791 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.300057:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571791 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.302748:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571791 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.302759:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571791 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.302767:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571791 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.302772:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17464ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762963.302776:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571791 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.302792:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571791 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.302807:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571791 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.302812:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571791 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762963.302891:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140883584:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2936us (98007us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762963.302899:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 907 00000100:00100000:2.0:1789762963.302907:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367772969782 time 367773076077 state 0x2 ref 0 00000100:00100000:1.0:1789762963.305139:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762963.305181:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140883712 00000100:00100000:3.0:1789762963.305190:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140883712 00000100:00100000:3.0:1789762963.305254:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367772969782 time 367773076077 state 0x0 ref 1 00000100:00100000:3.0:1789762963.305266:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367873076077 time 367773076077 state 0x1 ref 1 00000100:00100000:2.0:1789762963.400017:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367873076077 time 367873165089 state 0x0 ref 1 00000100:00100000:2.0:1789762963.400044:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140883712:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762963.400082:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571798 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.400097:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762963.400100:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762963.400105:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571798 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.400133:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571798 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.403261:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571798 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.403277:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571798 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.403288:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.403298:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d17464ae00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762963.403303:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.403313:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571798 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.403328:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571798 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.403333:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc419473/0xd08452c77c571798 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762963.403392:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140883712:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3359us (98255us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762963.403400:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 908 00000100:00100000:2.0:1789762963.403408:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367873076077 time 367873165089 state 0x2 ref 0 00000100:00100000:0.0:1789762963.405460:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762963.405503:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140883840 00000100:00100000:3.0:1789762963.405510:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140883840 00000100:00100000:3.0:1789762963.405544:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367873076077 time 367873165089 state 0x0 ref 1 00000100:00100000:3.0:1789762963.405554:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367973165089 time 367873165089 state 0x1 ref 1 00010000:00010000:2.0:1789762963.494984:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762963.500063:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367973165089 time 367973215974 state 0x0 ref 1 00000100:00100000:3.0:1789762963.500086:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140883840:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762963.500122:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57179f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.500145:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.500159:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.500165:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57179f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.500175:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57179f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.503092:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57179f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.503104:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57179f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.503117:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57179f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.503124:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762963.503128:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57179f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.503135:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57179f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.503148:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57179f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.503153:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c57179f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762963.503224:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140883840:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3145us (97763us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762963.503231:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 909 00000100:00100000:3.0:1789762963.503239:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367973165089 time 367973215974 state 0x2 ref 0 00000100:00100000:0.0:1789762963.505042:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762963.505082:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140883968 00000100:00100000:2.0:1789762963.505089:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140883968 00000100:00100000:2.0:1789762963.505124:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 367973165089 time 367973215974 state 0x0 ref 1 00000100:00100000:2.0:1789762963.505134:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368073215974 time 367973215974 state 0x1 ref 1 00000100:00100000:0.0:1789762963.600226:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368073215974 time 368073358327 state 0x0 ref 1 00000100:00100000:0.0:1789762963.600260:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140883968:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762963.600299:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717a6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.600314:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762963.600317:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762963.600322:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.600334:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.603071:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.603080:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.603086:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.603091:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762963.603094:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.603104:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.603118:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.603126:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762963.603193:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140883968:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2946us (98151us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762963.603214:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 910 00000100:00100000:0.0:1789762963.603224:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368073215974 time 368073358327 state 0x2 ref 0 00000100:00100000:0.0:1789762963.604950:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762963.604989:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140884096 00000100:00100000:2.0:1789762963.604997:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140884096 00000100:00100000:2.0:1789762963.605032:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368073215974 time 368073358327 state 0x0 ref 1 00000100:00100000:2.0:1789762963.605042:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368173358327 time 368073358327 state 0x1 ref 1 00000100:00100000:0.0:1789762963.700345:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368173358327 time 368173490921 state 0x0 ref 1 00000100:00100000:0.0:1789762963.700371:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140884096:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762963.700407:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717ad lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.700422:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762963.700425:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762963.700430:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.700442:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.703123:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.703135:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.703143:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.703160:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762963.703164:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.703171:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.703185:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.703191:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c47d9b/0xd08452c77c5717ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762963.703265:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2342:x1876702140884096:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2904us (98313us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762963.703276:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 911 00000100:00100000:2.0:1789762963.703286:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368173358327 time 368173490921 state 0x2 ref 0 00000100:00100000:2.0:1789762963.705175:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762963.705216:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140884224 00000100:00100000:3.0:1789762963.705223:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140884224 00000100:00100000:3.0:1789762963.705258:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368173358327 time 368173490921 state 0x0 ref 1 00000100:00100000:3.0:1789762963.705269:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368273490921 time 368173490921 state 0x1 ref 1 00000100:00100000:3.0:1789762963.800409:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368273490921 time 368273556496 state 0x0 ref 1 00000100:00100000:3.0:1789762963.800433:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17412ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140884224:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762963.800470:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717b4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.800484:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.800488:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.800493:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.800503:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.803137:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.803146:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.803153:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.803158:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762963.803161:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.803167:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.803179:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.803184:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762963.803242:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17412ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140884224:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2818us (98067us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762963.803249:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 912 00000100:00100000:3.0:1789762963.803263:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368273490921 time 368273556496 state 0x2 ref 0 00000100:00100000:2.0:1789762963.805158:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762963.805242:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140884352 00000100:00100000:0.0:1789762963.805251:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140884352 00000100:00100000:0.0:1789762963.805294:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368273490921 time 368273556496 state 0x0 ref 1 00000100:00100000:0.0:1789762963.805306:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368373556496 time 368273556496 state 0x1 ref 1 00000100:00100000:3.0:1789762963.900511:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368373556496 time 368373648011 state 0x0 ref 1 00000100:00100000:3.0:1789762963.900540:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140884352:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762963.900585:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717bb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.900603:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.900616:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.900623:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.900638:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.903429:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.903441:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.903452:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.903460:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762963.903472:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.903484:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.903502:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.903511:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762963.903569:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140884352:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3039us (98410us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762963.903579:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 913 00000100:00100000:3.0:1789762963.903589:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368373556496 time 368373648011 state 0x2 ref 0 00000100:00100000:0.0:1789762963.905285:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762963.905327:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140884480 00000100:00100000:2.0:1789762963.905335:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140884480 00000100:00100000:2.0:1789762963.905371:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368373556496 time 368373648011 state 0x0 ref 1 00000100:00100000:2.0:1789762963.905382:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368473648011 time 368373648011 state 0x1 ref 1 00000100:00100000:2.0:1789762964.000553:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368473648011 time 368473700352 state 0x0 ref 1 00000100:00100000:2.0:1789762964.000576:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140884480:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762964.000613:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c5717c2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.000630:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.000635:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.000643:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c5717c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.000659:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c5717c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.003597:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c5717c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.003608:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c5717c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.003615:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c5717c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.003620:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174638c00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762964.003623:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c5717c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.003629:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c5717c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.003648:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c5717c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.003660:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026a2ad83/0xd08452c77c5717c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762964.003710:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2343:x1876702140884480:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3141us (98425us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762964.003718:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 914 00000100:00100000:0.0:1789762964.003726:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368473648011 time 368473700352 state 0x2 ref 0 00000100:00100000:2.0:1789762964.005476:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762964.005516:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140884608 00000100:00100000:3.0:1789762964.005525:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140884608 00000100:00100000:3.0:1789762964.005560:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368473648011 time 368473700352 state 0x0 ref 1 00000100:00100000:3.0:1789762964.005571:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368573700352 time 368473700352 state 0x1 ref 1 00000100:00100000:2.0:1789762964.100663:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368573700352 time 368573796117 state 0x0 ref 1 00000100:00100000:2.0:1789762964.100694:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140884608:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762964.100736:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c5717c9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.100753:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.100758:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.100764:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c5717c9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.100791:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c5717c9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.103941:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c5717c9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.103958:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c5717c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.103966:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c5717c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.103972:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d174639a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762964.103976:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c5717c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.103982:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c5717c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.103998:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c5717c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.104004:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8214d5/0xd08452c77c5717c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762964.104056:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140884608:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3373us (98579us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762964.104064:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 915 00000100:00100000:0.0:1789762964.104073:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368573700352 time 368573796117 state 0x2 ref 0 00000100:00100000:1.0:1789762964.106047:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762964.106080:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140884736 00000100:00100000:3.0:1789762964.106088:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140884736 00000100:00100000:3.0:1789762964.106130:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368573700352 time 368573796117 state 0x0 ref 1 00000100:00100000:3.0:1789762964.106162:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368673796117 time 368573796117 state 0x1 ref 1 00000100:00100000:3.0:1789762964.200747:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368673796117 time 368673890657 state 0x0 ref 1 00000100:00100000:3.0:1789762964.200774:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140884736:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762964.200814:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717d0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.200855:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762964.200859:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762964.200864:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.200876:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.203667:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.203683:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.203693:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.203713:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762964.203719:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.203729:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.203749:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.203756:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762964.203805:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140884736:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3040us (97758us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762964.203812:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 916 00000100:00100000:3.0:1789762964.203819:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368673796117 time 368673890657 state 0x2 ref 0 00000100:00100000:1.0:1789762964.205877:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762964.205922:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140884864 00000100:00100000:0.0:1789762964.205930:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140884864 00000100:00100000:0.0:1789762964.205965:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368673796117 time 368673890657 state 0x0 ref 1 00000100:00100000:0.0:1789762964.205976:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368773890657 time 368673890657 state 0x1 ref 1 00000100:00100000:0.0:1789762964.300794:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368773890657 time 368773942417 state 0x0 ref 1 00000100:00100000:0.0:1789762964.300823:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140884864:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762964.300896:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717d7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.300916:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762964.300921:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762964.300928:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717d7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.300943:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717d7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.303795:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717d7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.303806:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.303813:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.303819:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cefe00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762964.303823:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.303829:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.303864:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.303870:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762964.303919:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140884864:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3109us (98042us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762964.303928:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 917 00000100:00100000:0.0:1789762964.303936:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368773890657 time 368773942417 state 0x2 ref 0 00000100:00100000:2.0:1789762964.305646:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762964.305728:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140884992 00000100:00100000:0.0:1789762964.305737:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140884992 00000100:00100000:0.0:1789762964.305779:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368773890657 time 368773942417 state 0x0 ref 1 00000100:00100000:0.0:1789762964.305790:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368873942417 time 368773942417 state 0x1 ref 1 00000100:00100000:2.0:1789762964.400889:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368873942417 time 368874036139 state 0x0 ref 1 00000100:00100000:2.0:1789762964.400913:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140884992:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762964.400951:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab6aef67/0xd08452c77c5717de lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.400966:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.400970:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.400975:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab6aef67/0xd08452c77c5717de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.400986:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab6aef67/0xd08452c77c5717de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.404052:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab6aef67/0xd08452c77c5717de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.404063:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab6aef67/0xd08452c77c5717de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.404071:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab6aef67/0xd08452c77c5717de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.404089:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e58600 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762964.404093:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab6aef67/0xd08452c77c5717de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.404099:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab6aef67/0xd08452c77c5717de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.404112:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab6aef67/0xd08452c77c5717de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.404117:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab6aef67/0xd08452c77c5717de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762964.404169:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140884992:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3264us (98523us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762964.404176:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 918 00000100:00100000:2.0:1789762964.404183:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368873942417 time 368874036139 state 0x2 ref 0 00000100:00100000:2.0:1789762964.406022:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762964.406070:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140885120 00000100:00100000:3.0:1789762964.406079:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140885120 00000100:00100000:3.0:1789762964.406119:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368873942417 time 368874036139 state 0x0 ref 1 00000100:00100000:3.0:1789762964.406134:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368974036139 time 368874036139 state 0x1 ref 1 00000100:00100000:3.0:1789762964.500984:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368974036139 time 368974112119 state 0x0 ref 1 00000100:00100000:3.0:1789762964.501022:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140885120:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762964.501066:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717e5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.501085:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762964.501089:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762964.501096:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717e5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.501111:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717e5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.504072:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717e5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.504095:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.504106:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.504115:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762964.504121:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.504147:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.504167:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.504176:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762964.504248:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140885120:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3234us (98224us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762964.504256:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 919 00000100:00100000:3.0:1789762964.504265:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368974036139 time 368974112119 state 0x2 ref 0 00000100:00100000:2.0:1789762964.506206:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762964.506258:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140885248 00000100:00100000:0.0:1789762964.506272:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140885248 00000100:00100000:0.0:1789762964.506318:0:11722:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 368974036139 time 368974112119 state 0x0 ref 1 00000100:00100000:0.0:1789762964.506330:0:11722:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369074112119 time 368974112119 state 0x1 ref 1 00010000:00010000:3.0:1789762964.518990:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762964.601066:0:11723:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369074112119 time 369074213711 state 0x0 ref 1 00000100:00100000:3.0:1789762964.601092:0:11723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140885248:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762964.601128:0:11723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717ec lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.601143:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762964.601146:0:11723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762964.601151:0:11723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717ec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.601177:0:11723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717ec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.603783:0:11723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717ec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.603799:0:11723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.603811:0:11723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.603819:0:11723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762964.603822:0:11723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.603829:0:11723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.603859:0:11723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.603865:0:11723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c5717ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762964.603924:0:11723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140885248:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2841us (97730us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762964.603931:0:11723:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 920 00000100:00100000:3.0:1789762964.603939:0:11723:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369074112119 time 369074213711 state 0x2 ref 0 00000100:00100000:1.0:1789762964.606000:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762964.606043:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140885376 00000100:00100000:2.0:1789762964.606051:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140885376 00000100:00100000:2.0:1789762964.606088:0:6659:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369074112119 time 369074213711 state 0x0 ref 1 00000100:00100000:2.0:1789762964.606099:0:6659:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369174213711 time 369074213711 state 0x1 ref 1 00000100:00100000:0.0:1789762964.701164:0:6661:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369174213711 time 369174309356 state 0x0 ref 1 00000100:00100000:0.0:1789762964.701207:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140885376:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:0.0:1789762964.701244:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717f3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.701259:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762964.701263:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762964.701268:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.701279:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.703994:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.704004:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.704011:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.704016:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cefe00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:0.0:1789762964.704020:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.704026:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.704040:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.704045:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aea755ca/0xd08452c77c5717f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762964.704092:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140885376:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2914us (98092us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762964.704099:0:6661:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 921 00000100:00100000:0.0:1789762964.704107:0:6661:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369174213711 time 369174309356 state 0x2 ref 0 00000100:00100000:0.0:1789762964.705891:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762964.705928:0:13229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140885504 00000100:00100000:3.0:1789762964.705939:0:13229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140885504 00000100:00100000:3.0:1789762964.705973:0:13229:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369174213711 time 369174309356 state 0x0 ref 1 00000100:00100000:3.0:1789762964.705984:0:13229:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369274309356 time 369174309356 state 0x1 ref 1 00000100:00100000:2.0:1789762964.801280:0:6660:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369274309356 time 369274426037 state 0x0 ref 1 00000100:00100000:2.0:1789762964.801305:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140885504:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762964.801341:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c5717fa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.801355:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.801358:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.801363:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c5717fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.801374:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c5717fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.803853:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c5717fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.803864:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c5717fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.803871:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c5717fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.803876:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d140030a00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762964.803879:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c5717fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.803897:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c5717fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.803910:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c5717fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.803915:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029b09d4c/0xd08452c77c5717fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762964.803959:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140885504:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2665us (98069us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762964.803966:0:6660:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 922 00000100:00100000:2.0:1789762964.803974:0:6660:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369274309356 time 369274426037 state 0x2 ref 0 00000100:00100000:2.0:1789762964.805883:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762964.805927:0:11723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140885632 00000100:00100000:3.0:1789762964.805937:0:11723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140885632 00000100:00100000:3.0:1789762964.805978:0:11723:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369274309356 time 369274426037 state 0x0 ref 1 00000100:00100000:3.0:1789762964.805989:0:11723:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369374426037 time 369274426037 state 0x1 ref 1 00000100:00100000:3.0:1789762964.901383:0:14626:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369374426037 time 369374528782 state 0x0 ref 1 00000100:00100000:3.0:1789762964.901412:0:14626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140885632:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762964.901458:0:14626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571801 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.901476:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762964.901497:0:14626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762964.901504:0:14626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571801 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.901519:0:14626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571801 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.904631:0:14626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571801 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.904642:0:14626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571801 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.904649:0:14626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571801 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.904654:0:14626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762964.904658:0:14626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571801 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.904664:0:14626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571801 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.904679:0:14626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571801 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.904685:0:14626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571801 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762964.904738:0:14626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140885632:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3339us (98855us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762964.904745:0:14626:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 923 00000100:00100000:3.0:1789762964.904754:0:14626:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369374426037 time 369374528782 state 0x2 ref 0 00000100:00100000:1.0:1789762964.906600:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762964.906642:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140885760 00000100:00100000:0.0:1789762964.906650:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140885760 00000100:00100000:0.0:1789762964.906688:0:6661:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369374426037 time 369374528782 state 0x0 ref 1 00000100:00100000:0.0:1789762964.906701:0:6661:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369474528782 time 369374528782 state 0x1 ref 1 00000100:00100000:0.0:1789762965.001454:0:11722:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369474528782 time 369474600006 state 0x0 ref 1 00000100:00100000:0.0:1789762965.001496:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140885760:12345-192.168.203.31@tcp:3:dd.500 00000100:00080000:1.0:1789762965.001529:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762965.001534:0:11722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571808 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.001550:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762965.001554:0:11722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762965.001558:0:11722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571808 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.001569:0:11722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571808 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.004247:0:11722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571808 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.004264:0:11722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571808 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.004275:0:11722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571808 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.004280:0:11722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d144cf7400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762965.004284:0:11722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571808 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.004291:0:11722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571808 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.004305:0:11722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571808 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.004311:0:11722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ab23382/0xd08452c77c571808 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762965.004370:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140885760:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2900us (97770us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762965.004377:0:11722:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 924 00000100:00100000:3.0:1789762965.004386:0:11722:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369474528782 time 369474600006 state 0x2 ref 0 00000100:00100000:1.0:1789762965.006249:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762965.006294:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140885888 00000100:00100000:2.0:1789762965.006302:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140885888 00000100:00100000:2.0:1789762965.006337:0:6660:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369474528782 time 369474600006 state 0x0 ref 1 00000100:00100000:2.0:1789762965.006348:0:6660:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369574600006 time 369474600006 state 0x1 ref 1 00000100:00100000:2.0:1789762965.101519:0:6659:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369574600006 time 369574667219 state 0x0 ref 1 00000100:00100000:2.0:1789762965.101544:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140885888:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:2.0:1789762965.101591:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57180f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.101605:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762965.101608:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762965.101613:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57180f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.101624:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57180f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.104431:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57180f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.104441:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57180f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.104447:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57180f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.104452:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:2.0:1789762965.104456:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57180f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.104463:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57180f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.104486:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57180f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.104493:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57180f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762965.104536:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77777931-b235-4c03-82d2-4b1d12553008+6:2345:x1876702140885888:12345-192.168.203.31@tcp:3:dd.500 Request processed in 3002us (98287us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762965.104544:0:6659:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 925 00000100:00100000:2.0:1789762965.104552:0:6659:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369574600006 time 369574667219 state 0x2 ref 0 00000100:00100000:2.0:1789762965.106321:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762965.106353:0:14626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140886016 00000100:00100000:3.0:1789762965.106361:0:14626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140886016 00000100:00100000:3.0:1789762965.106396:0:14626:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369574600006 time 369574667219 state 0x0 ref 1 00000100:00100000:3.0:1789762965.106407:0:14626:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369674667219 time 369574667219 state 0x1 ref 1 00000100:00100000:3.0:1789762965.201600:0:13229:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369674667219 time 369674747008 state 0x0 ref 1 00000100:00100000:3.0:1789762965.201640:0:13229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140886016:12345-192.168.203.31@tcp:3:dd.500 00010000:00010000:3.0:1789762965.201683:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571816 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.201697:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762965.201701:0:13229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762965.201706:0:13229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571816 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.201717:0:13229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571816 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.204283:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571816 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.204292:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571816 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.204298:0:13229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571816 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.204303:0:13229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d160193400 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762965.204307:0:13229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571816 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.204313:0:13229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571816 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.204326:0:13229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571816 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.204331:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15109aa/0xd08452c77c571816 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762965.204378:0:13229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:77777931-b235-4c03-82d2-4b1d12553008+6:2344:x1876702140886016:12345-192.168.203.31@tcp:3:dd.500 Request processed in 2754us (98056us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762965.204385:0:13229:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.31@tcp, seq: 926 00000100:00100000:3.0:1789762965.204399:0:13229:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff95d173f65000 key jobid={dd.500}&nid={192.168.203.31@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff95d1742b9600 gen 0 rate 10 depth 3 token 0 deadline 369674667219 time 369674747008 state 0x2 ref 0 00000100:00100000:0.0:1789762965.228038:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762965.228086:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140886144 00000100:00100000:3.0:1789762965.228096:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140886144 00000100:00100000:3.0:1789762965.228148:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:3.0:1789762965.228156:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+6:5572:x1876702140886144:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762965.228169:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762965.228214:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004544e12e/0xd08452c77c57155a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebee expref: 6 pid: 8803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.228235:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762965.228277:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77777931-b235-4c03-82d2-4b1d12553008+5:5572:x1876702140886144:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 122us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762965.228282:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:1.0:1789762965.236304:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762965.236345:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140886272 00000100:00100000:3.0:1789762965.236351:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140886272 00000100:00080000:1.0:1789762965.236390:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762965.236395:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 304 00000100:00100000:3.0:1789762965.236403:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+9:11955:x1876702140886272:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1789762965.236416:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762965.236429:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192a00/0xd08452c77c57181d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ebf5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.236477:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160193400/0xd08452c77c571824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.236488:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d160193400/0xd08452c77c571824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.236510:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d160193400/0xd08452c77c571824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762965.236537:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:3.0:1789762965.236540:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762965.236552:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d160193400/0xd08452c77c571824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.236570:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192a00/0xd08452c77c57181d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebf5 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.236581:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160193400/0xd08452c77c571824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebf5 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.236587:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff95d151e90800) 00010000:00010000:3.0:1789762965.236589:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762965.236591:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d160193400, rc 0) 00000100:00100000:3.0:1789762965.236620:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77777931-b235-4c03-82d2-4b1d12553008+10:11955:x1876702140886272:12345-192.168.203.31@tcp:101:bash.0 Request processed in 219us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762965.236625:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 304 00000100:00100000:2.0:1789762965.239742:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762965.239788:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140886528 00000100:00100000:3.0:1789762965.239794:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140886528 00000100:00100000:3.0:1789762965.239826:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 305 00000100:00100000:3.0:1789762965.239851:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+10:14083:x1876702140886528:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1789762965.239861:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762965.239871:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192e00/0xd08452c77c57182b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ebfc expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762965.239927:0:6681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00010000:00010000:3.0:1789762965.240045:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192e00/0xd08452c77c57182b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebfc expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.240054:0:6681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04100) 00010000:00010000:3.0:1789762965.240056:0:6681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762965.240058:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192e00/0xd08452c77c57182b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebfc expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.240066:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d160192e00, rc 0) 00000100:00100000:3.0:1789762965.240094:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+11:14083:x1876702140886528:12345-192.168.203.31@tcp:101:rm.0 Request processed in 263us (356us total) trans 4294967561 rc 301/301 00000100:00100000:3.0:1789762965.240099:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 305 00000100:00100000:0.0:1789762965.241538:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762965.241597:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140886656 00000100:00100000:2.0:1789762965.241603:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140886656 00000100:00100000:2.0:1789762965.241640:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:2.0:1789762965.241647:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+11:14083:x1876702140886656:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:2.0:1789762965.243598:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+11:14083:x1876702140886656:12345-192.168.203.31@tcp:37:rm.0 Request processed in 1950us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762965.243609:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:0.0:1789762965.244922:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762965.244957:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140886912 00000100:00100000:3.0:1789762965.244961:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140886912 00000100:00100000:3.0:1789762965.244987:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:3.0:1789762965.244992:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+11:14083:x1876702140886912:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:3.0:1789762965.245102:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+12:14083:x1876702140886912:12345-192.168.203.31@tcp:35:rm.0 Request processed in 109us (180us total) trans 4294967562 rc 0/0 00000100:00100000:3.0:1789762965.245108:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:0.0:1789762965.245946:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762965.245985:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140887168 00000100:00100000:2.0:1789762965.245989:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140887168 00000100:00100000:2.0:1789762965.246015:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 306 00000100:00100000:2.0:1789762965.246021:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+12:14083:x1876702140887168:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789762965.246038:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762965.246047:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c571839 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe076ac6206c7ec03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.246086:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c571840 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.246096:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c571840 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.246104:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c571840 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762965.246110:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00010000:00010000:2.0:1789762965.246155:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51e00/0xd08452c77c571839 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ec03 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.246167:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c571840 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ec03 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.246173:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff95d151e90800) 00010000:00010000:2.0:1789762965.246175:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789762965.246177:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d148e50800, rc 0) 00000100:00100000:2.0:1789762965.246231:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+14:14083:x1876702140887168:12345-192.168.203.31@tcp:101:rm.0 Request processed in 209us (287us total) trans 4294967563 rc 0/0 00000100:00100000:2.0:1789762965.246239:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 306 00000100:00100000:1.0:1789762965.247110:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762965.247148:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140887296 00000100:00100000:2.0:1789762965.247153:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140887296 00000100:00100000:2.0:1789762965.247178:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 307 00000100:00100000:2.0:1789762965.247205:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+14:14083:x1876702140887296:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:2.0:1789762965.247245:0:13232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7614758912 avail 7603224576 00000100:00100000:2.0:1789762965.247275:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+14:14083:x1876702140887296:12345-192.168.203.31@tcp:41:rm.0 Request processed in 74us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762965.247280:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 307 00000100:00100000:0.0:1789762965.248064:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762965.248094:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140887552 00000100:00100000:2.0:1789762965.248099:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140887552 00000100:00100000:2.0:1789762965.248124:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:2.0:1789762965.248129:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+14:14083:x1876702140887552:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:2.0:1789762965.248314:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77777931-b235-4c03-82d2-4b1d12553008+15:14083:x1876702140887552:12345-192.168.203.31@tcp:35:rm.0 Request processed in 184us (251us total) trans 4294967564 rc 0/0 00000100:00100000:2.0:1789762965.248320:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:0.0:1789762965.249075:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762965.249118:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140887808 00000100:00100000:2.0:1789762965.249124:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140887808 00000100:00100000:2.0:1789762965.249166:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 308 00000100:00100000:2.0:1789762965.249174:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+15:14083:x1876702140887808:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762965.249215:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762965.249232:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6600/0xd08452c77c57154c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebe7 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.249258:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d160192200/0xd08452c77c57125f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebe0 expref: 14 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.249268:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff95d15055d000) 00010000:00010000:2.0:1789762965.249282:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d160193400/0xd08452c77c571824 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebf5 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.249305:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff95d151e90800) 00010000:00010000:2.0:1789762965.249308:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762965.249321:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c57184e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.249331:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c57184e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.249339:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c57184e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.249353:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c571855 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.249362:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c571855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.249370:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c571855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.249654:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c57185c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.249664:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c57185c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.249672:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c57185c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762965.250549:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].20, 64 off9472 00000004:00080000:2.0:1789762965.250558:0:7603:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369723723605ns, next at 370723722205ns, rc = 0 00010000:00010000:2.0:1789762965.250595:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c571863 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250602:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c571863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250608:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c571863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250613:0:7603:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c571863 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250618:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c571863 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250622:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c571863 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250636:0:7603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762965.250645:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c57185c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250649:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c57185c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250653:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c57185c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250659:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50200 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762965.250662:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c57185c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.250667:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762965.250668:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c57185c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250680:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:2.0:1789762965.250684:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762965.250685:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c571863 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250687:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c57185c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250703:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50200/0xd08452c77c57185c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.250705:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51200 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:1.0:1789762965.250712:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c571863 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250717:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c57184e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.250720:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c571863 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250730:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c57184e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.250738:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff95d142a04a00) 00010000:00010000:2.0:1789762965.250739:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c57184e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.250745:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762965.250750:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51a00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762965.250752:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c57184e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250757:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c57184e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.250760:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c571863 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250763:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff95d151e90800) 00010000:00010000:2.0:1789762965.250769:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762965.250770:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51200/0xd08452c77c571863 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250772:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c57184e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.250782:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51a00/0xd08452c77c57184e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.250789:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762965.250792:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762965.250795:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1789762965.250803:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037eda02c reply state 00000000fbe2bbee transno 4294967565 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c571855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762965.250811:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762965.250859:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77777931-b235-4c03-82d2-4b1d12553008+14:14083:x1876702140887808:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1686us (1784us total) trans 4294967565 rc 0/0 00000100:00100000:2.0:1789762965.250866:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 308 00010000:00010000:3.0:1789762965.251401:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c571855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.251410:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c571855 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.251424:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c571855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.251428:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762965.251431:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c571855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.251435:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c571855 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.251443:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x4009f790 (ffff95d142a04000) 00010000:00010000:3.0:1789762965.251445:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762965.251447:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c571855 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.251451:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e51400/0xd08452c77c571855 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762965.251879:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762965.251901:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140888064 00000100:00100000:3.0:1789762965.251906:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140888064 00000100:00100000:3.0:1789762965.251962:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:3.0:1789762965.251968:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15177ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+13:14083:x1876702140888064:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:3.0:1789762965.252053:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15177ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77777931-b235-4c03-82d2-4b1d12553008+14:14083:x1876702140888064:12345-192.168.203.31@tcp:35:rm.0 Request processed in 84us (174us total) trans 4294967566 rc 0/0 00000100:00100000:3.0:1789762965.252063:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:1.0:1789762965.252756:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762965.252799:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140888320 00000100:00100000:2.0:1789762965.252805:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140888320 00000100:00100000:2.0:1789762965.252852:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 309 00000100:00100000:2.0:1789762965.252864:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+14:14083:x1876702140888320:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789762965.252891:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762965.252903:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50800/0xd08452c77c571840 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ec03 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.252920:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148c98000/0xd08452c77c571243 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebd9 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.252931:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff95d151e90800) 00010000:00010000:2.0:1789762965.252943:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d144cf6000/0xd08452c77c5711e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xe076ac6206c7ebc4 expref: 12 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.252954:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04100) 00010000:00010000:2.0:1789762965.252960:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762965.252972:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c57186a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.252987:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c57186a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.252993:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c57186a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253001:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c571871 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253006:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c571871 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253010:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c571871 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253183:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c571878 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253204:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c571878 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253209:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c571878 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762965.253605:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00010000:00010000:2.0:1789762965.253613:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c571878 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253620:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c571878 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253627:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c571878 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253640:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50c00 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762965.253644:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c571878 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253660:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c571878 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253671:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff95d142a04600) 00010000:00010000:2.0:1789762965.253674:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762965.253677:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c571878 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253681:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50c00/0xd08452c77c571878 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253694:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c57186a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253699:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c57186a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253703:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c57186a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253706:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50400 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:2.0:1789762965.253708:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c57186a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253712:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c57186a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253725:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d142a04b00) 00010000:00010000:2.0:1789762965.253726:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762965.253729:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c57186a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.253733:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50400/0xd08452c77c57186a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762965.253747:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0d00204 reply state 0000000091241558 transno 4294967567 ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c571871 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762965.253751:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762965.253796:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+13:14083:x1876702140888320:12345-192.168.203.31@tcp:36:rm.0 Request processed in 936us (1040us total) trans 4294967567 rc 0/0 00000100:00100000:2.0:1789762965.253802:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 309 00010000:00010000:3.0:1789762965.254339:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c571871 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.254348:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c571871 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.254359:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c571871 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.254363:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e50000 already unused, calling callback (ffffffffc1eb94f0) 00010000:00010000:3.0:1789762965.254366:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c571871 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.254370:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c571871 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.254378:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff95d142a04d00) 00010000:00010000:3.0:1789762965.254380:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762965.254382:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c571871 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.254386:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d148e50000/0xd08452c77c571871 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.542929:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789762966.056974:0:15491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370530138345ns, next at 370723722205ns, rc = 0 00000004:00080000:1.0:1789762966.064902:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 26 committed 00000001:00080000:1.0:1789762966.064922:0:5834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967567 is committed 00000004:00080000:1.0:1789762966.064929:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 25 committed 00000100:00100000:1.0:1789762966.065010:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149052416:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762966.065068:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762966.065099:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149052416 00000100:00100000:2.0:1789762966.065109:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149052416 00000100:00080000:1.0:1789762966.065135:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762966.065169:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789762966.065311:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149052416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789762966.065336:0:8803:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:20 count 1 00002000:00010000:2.0:1789762966.065361:0:8803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 104857600, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x3200b 00010000:00010000:2.0:1789762966.065368:0:8803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57187f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.065382:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1789762966.065386:0:8803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762966.065391:0:8803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57187f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.065413:0:8803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57187f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.065420:0:8803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57187f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.065426:0:8803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57187f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.065441:0:8803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762966.065460:0:6670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762966.065468:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57187f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.065477:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d148e51e00 already unused, calling callback (ffffffffc14a9350) 00010000:00010000:3.0:1789762966.065481:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57187f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.065489:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57187f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.065513:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57187f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.065520:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848280e5/0xd08452c77c57187f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.065533:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762966.065534:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762966.065535:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762966.065866:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149052416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 688us (795us total) trans 4294968031 rc 0/0 00000100:00100000:2.0:1789762966.065873:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000004:00080000:1.0:1789762966.065986:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d1488dfb80/2, rc 0, transno 4294968031 00000100:00100000:1.0:1789762966.065999:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149052416:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789762966.066106:0:15491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370539271236ns, next at 352200132910ns, rc = 0 00000004:00080000:3.0:1789762966.066882:0:5834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 20 committed 00010000:00010000:3.0:1789762966.566970:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762967.206970:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d15225a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149052672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762967.206984:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149052544:0@lo:400:kworker.0 00000100:00100000:3.0:1789762967.206996:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149052800:0@lo:400:kworker.0 00000100:00100000:0.0:1789762967.207030:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149052928:0@lo:400:kworker.0 00000100:00100000:1.0:1789762967.207052:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762967.207052:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762967.207053:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762967.207082:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149052544 00000100:00100000:0.0:1789762967.207090:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149052544 00000100:00100000:0.0:1789762967.207137:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789762967.207147:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149053056:0@lo:400:kworker.0 00000100:00100000:3.0:1789762967.207147:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149053312:0@lo:400:kworker.0 00000100:00100000:0.0:1789762967.207150:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149052544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762967.207150:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149053184:0@lo:400:kworker.0 00000100:00100000:1.0:1789762967.207209:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762967.207219:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762967.207231:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149052800 00000100:00100000:3.0:1789762967.207236:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149052800 00000100:00100000:0.0:1789762967.207258:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149052544:12345-0@lo:400:kworker.0 Request processed in 109us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762967.207268:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789762967.207268:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149052544:0@lo:400:kworker.0 00000100:00100000:3.0:1789762967.207273:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149053184 00000100:00100000:3.0:1789762967.207278:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149053184 00000100:00100000:1.0:1789762967.207294:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789762967.207304:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149052800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762967.207312:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149052672 00000100:00100000:2.0:1789762967.207317:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149052672 00000100:00100000:3.0:1789762967.207320:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789762967.207330:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149053184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762967.207338:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149053056 00000100:00100000:0.0:1789762967.207343:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149053056 00000100:00100000:1.0:1789762967.207350:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149052800:12345-0@lo:400:kworker.0 Request processed in 48us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762967.207363:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789762967.207363:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789762967.207379:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149052672:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762967.207386:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149053184:12345-0@lo:400:kworker.0 Request processed in 56us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762967.207394:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789762967.207399:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789762967.207401:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762967.207411:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149053056:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789762967.207415:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789762967.207420:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149052928 00000100:00100000:3.0:1789762967.207424:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149052928 00000100:00100000:1.0:1789762967.207462:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789762967.207467:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3278:x1876702149053056:12345-0@lo:400:kworker.0 Request processed in 60us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762967.207479:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789762967.207479:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149052928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762967.207481:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149052672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (433us total) trans 0 rc 0/0 00000100:00080000:3.0:1789762967.207484:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762967.207495:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1789762967.207499:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762967.207522:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762967.207526:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149053056:0@lo:400:kworker.0 00000100:00100000:1.0:1789762967.207536:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149052928:12345-0@lo:400:kworker.0 Request processed in 63us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762967.207543:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789762967.207558:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d15225a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149052672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762967.207570:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149052800:0@lo:400:kworker.0 00000100:00100000:2.0:1789762967.207577:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149053184:0@lo:400:kworker.0 00000100:00100000:1.0:1789762967.207584:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149052928:0@lo:400:kworker.0 00000100:00100000:0.0:1789762967.207622:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149053312 00000100:00100000:0.0:1789762967.207627:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149053312 00000100:00100000:0.0:1789762967.207652:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789762967.207657:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149053312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762967.207694:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149053312:12345-0@lo:400:kworker.0 Request processed in 35us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762967.207701:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789762967.207730:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149053312:0@lo:400:kworker.0 00000100:00100000:1.0:1789762967.412459:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762967.412510:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762967.412529:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140888832 00000100:00100000:2.0:1789762967.412541:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140888832 00000100:00100000:1.0:1789762967.412549:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762967.412550:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140888448 00000100:00100000:3.0:1789762967.412557:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140888448 00000100:00100000:1.0:1789762967.412579:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762967.412609:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 317 00000100:00100000:0.0:1789762967.412614:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140888704 00000100:00100000:1.0:1789762967.412615:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762967.412621:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140888704 00000100:00100000:3.0:1789762967.412622:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140888448:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762967.412625:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 170 00000100:00100000:2.0:1789762967.412643:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2341:x1876702140888832:12345-192.168.203.31@tcp:9:kworker.0 00000100:00100000:1.0:1789762967.412645:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140888576 00000100:00100000:1.0:1789762967.412652:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140888576 00000100:00100000:0.0:1789762967.412668:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 169 00000020:00000080:2.0:1789762967.412671:0:8803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd08452c77c57102f 00000100:00100000:0.0:1789762967.412680:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140888704:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:2.0:1789762967.412684:0:8803:0:(import.c:65:import_set_state_nolock()) ffff95d151b3a000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789762967.412692:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140888448:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 73us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762967.412695:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140888960 00000100:00100000:1.0:1789762967.412700:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140888960 00000100:00100000:3.0:1789762967.412701:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 317 00000100:00100000:0.0:1789762967.412719:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140888704:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 42us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762967.412733:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 169 00000001:00000004:2.0:1789762967.412736:0:8803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967416 00000100:00100000:1.0:1789762967.412738:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 280 00000100:00080000:3.0:1789762967.412747:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762967.412752:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762967.412757:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762967.412765:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d152258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140888576:12345-192.168.203.31@tcp:400:kworker.0 00010000:00010000:3.0:1789762967.412783:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762967.412798:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 281 00000100:00100000:3.0:1789762967.412810:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d15225a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140888960:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762967.412811:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d152258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140888576:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 47us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762967.412863:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 280 00000100:00100000:3.0:1789762967.412936:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2344:x1876702140888960:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 130us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762967.412943:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 281 00000100:00100000:2.0:1789762967.413086:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d15225a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+2:2341:x1876702140888832:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 448us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762967.413096:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 170 00010000:00010000:0.0:1789762967.590947:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762967.719935:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149053440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762967.719999:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762967.720033:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149053440 00000100:00100000:2.0:1789762967.720043:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149053440 00000100:00100000:2.0:1789762967.720090:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789762967.720100:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149053440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762967.720129:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526581760 pending 0 free 3754950656 avail 3752853504 00000100:00100000:2.0:1789762967.720193:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1876702149053440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762967.720200:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789762967.720216:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149053440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762968.614994:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762969.638967:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789762969.775438:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:2.0:1789762969.775444:0:7606:0:(genops.c:885:class_export_put()) final put ffff95d151b39800/77777931-b235-4c03-82d2-4b1d12553008 00000020:00000080:0.0:1789762969.775486:0:2356:0:(genops.c:844:class_export_destroy()) destroying export ffff95d151b39800/77777931-b235-4c03-82d2-4b1d12553008 for lustre-OST0001 00000020:00000080:0.0:1789762969.775532:0:2356:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d151b3a000 for lustre-OST0001 00010000:00010000:3.0:1789762970.662984:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789762970.806216:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968031 is committed 00010000:00010000:0.0:1789762971.687041:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762972.327017:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149053568:0@lo:400:kworker.0 00000100:00100000:1.0:1789762972.327021:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149053952:0@lo:400:kworker.0 00000100:00100000:2.0:1789762972.327025:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d17414c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149053696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762972.327041:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149053824:0@lo:400:kworker.0 00000100:00100000:3.0:1789762972.327106:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762972.327107:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762972.327111:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762972.327152:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149053568 00000100:00100000:0.0:1789762972.327162:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149053568 00000100:00100000:2.0:1789762972.327172:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149054080:0@lo:400:kworker.0 00000100:00100000:3.0:1789762972.327181:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149054208:0@lo:400:kworker.0 00000100:00100000:1.0:1789762972.327193:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149053952 00000100:00100000:1.0:1789762972.327199:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149053952 00000100:00100000:2.0:1789762972.327205:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762972.327214:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789762972.327227:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149053568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762972.327228:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762972.327257:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149053696 00000100:00100000:1.0:1789762972.327259:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149054208 00000100:00100000:2.0:1789762972.327264:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149053696 00000100:00100000:1.0:1789762972.327265:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149054208 00000100:00080000:3.0:1789762972.327283:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762972.327289:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149053568:12345-0@lo:400:kworker.0 Request processed in 65us (188us total) trans 0 rc 0/0 00000100:00080000:3.0:1789762972.327290:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762972.327299:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789762972.327303:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789762972.327311:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789762972.327316:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149053952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762972.327321:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789762972.327325:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149054208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762972.327336:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149053696:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762972.327338:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149054080 00000100:00100000:0.0:1789762972.327343:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149054080 00002000:00000024:2.0:1789762972.327367:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762972.327368:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149053952:12345-0@lo:400:kworker.0 Request processed in 55us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762972.327377:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149054208:12345-0@lo:400:kworker.0 Request processed in 56us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762972.327384:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789762972.327385:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789762972.327397:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789762972.327398:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149054080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762972.327419:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149053696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (317us total) trans 0 rc 0/0 00000100:00080000:3.0:1789762972.327429:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762972.327432:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789762972.327437:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762972.327439:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149054080:12345-0@lo:400:kworker.0 Request processed in 41us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762972.327447:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789762972.327459:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149054208:0@lo:400:kworker.0 00000100:00100000:1.0:1789762972.327469:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149054336:0@lo:400:kworker.0 00000100:00100000:3.0:1789762972.327477:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149053568:0@lo:400:kworker.0 00000100:00100000:2.0:1789762972.327491:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d17414c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149053696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762972.327503:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149053952:0@lo:400:kworker.0 00000100:00100000:1.0:1789762972.327513:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762972.327519:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968031 gen 2 00000004:00080000:2.0:1789762972.327524:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d1488dfb80, transno 4294968031 00000100:00100000:3.0:1789762972.327526:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149053824 00000100:00100000:3.0:1789762972.327531:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149053824 00000100:00100000:0.0:1789762972.327541:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149054336 00000100:00100000:2.0:1789762972.327543:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149054080:0@lo:400:kworker.0 00000100:00100000:0.0:1789762972.327546:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149054336 00000100:00100000:3.0:1789762972.327567:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789762972.327578:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149053824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762972.327581:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789762972.327592:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149054336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762972.327624:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149053824:12345-0@lo:400:kworker.0 Request processed in 49us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762972.327631:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789762972.327644:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149054336:12345-0@lo:400:kworker.0 Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762972.327645:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149053824:0@lo:400:kworker.0 00000100:00100000:0.0:1789762972.327659:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789762972.327667:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149054336:0@lo:400:kworker.0 00000100:00100000:1.0:1789762972.532576:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762972.532626:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762972.532646:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140889216 00000100:00100000:1.0:1789762972.532652:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789762972.532656:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140889216 00000100:00100000:3.0:1789762972.532668:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140889088 00000100:00100000:3.0:1789762972.532675:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140889088 00000100:00100000:1.0:1789762972.532697:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762972.532714:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140889472 00000100:00100000:0.0:1789762972.532720:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140889472 00000100:00100000:3.0:1789762972.532737:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 319 00000100:00100000:2.0:1789762972.532738:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 285 00000100:00080000:1.0:1789762972.532754:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762972.532760:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d150eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140889088:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762972.532761:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140889216:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762972.532768:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 286 00000100:00100000:0.0:1789762972.532781:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140889472:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762972.532801:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140889344 00000100:00100000:1.0:1789762972.532807:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140889344 00000100:00100000:2.0:1789762972.532868:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140889216:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 116us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762972.532872:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140889472:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 87us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762972.532872:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d150eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140889088:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 119us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762972.532888:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:2.0:1789762972.532888:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 285 00000100:00100000:3.0:1789762972.532893:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 319 00000100:00100000:0.0:1789762972.532897:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 286 00000100:00100000:1.0:1789762972.532903:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140889344:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762972.532966:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140889344:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 68us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762972.532976:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00080000:1.0:1789762972.532998:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762972.710972:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762972.839012:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789762972.839032:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149054464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762972.839101:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762972.839160:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149054464 00000100:00100000:2.0:1789762972.839193:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149054464 00000100:00100000:2.0:1789762972.839249:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789762972.839261:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149054464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762972.839295:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526581760 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762972.839351:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149054464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762972.839359:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789762972.839382:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149054464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762973.735017:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762974.758953:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762975.782996:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762976.807014:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762977.446991:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149054592:0@lo:400:kworker.0 00000100:00100000:3.0:1789762977.446994:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149054720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762977.447002:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149054848:0@lo:400:kworker.0 00000100:00100000:3.0:1789762977.447080:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762977.447087:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762977.447087:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762977.447181:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149055232:0@lo:400:kworker.0 00000100:00100000:2.0:1789762977.447184:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149055360:0@lo:400:kworker.0 00000100:00100000:1.0:1789762977.447187:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149055104:0@lo:400:kworker.0 00000100:00100000:3.0:1789762977.447219:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762977.447229:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762977.447244:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149054976:0@lo:400:kworker.0 00000100:00100000:1.0:1789762977.447274:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762977.447275:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149055360 00000100:00100000:0.0:1789762977.447283:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149055360 00000100:00100000:2.0:1789762977.447284:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149054848 00000100:00100000:2.0:1789762977.447290:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149054848 00000100:00100000:1.0:1789762977.447316:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149054592 00000100:00100000:1.0:1789762977.447322:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149054592 00000100:00100000:3.0:1789762977.447323:0:7133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149054720 00000100:00100000:3.0:1789762977.447329:0:7133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149054720 00000100:00100000:2.0:1789762977.447332:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149055232 00000100:00100000:2.0:1789762977.447337:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149055232 00000100:00100000:0.0:1789762977.447341:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789762977.447352:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149055360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762977.447363:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789762977.447373:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149054976 00000100:00100000:3.0:1789762977.447373:0:7133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789762977.447375:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149054592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762977.447379:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149054976 00000100:00100000:0.0:1789762977.447412:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3276:x1876702149055360:12345-0@lo:400:kworker.0 Request processed in 61us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762977.447419:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789762977.447424:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789762977.447435:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3278:x1876702149054592:12345-0@lo:400:kworker.0 Request processed in 54us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762977.447445:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789762977.447450:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1462c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149054848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762977.447487:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789762977.447501:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1462c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149054848:12345-0@lo:400:kworker.0 Request processed in 51us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762977.447508:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789762977.447512:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149055232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762977.447515:0:7133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d173d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149054720:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762977.447532:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789762977.447541:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149054976:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789762977.447557:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762977.447563:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762977.447573:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149055232:12345-0@lo:400:kworker.0 Request processed in 65us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762977.447581:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789762977.447583:0:7133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789762977.447588:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789762977.447588:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1876702149054976:12345-0@lo:400:kworker.0 Request processed in 46us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762977.447597:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789762977.447619:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3278:1876702149054592:0@lo:400:kworker.0 00000100:00100000:3.0:1789762977.447634:0:7133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d173d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1876702149054720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 249us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762977.447643:0:7133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789762977.447647:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1876702149054976:0@lo:400:kworker.0 00000100:00100000:2.0:1789762977.447647:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149055104 00000100:00100000:2.0:1789762977.447653:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149055104 00000100:00100000:0.0:1789762977.447679:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149055232:0@lo:400:kworker.0 00000100:00100000:2.0:1789762977.447698:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00080000:1.0:1789762977.447700:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762977.447702:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1876702149054720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762977.447709:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149055104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762977.447751:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149055104:12345-0@lo:400:kworker.0 Request processed in 47us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762977.447758:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789762977.447767:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149055104:0@lo:400:kworker.0 00000100:00100000:2.0:1789762977.447792:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149055360:0@lo:400:kworker.0 00000100:00100000:2.0:1789762977.447800:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149054848:0@lo:400:kworker.0 00000100:00100000:0.0:1789762977.652502:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762977.652537:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762977.652556:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762977.652571:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140889728 00000100:00100000:3.0:1789762977.652583:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140889600 00000100:00100000:0.0:1789762977.652587:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762977.652594:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140889600 00000100:00100000:1.0:1789762977.652596:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140889728 00000100:00080000:0.0:1789762977.652640:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762977.652653:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140889856 00000100:00100000:3.0:1789762977.652653:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 321 00000100:00100000:1.0:1789762977.652656:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140889984 00000100:00100000:2.0:1789762977.652661:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140889856 00000100:00100000:1.0:1789762977.652662:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140889984 00000100:00100000:3.0:1789762977.652668:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140889600:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762977.652685:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 290 00000100:00100000:0.0:1789762977.652697:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140889728:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762977.652708:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 291 00000100:00100000:1.0:1789762977.652720:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140889984:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789762977.652725:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:3.0:1789762977.652732:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2343:x1876702140889600:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 65us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762977.652743:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140889856:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762977.652743:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 321 00000100:00100000:0.0:1789762977.652745:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:77777931-b235-4c03-82d2-4b1d12553008+5:2342:x1876702140889728:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 52us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762977.652757:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 290 00000100:00100000:1.0:1789762977.652773:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2342:x1876702140889984:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 55us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762977.652783:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 291 00000100:00100000:2.0:1789762977.652787:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2343:x1876702140889856:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 50us (228us total) trans 0 rc 0/0 00000100:00080000:0.0:1789762977.652798:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762977.652805:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762977.652809:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 175 00010000:00010000:3.0:1789762977.831010:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762977.959024:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149055488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762977.959111:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762977.959167:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149055488 00000100:00100000:2.0:1789762977.959175:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149055488 00000100:00100000:2.0:1789762977.959221:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789762977.959230:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149055488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762977.959261:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526581760 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762977.959306:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149055488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762977.959312:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789762977.959348:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149055488:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762978.854971:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762979.879035:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762980.903123:0:6670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762981.927039:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762982.567135:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1462c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149055616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762982.567184:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1526dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149055744:0@lo:400:kworker.0 00000100:00100000:2.0:1789762982.567232:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d173f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149055872:0@lo:400:kworker.0 00000100:00100000:0.0:1789762982.567247:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762982.567277:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762982.567321:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149055616 00000100:00100000:3.0:1789762982.567335:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149055616 00000100:00100000:2.0:1789762982.567362:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762982.567380:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149056128:0@lo:400:kworker.0 00000100:00100000:1.0:1789762982.567390:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149056256:0@lo:400:kworker.0 00000100:00100000:2.0:1789762982.567431:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1463ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149056384:0@lo:400:kworker.0 00000100:00100000:3.0:1789762982.567462:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789762982.567463:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762982.567496:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762982.567508:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149055616:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789762982.567524:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762982.567552:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762982.567586:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149056128 00002000:00000024:3.0:1789762982.567586:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789762982.567602:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149056128 00000100:00100000:2.0:1789762982.567607:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789762982.567622:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d147cdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149056000:0@lo:400:kworker.0 00000100:00100000:1.0:1789762982.567634:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149055872 00000100:00100000:1.0:1789762982.567648:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149055872 00000100:00100000:2.0:1789762982.567720:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762982.567721:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149055616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 219us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762982.567722:0:10283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149056384 00000100:00100000:0.0:1789762982.567737:0:10283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149056384 00000100:00100000:3.0:1789762982.567745:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789762982.567751:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149056256 00000100:00100000:1.0:1789762982.567761:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149056256 00000100:00100000:3.0:1789762982.567810:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149056000 00000100:00100000:3.0:1789762982.567820:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149056000 00000100:00100000:2.0:1789762982.567827:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789762982.567879:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149056128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762982.567888:0:10283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789762982.567907:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789762982.567922:0:10283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149056384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762982.567945:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149055872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762982.567964:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789762982.567980:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1876702149056128:12345-0@lo:400:kworker.0 Request processed in 104us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762982.567986:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149056256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762982.568014:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789762982.568031:0:10283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3276:x1876702149056384:12345-0@lo:400:kworker.0 Request processed in 126us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762982.568045:0:10283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789762982.568087:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876702149055872:12345-0@lo:400:kworker.0 Request processed in 129us (705us total) trans 0 rc 0/0 00000100:00080000:2.0:1789762982.568095:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762982.568104:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:2.0:1789762982.568108:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762982.568131:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876702149056256:12345-0@lo:400:kworker.0 Request processed in 147us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762982.568150:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789762982.568172:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d042633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149056000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762982.568180:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789762982.568197:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1876702149056384:0@lo:400:kworker.0 00000100:00100000:1.0:1789762982.568226:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149055744 00000100:00100000:2.0:1789762982.568236:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d173f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876702149055872:0@lo:400:kworker.0 00000100:00100000:1.0:1789762982.568237:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149055744 00000100:00100000:0.0:1789762982.568258:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d042633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876702149056000:12345-0@lo:400:kworker.0 Request processed in 91us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762982.568278:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789762982.568299:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149056128:0@lo:400:kworker.0 00000100:00100000:2.0:1789762982.568310:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d147cdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1876702149056000:0@lo:400:kworker.0 00000100:00100000:1.0:1789762982.568336:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789762982.568356:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1462c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1876702149055616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762982.568358:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149055744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762982.568451:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f+19:3279:x1876702149055744:12345-0@lo:400:kworker.0 Request processed in 100us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762982.568456:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1463cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1876702149056256:0@lo:400:kworker.0 00000100:00100000:1.0:1789762982.568482:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789762982.568486:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1526dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27f3d6dd-3aeb-4425-9393-dc1bb3ae146f:3279:1876702149055744:0@lo:400:kworker.0 00000100:00100000:0.0:1789762982.772960:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762982.773014:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789762982.773054:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789762982.773085:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140890112 00000100:00100000:3.0:1789762982.773112:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140890112 00000100:00100000:0.0:1789762982.773125:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789762982.773154:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140890240 00000100:00100000:1.0:1789762982.773169:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140890240 00000100:00100000:2.0:1789762982.773178:0:8803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140890368 00000100:00100000:2.0:1789762982.773191:0:8803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140890368 00000100:00100000:3.0:1789762982.773201:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 323 00000100:00100000:3.0:1789762982.773222:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d16a182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140890112:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:0.0:1789762982.773248:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762982.773261:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762982.773295:0:8803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:0.0:1789762982.773304:0:13232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702140890496 00000100:00100000:0.0:1789762982.773316:0:13232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702140890496 00000100:00100000:1.0:1789762982.773321:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 295 00000100:00100000:2.0:1789762982.773325:0:8803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140890368:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789762982.773328:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d16a182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10092651-e3dd-4a03-ad8e-f8dd26fd4c3e+13:2344:x1876702140890112:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 105us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762982.773359:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 323 00000100:00100000:1.0:1789762982.773362:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140890240:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789762982.773402:0:13232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 296 00000100:00100000:2.0:1789762982.773419:0:8803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77777931-b235-4c03-82d2-4b1d12553008+5:2344:x1876702140890368:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 104us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762982.773428:0:13232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d1488dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140890496:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789762982.773451:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77777931-b235-4c03-82d2-4b1d12553008+5:2345:x1876702140890240:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 103us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762982.773458:0:8803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:1.0:1789762982.773476:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 295 00000100:00100000:0.0:1789762982.773533:0:13232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d1488dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9ed6d081-3f08-4f7b-834f-c9f807e3a9cb+5:2345:x1876702140890496:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 112us (405us total) trans 0 rc 0/0 00000100:00080000:1.0:1789762982.773551:0:5809:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762982.773554:0:13232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 296 00010000:00010000:3.0:1789762982.951042:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762983.079120:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d1488dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149056512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762983.079206:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762983.079288:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702149056512 00000100:00100000:2.0:1789762983.079318:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702149056512 00000100:00100000:2.0:1789762983.079395:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789762983.079411:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d17414f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149056512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762983.079456:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526581760 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789762983.079533:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d17414f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1876702149056512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762983.079542:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789762983.079634:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d1488dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1876702149056512:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789762983.975112:0:6671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 59612 lines, 59612 kept, 0 dropped, 0 bad.